-- Logs begin at Wed 2022-06-15 09:50:37 UTC, end at Wed 2022-06-15 10:54:10 UTC. -- Jun 15 10:20:10.804303 dv-cinder-843493-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 15 10:20:10.815963 dv-cinder-843493-2-smb devstack@keystone.service[80107]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 15 10:20:10.817992 dv-cinder-843493-2-smb devstack@keystone.service[80107]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 10:20:10 2022] *** Jun 15 10:20:10.817992 dv-cinder-843493-2-smb devstack@keystone.service[80107]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 10:20:10.817992 dv-cinder-843493-2-smb devstack@keystone.service[80107]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 10:20:10.817992 dv-cinder-843493-2-smb devstack@keystone.service[80107]: nodename: dv-cinder-843493-2-smb Jun 15 10:20:10.817992 dv-cinder-843493-2-smb devstack@keystone.service[80107]: machine: x86_64 Jun 15 10:20:10.817992 dv-cinder-843493-2-smb devstack@keystone.service[80107]: clock source: unix Jun 15 10:20:10.817992 dv-cinder-843493-2-smb devstack@keystone.service[80107]: pcre jit disabled Jun 15 10:20:10.817992 dv-cinder-843493-2-smb devstack@keystone.service[80107]: detected number of CPU cores: 4 Jun 15 10:20:10.817992 dv-cinder-843493-2-smb devstack@keystone.service[80107]: current working directory: / Jun 15 10:20:10.817992 dv-cinder-843493-2-smb devstack@keystone.service[80107]: detected binary path: /usr/bin/uwsgi-core Jun 15 10:20:10.818641 dv-cinder-843493-2-smb devstack@keystone.service[80107]: your processes number limit is 47680 Jun 15 10:20:10.818641 dv-cinder-843493-2-smb devstack@keystone.service[80107]: your memory page size is 4096 bytes Jun 15 10:20:10.818641 dv-cinder-843493-2-smb devstack@keystone.service[80107]: detected max file descriptor number: 2048 Jun 15 10:20:10.818641 dv-cinder-843493-2-smb devstack@keystone.service[80107]: lock engine: pthread robust mutexes Jun 15 10:20:10.818641 dv-cinder-843493-2-smb devstack@keystone.service[80107]: thunder lock: enabled Jun 15 10:20:10.818641 dv-cinder-843493-2-smb devstack@keystone.service[80107]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 15 10:20:10.818641 dv-cinder-843493-2-smb devstack@keystone.service[80107]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 10:20:10.864009 dv-cinder-843493-2-smb devstack@keystone.service[80107]: Python main interpreter initialized at 0x55895584e9c0 Jun 15 10:20:10.864009 dv-cinder-843493-2-smb devstack@keystone.service[80107]: python threads support enabled Jun 15 10:20:10.864009 dv-cinder-843493-2-smb devstack@keystone.service[80107]: your server socket listen backlog is limited to 100 connections Jun 15 10:20:10.864009 dv-cinder-843493-2-smb devstack@keystone.service[80107]: your mercy for graceful operations on workers is 90 seconds Jun 15 10:20:10.864360 dv-cinder-843493-2-smb devstack@keystone.service[80107]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 10:20:10.864438 dv-cinder-843493-2-smb devstack@keystone.service[80107]: *** Operational MODE: preforking *** Jun 15 10:20:10.864696 dv-cinder-843493-2-smb devstack@keystone.service[80107]: *** uWSGI is running in multiple interpreter mode *** Jun 15 10:20:10.864696 dv-cinder-843493-2-smb devstack@keystone.service[80107]: spawned uWSGI master process (pid: 80107) Jun 15 10:20:10.864887 dv-cinder-843493-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 15 10:20:10.866579 dv-cinder-843493-2-smb devstack@keystone.service[80107]: spawned uWSGI worker 1 (pid: 80117, cores: 1) Jun 15 10:20:10.866579 dv-cinder-843493-2-smb devstack@keystone.service[80107]: spawned uWSGI worker 2 (pid: 80118, cores: 1) Jun 15 10:20:10.866579 dv-cinder-843493-2-smb devstack@keystone.service[80107]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 10:20:16.357411 dv-cinder-843493-2-smb devstack@keystone.service[80118]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:20:16.357411 dv-cinder-843493-2-smb devstack@keystone.service[80118]: from cryptography.utils import int_from_bytes Jun 15 10:20:16.358219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:20:16.358219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: from cryptography.utils import int_from_bytes Jun 15 10:20:16.362873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:20:16.362873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: from cryptography.utils import int_from_bytes Jun 15 10:20:16.363347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 10:20:16.363347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: from cryptography.utils import int_from_bytes Jun 15 10:20:16.407688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 10:20:16.407879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 10:20:16.408071 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] command line args: [] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 10:20:16.408340 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 10:20:16.408518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ================================================================================ {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 10:20:16.408772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] admin_token = **** {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.409024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] config_dir = [] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.409211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.409390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] config_source = [] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.409567 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] debug = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.409765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.411173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.411173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.411359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 10:20:16.411359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 10:20:16.411517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.411605 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] command line args: [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 10:20:16.411692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.411772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 10:20:16.411845 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] list_limit = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.411924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ================================================================================ {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 10:20:16.411997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] log_config_append = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.412080 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] admin_token = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.412153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.412153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] log_dir = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.412290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] config_dir = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.412363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] log_file = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.412434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.412518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.412597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] config_source = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.412597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] debug = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.412740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.412819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.412928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.413003 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.413075 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.413149 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.413220 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.413293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.413374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.413454 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.413527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.413599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] list_limit = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.413677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.413756 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] log_config_append = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.413840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.413919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.413919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] log_dir = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.414061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.414139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] log_file = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.414222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.414296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.414378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.414452 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.414531 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.414682 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.414791 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.414928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.415009 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.415110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.415294 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.415501 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.415599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.415675 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] publish_errors = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.415801 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.415925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.416053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.416178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.416293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.416408 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.416522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.416636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.416759 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.416880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.416986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.417105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] standard_threads = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.417221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.417343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.417470 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.417602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.417602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.417837 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] use_journal = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.417961 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.418078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] use_json = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.418194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] publish_errors = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.418315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] use_stderr = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.418315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] use_syslog = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.418585 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.418703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.418824 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.418824 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.419029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.419153 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.419276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.419392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.419539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.419658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] standard_threads = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.419780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.419908 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.420025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.420140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.420140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.420362 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.420483 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] use_journal = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.420607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.420729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] use_json = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.420729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] use_stderr = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.420945 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.421060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] use_syslog = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.421175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.421298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 10:20:16.421415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.421529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.421644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.421765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.421880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.422010 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.422126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.422240 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.422361 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.422478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.422598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.422722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.422838 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.422953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.423074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.423196 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.423318 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.423444 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.423587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.423703 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.423703 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.423918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.424033 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.424223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.424342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.424342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.424565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.424680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.424794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.424920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.425043 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.425173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.425289 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.425404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.425404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.425629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.425745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.425860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.425975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.425975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.426190 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.426313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.426430 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.426551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.426667 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.426788 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.426904 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.427027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.427144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.427264 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.427379 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.427508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.427508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.427747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.427861 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.427976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.428097 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.428213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.428334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.428455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.428618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.428740 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.428855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.428970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.429097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.429213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.429328 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.429442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.429557 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.429671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.429862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.429980 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.430096 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.430211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.430333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.430449 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.430572 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.430688 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.430805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.430920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.431034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.431149 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.431277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.431399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.432044 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.432161 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.432161 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.432376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.432504 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.432621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.432736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.432851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.432966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.433081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.433209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.433339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.433456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.433577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.433693 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.433839 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.433954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.434053 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.434160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.434257 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.434354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.434450 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.434567 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.434667 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.434764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.434869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.434988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.435105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.435229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.435346 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.435533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.435668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.435786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.435902 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.436010 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.436137 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.436263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.436380 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.436502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.436619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.436734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.436850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.436975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.437100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.437223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.437346 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.437464 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.437580 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.437704 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.437822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.437937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.438056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.438173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.438296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.438417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.438535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.438650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.438765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.438880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.439004 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.439121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.439237 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.439353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.439483 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.439613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.439740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.439857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.439973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.440089 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.440206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.440321 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.440446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.440563 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.440685 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.440801 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.440918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.441071 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.441200 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.441325 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.441442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.441558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.441680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.441885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.442086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.442206 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.442324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.442450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.442573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.442690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.442815 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.442941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.443071 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.443190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.443307 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.443423 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.443566 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.443683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.443813 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.443931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.444047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.444170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.444170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.444170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.444170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.444170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.444710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.444710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.444927 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.445071 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.445330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.445602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.445876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.446131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.446250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.446366 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] auth.external = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.446494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.446614 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.446730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] auth.external = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.446893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.447015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.447847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.447984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.448114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] auth.password = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.448233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.448351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] auth.token = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.448536 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] auth.password = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.448657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.448773 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] auth.token = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.448899 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.449017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.449147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.449265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.449381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.449504 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.449630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.449739 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.449861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.449979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.450095 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.450211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.450337 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] credential.caching = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.450520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.450640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.450759 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] credential.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.450876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.451001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.451128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.451246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.451364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.451495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.451495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.451716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.451851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.451971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.452087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.452211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.452329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.452446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.452572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.452690 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.452809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.452926 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.453042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.453172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.453298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.453417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.453540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.453658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.453774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.453892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.454018 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.454145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.454263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.454380 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] federation.caching = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.454503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.454620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.454746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.454864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.454982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.455098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.455214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.455330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.455455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.455617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.455746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.455867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.455986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.456103 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.456229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.456356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.456480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.456599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.456717 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.456834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.456959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.457085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.457288 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.457408 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity.caching = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.457524 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.457640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.457830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.457950 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.458067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.458183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.458300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.458425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.458542 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.458659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.458781 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.458898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.459015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.459144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.459261 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.459384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.459515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.459633 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.459749 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.459878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.459996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.460113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.460230 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.460347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.460462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.460588 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.460749 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.460917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.461036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.461153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.461271 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.461396 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.461524 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.461642 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.461766 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.461884 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.462000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.462000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.462233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.462349 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.462349 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.462567 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.462689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.462689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.462918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.463034 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.463034 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.463252 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.463368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.463368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.463659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.463775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.463775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.463993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.464109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.464234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.464352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.464352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.464569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.464684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.464800 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.464923 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.465040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.465156 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.465355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.465477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.465619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.465821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.465942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.466084 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.466247 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.466367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.466555 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.466684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.466821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.467020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.467133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.467254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.467510 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.467649 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.467769 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.467884 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.468001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.468118 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.468235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.468360 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.468478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.468596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.468712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.468875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.469102 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.469231 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.469349 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.469465 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.469582 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.469703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.469820 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.469946 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.470065 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.470183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.470299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.470415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.470515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.470690 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.470813 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.470930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.471046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.471162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.471287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.471405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.471570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.471690 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.471806 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.471923 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.472052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.472171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.472288 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.472404 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.472521 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.472638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.472764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.472882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.472999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.473115 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.473232 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.473348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.473474 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.473593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.473710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.473827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.473944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.474060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.474185 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.474303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.474419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.474542 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.474661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.474777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.474905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.475023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.475139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.475256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.475372 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.475511 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.475644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.475763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.475881 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.475998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.476114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.476230 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.476356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.476474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.476590 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.476707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.476824 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.476941 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.477067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.477184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.477301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.477417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.477533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.477656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.477783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.477901 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.478019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.478136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.478252 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.478369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.478499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.478619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.478735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.478851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.478968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.479085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.479211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.479329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.479452 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.479618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.479739 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.479856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.479985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] role.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.480106 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.480222 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] role.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.480339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.480455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.480571 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.480697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.480815 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.480932 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.481056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.481175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.481291 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] resource.caching = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.481485 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.481605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.481722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.481845 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.481963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.482080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.482209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.482329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.482446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.482562 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.482679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.482795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.482920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.483038 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.483155 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.483280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.483398 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.483539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.483660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.483777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] role.caching = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.483777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] role.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.483996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.484113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.484239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.484372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.484548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.484670 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.484788 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.484905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.485034 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.485153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.485270 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.485388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.485506 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.485623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.485749 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.485867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.485984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.486101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.486217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.486334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.486460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.486578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.486694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.486818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.486936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.487052 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.487178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.487296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.487414 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.487414 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.487677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.487794 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.487924 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.488043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.488160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.488277 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.488393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.488511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.488636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.488872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.488995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.489310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.489438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.489557 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.489677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.489794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.489910 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.490026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.490150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.490268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.490384 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.490500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.490865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.490982 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.491106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.491230 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.491347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.491480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.491601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.491716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.491845 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.491963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.492080 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.492195 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.492310 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.492426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.492550 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.492668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] token.caching = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.492783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.492899 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.493014 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.493130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.493254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.connection = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.493380 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.493509 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.493627 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.493743 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.493860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.494466 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.494585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.494710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.494828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.494945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.495060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.495176 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.495292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.495416 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.495553 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.495669 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.495787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.495902 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.496018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.496147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.496265 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.496388 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.496506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.496622 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.496739 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.496864 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.496982 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.497098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.497215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.497330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.497446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.connection = **** {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.497575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.497705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.497823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.497940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.498056 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.498056 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 10:20:16.498275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.498275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.498275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.498275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.498275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.498275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.498911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.498911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.498911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.499239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.499239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.499507 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.499701 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.499932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.500173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.500409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 10:20:16.500580 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 10:20:16.615112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.615290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.615493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.616202 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.616437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.616667 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.624770 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.626048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.652412 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.652626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.653622 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.653856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.706725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.707027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.755276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.755530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.756344 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.756578 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.820769 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.820996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.821216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.821304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.821434 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.821520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.821658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.821742 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.821873 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.821968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.822123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.822339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.844906 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.845162 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.845272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.845353 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.845462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.845575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.845691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.845782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.845915 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.846000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.846134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.846217 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.846348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.846563 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.857807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.857917 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.871327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.871444 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.871585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.871693 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.871777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.871920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.872003 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.872142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.872233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.872358 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.872441 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.872568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.872650 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80118) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.872781 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80117) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 10:20:16.889598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.889808 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 10:20:16.890142 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.890225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.890342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 10:20:16.890427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 10:20:16.890607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.890691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.890892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 10:20:16.891033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.891159 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.891289 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.891580 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.891709 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.891880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.892135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.902356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.902631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.902893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.902976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.903166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.903263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.903434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.903744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.911248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:16.911921 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:16.914660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:16.914940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.915222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.915302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:16.915522 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.915620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.916325 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.916423 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.916589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.916673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.916855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.916939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.917124 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.917206 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.917388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.917469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.917654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.917735 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.917914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.917994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.918180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.918443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.945122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.945853 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.946739 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:16.947014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.947519 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:16.947800 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.952389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:16.952678 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.952957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.953139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:16.953418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.953693 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.960406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:16.960683 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.961233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:16.961513 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.965742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:16.966026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.966306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.966553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:16.966658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.966838 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.966923 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.967105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.967190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.967372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.967495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.967664 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.967750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.968000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.972105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.972105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.986891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.987171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.990381 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.990921 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.991984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:16.995510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:16.995655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.995948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.999138 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:16.999427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.001228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.004544 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.005022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.008151 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.010117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.010818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.011092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.011365 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.011657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.011928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.012025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.012227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.012507 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.012787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.013063 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.013336 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.032915 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.033156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.033244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.033436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.033535 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.033698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.033781 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.033957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.042209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.042393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.043954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.044118 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.044237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.044400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.047282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.047496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.047641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.047763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.049334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.049469 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.049634 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.049764 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.049926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.050048 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.063256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.063370 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.063573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.063672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.063854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.063938 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.064134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.064217 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.064410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.064494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.064680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.064772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.064951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.065036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.082937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.083068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.086203 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.086343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.090063 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.090202 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.091664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.091820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.093436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.093590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.093714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.093879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.093992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.094163 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.101300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.101456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.102910 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.103080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.106785 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.106877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.107071 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.107154 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.107349 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.107432 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.107644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.107730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.117122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.117244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.117407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.117528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.117684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.117804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.125676 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80118) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.125772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80117) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 10:20:17.125903 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.125988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.126179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.126262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.126451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.126535 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.126724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.126808 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.127011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.127095 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.127279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.127370 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.127570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.127654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.127842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.127975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.128201 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.128283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.128466 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.128547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.128723 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.128805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.128994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.129075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.129254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80117) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.129335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80118) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 10:20:17.167828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55895584e9c0 pid: 80118 (default app) Jun 15 10:20:17.167926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55895584e9c0 pid: 80117 (default app) Jun 15 10:20:17.171189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45169f2-7aac-4006-acca-b2d22163b874 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:17.171508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45169f2-7aac-4006-acca-b2d22163b874 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:17.171792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45169f2-7aac-4006-acca-b2d22163b874 None None] PATH_INFO: `/v3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:17.175961 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Wed Jun 15 10:20:17 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:24.880725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf754078-ca64-4b85-9d8b-64b18c62beb1 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:24.881285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf754078-ca64-4b85-9d8b-64b18c62beb1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:24.881285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf754078-ca64-4b85-9d8b-64b18c62beb1 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:24.885615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:20:24.890798 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e6b9d-8d03-4f20-bb00-6cbb1d16f39e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:24.891185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e6b9d-8d03-4f20-bb00-6cbb1d16f39e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:24.891353 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e6b9d-8d03-4f20-bb00-6cbb1d16f39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:24.959937 dv-cinder-843493-2-smb devstack@keystone.service[80118]: INFO dbcounter [None req-729e6b9d-8d03-4f20-bb00-6cbb1d16f39e None None] Registered counter for database keystone Jun 15 10:20:24.980943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG oslo_db.sqlalchemy.engines [None req-729e6b9d-8d03-4f20-bb00-6cbb1d16f39e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:20:24.987065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writer thread running {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:20:25.165236 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG passlib.handlers.bcrypt [None req-729e6b9d-8d03-4f20-bb00-6cbb1d16f39e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80118) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 15 10:20:25.166178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG passlib.handlers.bcrypt [None req-729e6b9d-8d03-4f20-bb00-6cbb1d16f39e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80118) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 15 10:20:25.221367 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-729e6b9d-8d03-4f20-bb00-6cbb1d16f39e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:25.223186 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-729e6b9d-8d03-4f20-bb00-6cbb1d16f39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:25.344476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 15 10:20:25.489653 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf754078-ca64-4b85-9d8b-64b18c62beb1 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:25.559278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: INFO dbcounter [None req-cf754078-ca64-4b85-9d8b-64b18c62beb1 None None] Registered counter for database keystone Jun 15 10:20:25.578671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG oslo_db.sqlalchemy.engines [None req-cf754078-ca64-4b85-9d8b-64b18c62beb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80117) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 10:20:25.584775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writer thread running {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 10:20:25.705596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf754078-ca64-4b85-9d8b-64b18c62beb1 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:25.709864 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af00bba-d78c-4310-bbd6-09ccfd24f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:25.710526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00bba-d78c-4310-bbd6-09ccfd24f8bb admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:25.710810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00bba-d78c-4310-bbd6-09ccfd24f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:25.711083 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00bba-d78c-4310-bbd6-09ccfd24f8bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:25.719817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af00bba-d78c-4310-bbd6-09ccfd24f8bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:25.771447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1af00bba-d78c-4310-bbd6-09ccfd24f8bb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 15 10:20:25.771756 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af00bba-d78c-4310-bbd6-09ccfd24f8bb admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:25.781790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1324 bytes} [Wed Jun 15 10:20:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 10:20:25.787668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e6b9d-8d03-4f20-bb00-6cbb1d16f39e None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:25.804342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e6b9d-8d03-4f20-bb00-6cbb1d16f39e None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:25.808758 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4e815-824f-4bb8-ba94-ea914d51e3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:25.809844 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4e815-824f-4bb8-ba94-ea914d51e3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:25.810132 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4e815-824f-4bb8-ba94-ea914d51e3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:25.810409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4e815-824f-4bb8-ba94-ea914d51e3a1 admin admin] PATH_INFO: `/v3/projects/e426bab74fde45f595bae4efed952751` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:25.811976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4e815-824f-4bb8-ba94-ea914d51e3a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=e426bab74fde45f595bae4efed952751)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:25.863111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c2a4e815-824f-4bb8-ba94-ea914d51e3a1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 15 10:20:25.863459 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4e815-824f-4bb8-ba94-ea914d51e3a1 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:25.868327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 3/5] 10.222.0.50 () {56 vars in 1207 bytes} [Wed Jun 15 10:20:25 2022] GET /identity/v3/projects/e426bab74fde45f595bae4efed952751 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:27.961553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec84a1f-0475-465e-95fe-68bcb664ac81 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:27.962053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec84a1f-0475-465e-95fe-68bcb664ac81 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:27.962053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec84a1f-0475-465e-95fe-68bcb664ac81 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:27.966143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 3/6] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:20:27.971562 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd162f-d634-4c3e-81fd-f7ded5c9c7cf None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:27.971977 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd162f-d634-4c3e-81fd-f7ded5c9c7cf None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:27.972118 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd162f-d634-4c3e-81fd-f7ded5c9c7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:27.991115 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-f9dd162f-d634-4c3e-81fd-f7ded5c9c7cf None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:27.992667 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f9dd162f-d634-4c3e-81fd-f7ded5c9c7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:28.001031 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 15 10:20:28.024199 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec84a1f-0475-465e-95fe-68bcb664ac81 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:28.036357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec84a1f-0475-465e-95fe-68bcb664ac81 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:28.040529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe90d2-357c-457b-bd55-ab6b3ab8d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:28.041641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe90d2-357c-457b-bd55-ab6b3ab8d1cc admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:28.041924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe90d2-357c-457b-bd55-ab6b3ab8d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:28.042196 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe90d2-357c-457b-bd55-ab6b3ab8d1cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:28.049858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe90d2-357c-457b-bd55-ab6b3ab8d1cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:28.051658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe90d2-357c-457b-bd55-ab6b3ab8d1cc admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:28.061018 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1324 bytes} [Wed Jun 15 10:20:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 10:20:28.066096 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd162f-d634-4c3e-81fd-f7ded5c9c7cf None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:28.074999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd162f-d634-4c3e-81fd-f7ded5c9c7cf None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:28.080415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e265f0-84bf-495e-82e3-1edab94c8fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:28.085477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e265f0-84bf-495e-82e3-1edab94c8fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:28.085765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e265f0-84bf-495e-82e3-1edab94c8fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:28.086078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e265f0-84bf-495e-82e3-1edab94c8fc7 admin admin] PATH_INFO: `/v3/users/283045f7f6ca4861bfbecc3aa402c697` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:28.087589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e265f0-84bf-495e-82e3-1edab94c8fc7 admin admin] RBAC: Authorizing `identity:get_user(user_id=283045f7f6ca4861bfbecc3aa402c697)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:28.089435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e265f0-84bf-495e-82e3-1edab94c8fc7 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:28.091034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 5/9] 10.222.0.50 () {56 vars in 1198 bytes} [Wed Jun 15 10:20:28 2022] GET /identity/v3/users/283045f7f6ca4861bfbecc3aa402c697 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:30.276020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63d6bf-389f-436b-9d7a-bdb9cb2dc200 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:30.276565 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63d6bf-389f-436b-9d7a-bdb9cb2dc200 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:30.276565 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63d6bf-389f-436b-9d7a-bdb9cb2dc200 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:30.277971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:30.284032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff756ad1-9a18-49ba-b6f5-dd0c18f2829e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:30.284472 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff756ad1-9a18-49ba-b6f5-dd0c18f2829e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:30.284570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff756ad1-9a18-49ba-b6f5-dd0c18f2829e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:30.302905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ff756ad1-9a18-49ba-b6f5-dd0c18f2829e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:30.304111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ff756ad1-9a18-49ba-b6f5-dd0c18f2829e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:30.307955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693f343-e31d-4636-99ed-cbb2dcb8136f None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:30.308242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693f343-e31d-4636-99ed-cbb2dcb8136f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:30.308516 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693f343-e31d-4636-99ed-cbb2dcb8136f None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:30.310143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 6/11] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:20:30.317137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c84ad0-2780-4297-942f-5aa228d46f91 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:30.319818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c84ad0-2780-4297-942f-5aa228d46f91 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:30.319818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c84ad0-2780-4297-942f-5aa228d46f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:30.363025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG passlib.handlers.bcrypt [None req-69c84ad0-2780-4297-942f-5aa228d46f91 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80117) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 15 10:20:30.363452 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG passlib.handlers.bcrypt [None req-69c84ad0-2780-4297-942f-5aa228d46f91 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80117) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 15 10:20:30.389684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:30.409837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-69c84ad0-2780-4297-942f-5aa228d46f91 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:30.411489 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-69c84ad0-2780-4297-942f-5aa228d46f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:30.413610 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff756ad1-9a18-49ba-b6f5-dd0c18f2829e None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:30.438656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:30.526867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff756ad1-9a18-49ba-b6f5-dd0c18f2829e None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:30.530171 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:20:30.552985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c84ad0-2780-4297-942f-5aa228d46f91 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:30.568588 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65835a49-1ae9-4b66-91f7-b07cefd331e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:30.569395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65835a49-1ae9-4b66-91f7-b07cefd331e5 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:30.569680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65835a49-1ae9-4b66-91f7-b07cefd331e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:30.569962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65835a49-1ae9-4b66-91f7-b07cefd331e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:30.584390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65835a49-1ae9-4b66-91f7-b07cefd331e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-65835a49-1ae9-4b66-91f7-b07cefd331e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:30.595871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:30.596981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:30.597851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:30.597851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:30.597851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:30.597851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:30.597851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:30.597851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:30.597851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:30.597851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:30.597851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:30.597851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:30.597851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:20:30.597851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:20:30.597851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 7/14] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:20:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:20:30.604717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65835a49-1ae9-4b66-91f7-b07cefd331e5 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:30.667139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c84ad0-2780-4297-942f-5aa228d46f91 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:30.670672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:30.693305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:30.710105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fee95-69c3-442c-9f4f-c05d7285af17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:30.711007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fee95-69c3-442c-9f4f-c05d7285af17 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:30.711298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fee95-69c3-442c-9f4f-c05d7285af17 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:30.711614 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fee95-69c3-442c-9f4f-c05d7285af17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:30.715205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65835a49-1ae9-4b66-91f7-b07cefd331e5 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:30.751883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0279dd-51f0-4eb9-94d4-57a9a453d6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:30.752544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0279dd-51f0-4eb9-94d4-57a9a453d6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:30.752828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0279dd-51f0-4eb9-94d4-57a9a453d6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:30.753105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0279dd-51f0-4eb9-94d4-57a9a453d6c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:30.753889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0279dd-51f0-4eb9-94d4-57a9a453d6c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:30.754195 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0279dd-51f0-4eb9-94d4-57a9a453d6c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:30.755640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0279dd-51f0-4eb9-94d4-57a9a453d6c8 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:30.767877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 8/15] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:30.773092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0279dd-51f0-4eb9-94d4-57a9a453d6c8 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:30.780673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fee95-69c3-442c-9f4f-c05d7285af17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:30.782120 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fee95-69c3-442c-9f4f-c05d7285af17 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:30.872242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0279dd-51f0-4eb9-94d4-57a9a453d6c8 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:30.881001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 8/16] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:20:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 10:20:30.886757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fee95-69c3-442c-9f4f-c05d7285af17 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:30.889399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:30.905150 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f66b1-360c-41fe-8c89-f05be5a240fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:30.906022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f66b1-360c-41fe-8c89-f05be5a240fd None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:30.906302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f66b1-360c-41fe-8c89-f05be5a240fd None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:30.906573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f66b1-360c-41fe-8c89-f05be5a240fd None admin] PATH_INFO: `/v3/users/283045f7f6ca4861bfbecc3aa402c697` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:30.907811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f66b1-360c-41fe-8c89-f05be5a240fd None admin] RBAC: Authorizing `identity:get_user(user_id=283045f7f6ca4861bfbecc3aa402c697)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:30.909285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f66b1-360c-41fe-8c89-f05be5a240fd None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:30.910904 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 9/17] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:30 2022] GET /identity/v3/users/283045f7f6ca4861bfbecc3aa402c697 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:20:30.916699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f66b1-360c-41fe-8c89-f05be5a240fd None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:30.932689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:30.987899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fee95-69c3-442c-9f4f-c05d7285af17 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:31.017263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f66b1-360c-41fe-8c89-f05be5a240fd None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:31.020625 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd9eee-1105-4770-bcda-040bf6efc467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:31.021404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd9eee-1105-4770-bcda-040bf6efc467 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:31.021684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd9eee-1105-4770-bcda-040bf6efc467 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:31.021958 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd9eee-1105-4770-bcda-040bf6efc467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:31.040054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd9eee-1105-4770-bcda-040bf6efc467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:31.042047 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd9eee-1105-4770-bcda-040bf6efc467 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:31.050686 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d90bc0-18ba-4a9b-826c-4f73987faaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:31.051490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90bc0-18ba-4a9b-826c-4f73987faaab None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:31.051792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90bc0-18ba-4a9b-826c-4f73987faaab None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:31.052075 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90bc0-18ba-4a9b-826c-4f73987faaab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:31.053249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d90bc0-18ba-4a9b-826c-4f73987faaab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:31.054696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d90bc0-18ba-4a9b-826c-4f73987faaab None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:31.056933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 10/18] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:20:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:20:31.062969 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d90bc0-18ba-4a9b-826c-4f73987faaab None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-5edd9eee-1105-4770-bcda-040bf6efc467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:20:31.063337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:31.064243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:31.065076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:20:31.065076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:20:31.065076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:20:31.065076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:20:31.065076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 9/19] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:20:31.070175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd9eee-1105-4770-bcda-040bf6efc467 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:31.127393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:31.143897 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:31.163191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d90bc0-18ba-4a9b-826c-4f73987faaab None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:31.172841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd9eee-1105-4770-bcda-040bf6efc467 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:31.197538 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d197990-09af-439c-ab0c-e849505448d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:31.198185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197990-09af-439c-ab0c-e849505448d1 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:31.198463 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197990-09af-439c-ab0c-e849505448d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:31.198736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d197990-09af-439c-ab0c-e849505448d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:31.199589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d197990-09af-439c-ab0c-e849505448d1 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.domain.id=default, user.id=283045f7f6ca4861bfbecc3aa402c697) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:31.199897 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d197990-09af-439c-ab0c-e849505448d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:31.201323 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d197990-09af-439c-ab0c-e849505448d1 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:31.206070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb0dc2-0a40-4a8c-82bd-d834e1a45536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:31.206746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb0dc2-0a40-4a8c-82bd-d834e1a45536 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:31.207027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb0dc2-0a40-4a8c-82bd-d834e1a45536 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:31.207303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb0dc2-0a40-4a8c-82bd-d834e1a45536 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:31.208042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 11/20] 10.222.0.50 () {56 vars in 1322 bytes} [Wed Jun 15 10:20:31 2022] GET /identity/v3/role_assignments?user.id=283045f7f6ca4861bfbecc3aa402c697&scope.domain.id=default&role.id=e1a2021d08e14daa969362b3d23face3 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:20:31.208135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb0dc2-0a40-4a8c-82bd-d834e1a45536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:31.208357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb0dc2-0a40-4a8c-82bd-d834e1a45536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:31.209732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb0dc2-0a40-4a8c-82bd-d834e1a45536 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:31.230694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 10/21] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:20:33.712146 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789f70-2660-452a-aa16-9569742b2f3b None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:33.713205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789f70-2660-452a-aa16-9569742b2f3b None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:33.713316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789f70-2660-452a-aa16-9569742b2f3b None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:33.715035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 12/22] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:33.725270 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a532c74-e600-43b2-be8c-7a892a82abd1 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:33.726215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a532c74-e600-43b2-be8c-7a892a82abd1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:33.726697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a532c74-e600-43b2-be8c-7a892a82abd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:33.754770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2a532c74-e600-43b2-be8c-7a892a82abd1 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:33.756384 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2a532c74-e600-43b2-be8c-7a892a82abd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:33.849092 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 11/23] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:33.862585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39394209-99c0-4ad8-bfc6-997a744392e3 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:33.862878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39394209-99c0-4ad8-bfc6-997a744392e3 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:33.863149 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39394209-99c0-4ad8-bfc6-997a744392e3 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:33.864853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:33.870262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb3236-6e4b-4688-9955-8b6f3198ceb3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:33.870545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb3236-6e4b-4688-9955-8b6f3198ceb3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:33.870838 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb3236-6e4b-4688-9955-8b6f3198ceb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:33.877957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39394209-99c0-4ad8-bfc6-997a744392e3 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:33.910285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b8bb3236-6e4b-4688-9955-8b6f3198ceb3 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:33.911497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b8bb3236-6e4b-4688-9955-8b6f3198ceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:34.017538 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:34.071381 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 12/25] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:34.101401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39394209-99c0-4ad8-bfc6-997a744392e3 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:34.121785 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb3236-6e4b-4688-9955-8b6f3198ceb3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:34.184610 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5e69b-b4ab-4a54-b7da-d0595dea6996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:34.185421 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5e69b-b4ab-4a54-b7da-d0595dea6996 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:34.185699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5e69b-b4ab-4a54-b7da-d0595dea6996 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:34.185972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5e69b-b4ab-4a54-b7da-d0595dea6996 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:34.216080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5e69b-b4ab-4a54-b7da-d0595dea6996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-64b5e69b-b4ab-4a54-b7da-d0595dea6996 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:34.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:34.226905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:34.227743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:34.227743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:34.227743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:34.227743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:34.227743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:34.227743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:34.227743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:34.227743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:34.227743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:34.227743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:34.227743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:20:34.227743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:20:34.227743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 14/26] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:20:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:20:34.238512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5e69b-b4ab-4a54-b7da-d0595dea6996 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:34.249668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:34.373480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb3236-6e4b-4688-9955-8b6f3198ceb3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:34.420527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4d0d4-b3d0-4451-bc9b-bf4af43e7053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:34.420527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4d0d4-b3d0-4451-bc9b-bf4af43e7053 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:34.420527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4d0d4-b3d0-4451-bc9b-bf4af43e7053 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:34.420527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4d0d4-b3d0-4451-bc9b-bf4af43e7053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:34.431575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4d0d4-b3d0-4451-bc9b-bf4af43e7053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:34.432712 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5e69b-b4ab-4a54-b7da-d0595dea6996 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:34.433251 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4d0d4-b3d0-4451-bc9b-bf4af43e7053 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-4de4d0d4-b3d0-4451-bc9b-bf4af43e7053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:20:34.456300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:34.457337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:34.458226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:20:34.458226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:20:34.458226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:20:34.458226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:20:34.458226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 13/27] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:20:34.458713 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fa180-095d-4fe8-9380-41dbd4b575a7 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:34.459311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fa180-095d-4fe8-9380-41dbd4b575a7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:34.459857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fa180-095d-4fe8-9380-41dbd4b575a7 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:34.461957 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 14/28] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:34.467990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f848d-8151-4898-a35a-1329db9f06c7 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:34.468440 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f848d-8151-4898-a35a-1329db9f06c7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:34.468965 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f848d-8151-4898-a35a-1329db9f06c7 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:34.470800 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 15/29] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:34.475517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f848d-8151-4898-a35a-1329db9f06c7 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:34.477646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2523ff8-d4ea-4cd3-bf19-3f381d097bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:34.479063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2523ff8-d4ea-4cd3-bf19-3f381d097bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:34.479437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2523ff8-d4ea-4cd3-bf19-3f381d097bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:34.479942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2523ff8-d4ea-4cd3-bf19-3f381d097bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:34.480903 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2523ff8-d4ea-4cd3-bf19-3f381d097bb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:34.481274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2523ff8-d4ea-4cd3-bf19-3f381d097bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:34.482754 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2523ff8-d4ea-4cd3-bf19-3f381d097bb6 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:34.492241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 15/30] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:34.493664 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fa672-c78d-4c8e-bc2d-e4dd08f8cec4 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:34.494023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fa672-c78d-4c8e-bc2d-e4dd08f8cec4 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:34.494365 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fa672-c78d-4c8e-bc2d-e4dd08f8cec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:34.508647 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:34.512938 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8c8fa672-c78d-4c8e-bc2d-e4dd08f8cec4 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:34.514316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8c8fa672-c78d-4c8e-bc2d-e4dd08f8cec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:34.578177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:34.586304 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 16/31] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:34.588664 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d6173-423e-4d67-971b-6eda73cd6874 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:34.589157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d6173-423e-4d67-971b-6eda73cd6874 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:34.589648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d6173-423e-4d67-971b-6eda73cd6874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:34.602167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f848d-8151-4898-a35a-1329db9f06c7 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:34.621892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-038d6173-423e-4d67-971b-6eda73cd6874 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:34.623141 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-038d6173-423e-4d67-971b-6eda73cd6874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:34.647770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dbaf0-0faf-4212-b23e-9c5ddf0553f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:34.648873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dbaf0-0faf-4212-b23e-9c5ddf0553f1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:34.649160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dbaf0-0faf-4212-b23e-9c5ddf0553f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:34.649743 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3dbaf0-0faf-4212-b23e-9c5ddf0553f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:34.651083 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3dbaf0-0faf-4212-b23e-9c5ddf0553f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:34.651685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3dbaf0-0faf-4212-b23e-9c5ddf0553f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:34.653193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3dbaf0-0faf-4212-b23e-9c5ddf0553f1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:34.669457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 16/32] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:34.670358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dbaf0-0faf-4212-b23e-9c5ddf0553f1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:34.725657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 17/33] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:34.726582 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d6173-423e-4d67-971b-6eda73cd6874 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:34.769599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:34.793466 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3dbaf0-0faf-4212-b23e-9c5ddf0553f1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:34.842280 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7be5d-0e6a-432e-9eb4-6f725822cee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:34.843160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7be5d-0e6a-432e-9eb4-6f725822cee6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:34.843443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7be5d-0e6a-432e-9eb4-6f725822cee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:34.843743 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7be5d-0e6a-432e-9eb4-6f725822cee6 None admin] PATH_INFO: `/v3/users/283045f7f6ca4861bfbecc3aa402c697` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:34.846438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7be5d-0e6a-432e-9eb4-6f725822cee6 None admin] RBAC: Authorizing `identity:get_user(user_id=283045f7f6ca4861bfbecc3aa402c697)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:34.847945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7be5d-0e6a-432e-9eb4-6f725822cee6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:34.848541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d6173-423e-4d67-971b-6eda73cd6874 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:34.849799 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 17/34] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:34 2022] GET /identity/v3/users/283045f7f6ca4861bfbecc3aa402c697 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:34.850620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7be5d-0e6a-432e-9eb4-6f725822cee6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:34.878607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:34.889752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3b332-154e-4b35-a657-81f069431e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:34.890731 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3b332-154e-4b35-a657-81f069431e25 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:34.891252 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3b332-154e-4b35-a657-81f069431e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:34.891779 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3b332-154e-4b35-a657-81f069431e25 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:34.892795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3b332-154e-4b35-a657-81f069431e25 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:34.894533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3b332-154e-4b35-a657-81f069431e25 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:34.970253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7be5d-0e6a-432e-9eb4-6f725822cee6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:35.010315 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ea8bb-22dd-402e-901c-e46cbb98528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:35.010991 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ea8bb-22dd-402e-901c-e46cbb98528b None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:35.011284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ea8bb-22dd-402e-901c-e46cbb98528b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:35.011608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ea8bb-22dd-402e-901c-e46cbb98528b None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:35.012337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ea8bb-22dd-402e-901c-e46cbb98528b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:35.013833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ea8bb-22dd-402e-901c-e46cbb98528b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:35.144001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 18/35] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Jun 15 10:20:34 2022] POST /identity/v3/roles => generated 219 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:20:35.145551 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3b332-154e-4b35-a657-81f069431e25 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:35.274690 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3b332-154e-4b35-a657-81f069431e25 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:35.283798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 18/36] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Jun 15 10:20:34 2022] POST /identity/v3/projects => generated 301 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:20:35.283798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ea8bb-22dd-402e-901c-e46cbb98528b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:35.291055 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:35.334280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af807960-3db9-42f7-8117-e4d3e8dd6092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:35.334976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af807960-3db9-42f7-8117-e4d3e8dd6092 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:35.335268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af807960-3db9-42f7-8117-e4d3e8dd6092 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:35.335680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af807960-3db9-42f7-8117-e4d3e8dd6092 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:35.336457 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af807960-3db9-42f7-8117-e4d3e8dd6092 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:35.338622 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af807960-3db9-42f7-8117-e4d3e8dd6092 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:35.356657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 19/37] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Jun 15 10:20:35 2022] POST /identity/v3/roles => generated 225 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:20:35.363525 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29f71-06c4-455f-a811-c1070b0f3450 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:35.363525 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29f71-06c4-455f-a811-c1070b0f3450 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:35.363525 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29f71-06c4-455f-a811-c1070b0f3450 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:35.363525 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 20/38] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:35.367053 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aad8e-26fc-479a-b9f6-0dfe343a65bc None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:35.367336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aad8e-26fc-479a-b9f6-0dfe343a65bc None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:35.367591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aad8e-26fc-479a-b9f6-0dfe343a65bc None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:35.369517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 21/39] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:35.370714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fef41-0f08-4f62-8082-7e92c0596270 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:35.371010 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fef41-0f08-4f62-8082-7e92c0596270 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:35.371616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fef41-0f08-4f62-8082-7e92c0596270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:35.391616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-194fef41-0f08-4f62-8082-7e92c0596270 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:35.393226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-194fef41-0f08-4f62-8082-7e92c0596270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:35.422793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ea8bb-22dd-402e-901c-e46cbb98528b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:35.457182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:35.476036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773a741-5b2a-457b-bc98-348b0839739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:35.476872 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773a741-5b2a-457b-bc98-348b0839739c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:35.477165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773a741-5b2a-457b-bc98-348b0839739c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:35.477558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773a741-5b2a-457b-bc98-348b0839739c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:35.479705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773a741-5b2a-457b-bc98-348b0839739c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:35.482270 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773a741-5b2a-457b-bc98-348b0839739c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:35.484267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 19/40] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:20:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:35.485942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639ae2-1e8d-4a6d-be69-b548104cec8c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:35.486424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639ae2-1e8d-4a6d-be69-b548104cec8c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:35.486859 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639ae2-1e8d-4a6d-be69-b548104cec8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:35.500554 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 22/41] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:35.501605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fef41-0f08-4f62-8082-7e92c0596270 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:35.505645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-25639ae2-1e8d-4a6d-be69-b548104cec8c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:35.507442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-25639ae2-1e8d-4a6d-be69-b548104cec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:35.592531 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 20/42] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:35.594502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25639ae2-1e8d-4a6d-be69-b548104cec8c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:35.605322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:35.636016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fef41-0f08-4f62-8082-7e92c0596270 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:35.678693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8facd9-0f38-471f-85ac-15dee9fafa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:35.679601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8facd9-0f38-471f-85ac-15dee9fafa74 None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:35.679890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8facd9-0f38-471f-85ac-15dee9fafa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:35.680169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8facd9-0f38-471f-85ac-15dee9fafa74 None admin] PATH_INFO: `/v3/domains/default/users/283045f7f6ca4861bfbecc3aa402c697/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:35.682727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8facd9-0f38-471f-85ac-15dee9fafa74 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=283045f7f6ca4861bfbecc3aa402c697, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:35.684229 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8facd9-0f38-471f-85ac-15dee9fafa74 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:35.698654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 23/43] 10.222.0.50 () {58 vars in 1361 bytes} [Wed Jun 15 10:20:35 2022] PUT /identity/v3/domains/default/users/283045f7f6ca4861bfbecc3aa402c697/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:20:35.699722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8facd9-0f38-471f-85ac-15dee9fafa74 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:35.717254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25639ae2-1e8d-4a6d-be69-b548104cec8c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:35.738357 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:35.760284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa3fe2-9f30-4f00-abfd-3ef2e0e9586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:35.761709 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3fe2-9f30-4f00-abfd-3ef2e0e9586e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:35.762004 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3fe2-9f30-4f00-abfd-3ef2e0e9586e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:35.762285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3fe2-9f30-4f00-abfd-3ef2e0e9586e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:35.763568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa3fe2-9f30-4f00-abfd-3ef2e0e9586e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:35.765706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa3fe2-9f30-4f00-abfd-3ef2e0e9586e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:35.768810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 21/44] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:20:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:35.775034 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa3fe2-9f30-4f00-abfd-3ef2e0e9586e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:35.820120 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8facd9-0f38-471f-85ac-15dee9fafa74 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:35.859083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbcc6dd-919b-4602-b304-6d089eefaf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:35.859370 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcc6dd-919b-4602-b304-6d089eefaf60 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:35.859677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcc6dd-919b-4602-b304-6d089eefaf60 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:35.859958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcc6dd-919b-4602-b304-6d089eefaf60 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:35.861002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcc6dd-919b-4602-b304-6d089eefaf60 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:35.862126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbcc6dd-919b-4602-b304-6d089eefaf60 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:35.874924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:35.877816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 24/45] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Jun 15 10:20:35 2022] POST /identity/v3/roles => generated 223 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:20:35.904508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa3fe2-9f30-4f00-abfd-3ef2e0e9586e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:35.942913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee0efe-0632-4e1f-8c08-bccedb9107c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:35.943622 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee0efe-0632-4e1f-8c08-bccedb9107c6 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:35.943911 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee0efe-0632-4e1f-8c08-bccedb9107c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:35.944189 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee0efe-0632-4e1f-8c08-bccedb9107c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:35.944920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee0efe-0632-4e1f-8c08-bccedb9107c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:35.946431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee0efe-0632-4e1f-8c08-bccedb9107c6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:35.976024 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 22/46] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Jun 15 10:20:35 2022] POST /identity/v3/projects => generated 312 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:20:37.821434 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427928a0-a74a-440c-a06b-31b93aaf814d None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:37.821965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427928a0-a74a-440c-a06b-31b93aaf814d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:37.822050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427928a0-a74a-440c-a06b-31b93aaf814d None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:37.823562 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 25/47] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:37.828539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e807-b048-41f2-a234-0be8836a5a0e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:37.828953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e807-b048-41f2-a234-0be8836a5a0e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:37.829109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e807-b048-41f2-a234-0be8836a5a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:37.845590 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4758e807-b048-41f2-a234-0be8836a5a0e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:37.846800 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4758e807-b048-41f2-a234-0be8836a5a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:37.916552 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 23/48] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:37.939495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427928a0-a74a-440c-a06b-31b93aaf814d None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:38.032668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:38.041242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427928a0-a74a-440c-a06b-31b93aaf814d None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:38.076104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38a9f0-f7f7-41fd-88aa-bbe41cc781a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:38.076890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38a9f0-f7f7-41fd-88aa-bbe41cc781a8 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:38.077170 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38a9f0-f7f7-41fd-88aa-bbe41cc781a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:38.077444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38a9f0-f7f7-41fd-88aa-bbe41cc781a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:38.087759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38a9f0-f7f7-41fd-88aa-bbe41cc781a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-ac38a9f0-f7f7-41fd-88aa-bbe41cc781a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:38.095234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:38.096329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:38.101952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:38.101952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:38.101952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:38.101952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:38.101952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:38.101952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:38.101952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:38.101952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:38.101952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:38.101952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:38.101952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:20:38.101952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:20:38.101952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 26/49] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:20:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:38.102603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00aa55-4a9a-49e9-befa-7db03ea8c86a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:38.102603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00aa55-4a9a-49e9-befa-7db03ea8c86a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:38.102603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00aa55-4a9a-49e9-befa-7db03ea8c86a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:38.102603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 24/50] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:38.102835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38a9f0-f7f7-41fd-88aa-bbe41cc781a8 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:38.106521 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa2d8-2d58-4dd7-af96-aa5c7089eccd None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:38.106947 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa2d8-2d58-4dd7-af96-aa5c7089eccd None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:38.107275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caa2d8-2d58-4dd7-af96-aa5c7089eccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:38.124076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e3caa2d8-2d58-4dd7-af96-aa5c7089eccd None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:38.125275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e3caa2d8-2d58-4dd7-af96-aa5c7089eccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:38.187760 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:38.204866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38a9f0-f7f7-41fd-88aa-bbe41cc781a8 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:38.206165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 25/51] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:20:38.230076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caa2d8-2d58-4dd7-af96-aa5c7089eccd None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:38.238818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046c57a-f654-4d0c-b063-8b841560fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:38.239507 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046c57a-f654-4d0c-b063-8b841560fb7e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:38.239797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046c57a-f654-4d0c-b063-8b841560fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:38.240073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046c57a-f654-4d0c-b063-8b841560fb7e None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:38.241090 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046c57a-f654-4d0c-b063-8b841560fb7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:38.241399 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046c57a-f654-4d0c-b063-8b841560fb7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:38.242795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046c57a-f654-4d0c-b063-8b841560fb7e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:38.251313 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 27/52] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:20:38.256953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046c57a-f654-4d0c-b063-8b841560fb7e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:38.281490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:38.331687 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caa2d8-2d58-4dd7-af96-aa5c7089eccd None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:38.360952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046c57a-f654-4d0c-b063-8b841560fb7e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:38.364719 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd33b7-c6a5-4206-80e3-12368a02c460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:38.365576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd33b7-c6a5-4206-80e3-12368a02c460 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:38.366114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd33b7-c6a5-4206-80e3-12368a02c460 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:38.366386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd33b7-c6a5-4206-80e3-12368a02c460 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:38.367675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd33b7-c6a5-4206-80e3-12368a02c460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:38.369714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd33b7-c6a5-4206-80e3-12368a02c460 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:38.371327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 26/53] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:20:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:20:38.376919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd33b7-c6a5-4206-80e3-12368a02c460 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:38.399037 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1665c1-fa5a-477e-86ce-0fbc06107ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:38.399961 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1665c1-fa5a-477e-86ce-0fbc06107ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:38.400267 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1665c1-fa5a-477e-86ce-0fbc06107ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:38.400531 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1665c1-fa5a-477e-86ce-0fbc06107ad5 None admin] PATH_INFO: `/v3/users/283045f7f6ca4861bfbecc3aa402c697` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:38.401747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1665c1-fa5a-477e-86ce-0fbc06107ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=283045f7f6ca4861bfbecc3aa402c697)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:38.403212 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1665c1-fa5a-477e-86ce-0fbc06107ad5 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:38.404886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 28/54] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:38 2022] GET /identity/v3/users/283045f7f6ca4861bfbecc3aa402c697 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:20:38.410734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1665c1-fa5a-477e-86ce-0fbc06107ad5 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:38.436168 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:38.479348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd33b7-c6a5-4206-80e3-12368a02c460 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:38.494474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:38.509605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1665c1-fa5a-477e-86ce-0fbc06107ad5 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:38.516489 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb749b1-7f46-4de1-832d-5911a9fecb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:38.517143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb749b1-7f46-4de1-832d-5911a9fecb87 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:38.517424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb749b1-7f46-4de1-832d-5911a9fecb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:38.517704 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb749b1-7f46-4de1-832d-5911a9fecb87 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:38.518411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb749b1-7f46-4de1-832d-5911a9fecb87 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:38.519917 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb749b1-7f46-4de1-832d-5911a9fecb87 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:38.543060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c9c8a-5fc7-4857-960c-ccd7115a36a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:38.543885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c9c8a-5fc7-4857-960c-ccd7115a36a4 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:38.544006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 27/55] 10.222.0.50 () {60 vars in 1140 bytes} [Wed Jun 15 10:20:38 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:20:38.544176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c9c8a-5fc7-4857-960c-ccd7115a36a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:38.544455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c9c8a-5fc7-4857-960c-ccd7115a36a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:38.545664 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c9c8a-5fc7-4857-960c-ccd7115a36a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:38.547128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c9c8a-5fc7-4857-960c-ccd7115a36a4 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:38.548992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 29/56] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:20:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:20:38.554831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb749b1-7f46-4de1-832d-5911a9fecb87 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:38.661685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb749b1-7f46-4de1-832d-5911a9fecb87 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:38.669994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:38.700369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a788cc-827d-4404-aeac-390cf21f50f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:38.701040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a788cc-827d-4404-aeac-390cf21f50f4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:38.701325 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a788cc-827d-4404-aeac-390cf21f50f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:38.701603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a788cc-827d-4404-aeac-390cf21f50f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:38.702450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a788cc-827d-4404-aeac-390cf21f50f4 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.domain.id=default, user.id=283045f7f6ca4861bfbecc3aa402c697) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:38.702758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a788cc-827d-4404-aeac-390cf21f50f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:38.704227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a788cc-827d-4404-aeac-390cf21f50f4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:38.713755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 28/57] 10.222.0.50 () {56 vars in 1322 bytes} [Wed Jun 15 10:20:38 2022] GET /identity/v3/role_assignments?user.id=283045f7f6ca4861bfbecc3aa402c697&scope.domain.id=default&role.id=e1a2021d08e14daa969362b3d23face3 => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:40.665805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec56f-672b-40b6-962d-4bc257c711f1 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:40.666317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec56f-672b-40b6-962d-4bc257c711f1 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:40.666427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec56f-672b-40b6-962d-4bc257c711f1 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:40.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 30/58] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:40.672950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab99767-d7fc-4e29-8e89-505b48e840ae None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:40.673299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab99767-d7fc-4e29-8e89-505b48e840ae None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:40.673507 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab99767-d7fc-4e29-8e89-505b48e840ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:40.690447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3ab99767-d7fc-4e29-8e89-505b48e840ae None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:40.691669 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3ab99767-d7fc-4e29-8e89-505b48e840ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:40.756181 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 29/59] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:40.780062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ec56f-672b-40b6-962d-4bc257c711f1 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:40.877832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ec56f-672b-40b6-962d-4bc257c711f1 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:40.908875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e00b6-04e8-4515-af74-f5499267e086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:40.909648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e00b6-04e8-4515-af74-f5499267e086 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:40.909928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e00b6-04e8-4515-af74-f5499267e086 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:40.910196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e00b6-04e8-4515-af74-f5499267e086 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:40.911355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e00b6-04e8-4515-af74-f5499267e086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:40.912824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e00b6-04e8-4515-af74-f5499267e086 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:40.914408 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 31/60] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:20:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:40.920339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab99767-d7fc-4e29-8e89-505b48e840ae None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:41.012659 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:41.015856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab99767-d7fc-4e29-8e89-505b48e840ae None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:41.049768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9fa00-fb8b-4155-88e1-112bfe9821d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:41.050415 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9fa00-fb8b-4155-88e1-112bfe9821d7 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:41.050696 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9fa00-fb8b-4155-88e1-112bfe9821d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:41.050966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9fa00-fb8b-4155-88e1-112bfe9821d7 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:41.051687 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9fa00-fb8b-4155-88e1-112bfe9821d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:41.053149 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9fa00-fb8b-4155-88e1-112bfe9821d7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:41.076430 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 30/61] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:20:40 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:20:44.267301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf8b62-cd1c-4e09-812f-bc14c2af154f None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:44.267864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf8b62-cd1c-4e09-812f-bc14c2af154f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:44.267864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf8b62-cd1c-4e09-812f-bc14c2af154f None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:44.269260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 32/62] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:44.274672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969363b1-c1b2-4005-8a68-baaaeeb1bcc9 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:44.275070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969363b1-c1b2-4005-8a68-baaaeeb1bcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:44.275241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969363b1-c1b2-4005-8a68-baaaeeb1bcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:44.300554 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-969363b1-c1b2-4005-8a68-baaaeeb1bcc9 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:44.302039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-969363b1-c1b2-4005-8a68-baaaeeb1bcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:44.386063 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 31/63] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:44.425587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf8b62-cd1c-4e09-812f-bc14c2af154f None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:44.461058 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:44.479771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa6f2b-d50b-410c-a944-43d9f36dea23 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:44.480338 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa6f2b-d50b-410c-a944-43d9f36dea23 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:44.480794 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa6f2b-d50b-410c-a944-43d9f36dea23 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:44.482709 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 32/64] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:44.489986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc76d2b-77df-4b62-a9ea-59d0d42e3096 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:44.490538 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc76d2b-77df-4b62-a9ea-59d0d42e3096 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:44.491255 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc76d2b-77df-4b62-a9ea-59d0d42e3096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:44.520730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8fc76d2b-77df-4b62-a9ea-59d0d42e3096 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:44.524366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8fc76d2b-77df-4b62-a9ea-59d0d42e3096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:44.581646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf8b62-cd1c-4e09-812f-bc14c2af154f None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:44.603341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 33/65] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:44.604960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277f603-f103-4dd4-9b45-c3b1c98b3c8e None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:44.605380 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277f603-f103-4dd4-9b45-c3b1c98b3c8e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:44.605776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277f603-f103-4dd4-9b45-c3b1c98b3c8e None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:44.607173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 34/66] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:44.612470 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d58d-85a9-4f17-b2a9-1f4c6e70393a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:44.612928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d58d-85a9-4f17-b2a9-1f4c6e70393a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:44.613347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d58d-85a9-4f17-b2a9-1f4c6e70393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:44.635985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ecc4d58d-85a9-4f17-b2a9-1f4c6e70393a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:44.638245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ecc4d58d-85a9-4f17-b2a9-1f4c6e70393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:44.642478 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1de85-699e-4762-b777-4d36c7054142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:44.643578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1de85-699e-4762-b777-4d36c7054142 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:44.644005 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1de85-699e-4762-b777-4d36c7054142 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:44.644420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1de85-699e-4762-b777-4d36c7054142 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:44.658848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:44.660305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1de85-699e-4762-b777-4d36c7054142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-a6f1de85-699e-4762-b777-4d36c7054142 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:44.668820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:44.669840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:44.670644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:44.670644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:44.670644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:44.670644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:44.670644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:44.670644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:44.670644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:44.670644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:44.670644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:44.670644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:44.670644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:20:44.670644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:20:44.673931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 33/67] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:20:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:44.674949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1de85-699e-4762-b777-4d36c7054142 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:44.741111 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 35/68] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:44.741963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4d58d-85a9-4f17-b2a9-1f4c6e70393a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:44.787687 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:44.810848 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1de85-699e-4762-b777-4d36c7054142 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:44.847456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad386f-bfea-4a51-9cc7-7a341d94fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:44.848269 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad386f-bfea-4a51-9cc7-7a341d94fca8 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:44.848727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad386f-bfea-4a51-9cc7-7a341d94fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:44.848855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad386f-bfea-4a51-9cc7-7a341d94fca8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:44.851435 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4d58d-85a9-4f17-b2a9-1f4c6e70393a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:44.861724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad386f-bfea-4a51-9cc7-7a341d94fca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-f3ad386f-bfea-4a51-9cc7-7a341d94fca8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:44.870083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:44.870974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:44.872254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:44.872254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:44.872254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:44.872254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:44.872254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:44.872254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:44.872254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:44.872254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:44.872254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:44.872254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:44.872254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:20:44.872254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:20:44.872254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 34/69] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:44.872254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad386f-bfea-4a51-9cc7-7a341d94fca8 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:44.894440 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccc0fd-3468-4889-8b88-c16b164600cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:44.895318 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccc0fd-3468-4889-8b88-c16b164600cd None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:44.895775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccc0fd-3468-4889-8b88-c16b164600cd None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:44.896223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccc0fd-3468-4889-8b88-c16b164600cd None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:44.896976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccc0fd-3468-4889-8b88-c16b164600cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:44.897287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccc0fd-3468-4889-8b88-c16b164600cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:44.898677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccc0fd-3468-4889-8b88-c16b164600cd None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:44.912197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 36/70] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:44.917217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f721157-41c9-4d76-8f0c-3007bfb0ede2 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:44.917217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f721157-41c9-4d76-8f0c-3007bfb0ede2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:44.917217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f721157-41c9-4d76-8f0c-3007bfb0ede2 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:44.917217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 37/71] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:44.917217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f721157-41c9-4d76-8f0c-3007bfb0ede2 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:44.928412 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:44.986801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad386f-bfea-4a51-9cc7-7a341d94fca8 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:45.022776 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97e64d-8606-4873-b7fe-06d6dc242a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:45.023604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97e64d-8606-4873-b7fe-06d6dc242a6e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:45.023891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97e64d-8606-4873-b7fe-06d6dc242a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:45.024167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97e64d-8606-4873-b7fe-06d6dc242a6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:45.032407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f721157-41c9-4d76-8f0c-3007bfb0ede2 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:45.034900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97e64d-8606-4873-b7fe-06d6dc242a6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-8d97e64d-8606-4873-b7fe-06d6dc242a6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:45.043555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:45.044481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:45.045292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:45.045292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:45.045292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:45.045292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:45.045292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:45.045292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:45.045292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:45.045292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:45.045292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:45.045292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:45.045292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:20:45.045292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:20:45.045292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 35/72] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:20:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:45.046171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97e64d-8606-4873-b7fe-06d6dc242a6e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:45.049206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:45.072572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ac046-bedd-4b37-8960-831d658a871d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:45.073242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ac046-bedd-4b37-8960-831d658a871d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:45.073533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ac046-bedd-4b37-8960-831d658a871d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:45.073816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ac046-bedd-4b37-8960-831d658a871d None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:45.074570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ac046-bedd-4b37-8960-831d658a871d None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:45.074887 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ac046-bedd-4b37-8960-831d658a871d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:45.076374 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ac046-bedd-4b37-8960-831d658a871d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:45.084469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 38/73] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:20:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:45.085482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce72d70-8f27-4897-bac2-1d373973af33 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:45.085774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce72d70-8f27-4897-bac2-1d373973af33 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:45.086055 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce72d70-8f27-4897-bac2-1d373973af33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:45.102587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7ce72d70-8f27-4897-bac2-1d373973af33 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:45.103853 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7ce72d70-8f27-4897-bac2-1d373973af33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:45.145910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97e64d-8606-4873-b7fe-06d6dc242a6e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:45.164790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:45.169871 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 39/74] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:45.171130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a934f31-2708-4df2-ad92-35ff076b21d0 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:45.171419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a934f31-2708-4df2-ad92-35ff076b21d0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:45.171728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a934f31-2708-4df2-ad92-35ff076b21d0 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:45.172990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 40/75] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:45.173696 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a934f31-2708-4df2-ad92-35ff076b21d0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:45.186648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cd81b-2a87-4f93-b23a-6cba810af229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:45.187861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd81b-2a87-4f93-b23a-6cba810af229 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:45.188300 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd81b-2a87-4f93-b23a-6cba810af229 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:45.188573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd81b-2a87-4f93-b23a-6cba810af229 None admin] PATH_INFO: `/v3/users/283045f7f6ca4861bfbecc3aa402c697` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:45.189777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cd81b-2a87-4f93-b23a-6cba810af229 None admin] RBAC: Authorizing `identity:get_user(user_id=283045f7f6ca4861bfbecc3aa402c697)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:45.191239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cd81b-2a87-4f93-b23a-6cba810af229 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:45.192886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 36/76] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:45 2022] GET /identity/v3/users/283045f7f6ca4861bfbecc3aa402c697 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:45.193640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cd81b-2a87-4f93-b23a-6cba810af229 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:45.263419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:45.278299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a934f31-2708-4df2-ad92-35ff076b21d0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:45.295490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cd81b-2a87-4f93-b23a-6cba810af229 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:45.311623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06826ca-e41a-424f-9fb8-fbb2754a7b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:45.312278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06826ca-e41a-424f-9fb8-fbb2754a7b0c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:45.312560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06826ca-e41a-424f-9fb8-fbb2754a7b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:45.312833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06826ca-e41a-424f-9fb8-fbb2754a7b0c None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:45.313571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06826ca-e41a-424f-9fb8-fbb2754a7b0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:45.313879 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06826ca-e41a-424f-9fb8-fbb2754a7b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:45.315247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06826ca-e41a-424f-9fb8-fbb2754a7b0c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:45.323537 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 41/77] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:20:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:45.324858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f9e93-ad29-4cc9-80a7-96b7e13446ce None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:45.325148 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f9e93-ad29-4cc9-80a7-96b7e13446ce None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:45.325526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f9e93-ad29-4cc9-80a7-96b7e13446ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:45.328708 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de407102-625a-49dd-a087-ffd4b8055c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:45.329584 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de407102-625a-49dd-a087-ffd4b8055c94 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:45.329869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de407102-625a-49dd-a087-ffd4b8055c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:45.330314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de407102-625a-49dd-a087-ffd4b8055c94 None admin] PATH_INFO: `/v3/users/e524aa79ee4a4cec95734314eb804eae` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:45.341705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-363f9e93-ad29-4cc9-80a7-96b7e13446ce None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:45.342899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-363f9e93-ad29-4cc9-80a7-96b7e13446ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:45.344097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de407102-625a-49dd-a087-ffd4b8055c94 None admin] RBAC: Authorizing `identity:get_user(user_id=e524aa79ee4a4cec95734314eb804eae)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:45.345567 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de407102-625a-49dd-a087-ffd4b8055c94 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:45.347374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 37/78] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:45 2022] GET /identity/v3/users/e524aa79ee4a4cec95734314eb804eae => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:45.348015 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de407102-625a-49dd-a087-ffd4b8055c94 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:45.401404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:45.411888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 42/79] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:45.412694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f9e93-ad29-4cc9-80a7-96b7e13446ce None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:45.445883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de407102-625a-49dd-a087-ffd4b8055c94 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:45.471805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:45.480375 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461ebb0-0f1d-4c08-9637-914fd233d3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:45.481174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461ebb0-0f1d-4c08-9637-914fd233d3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:45.481460 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461ebb0-0f1d-4c08-9637-914fd233d3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:45.481739 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461ebb0-0f1d-4c08-9637-914fd233d3c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:45.492070 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461ebb0-0f1d-4c08-9637-914fd233d3c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-f461ebb0-0f1d-4c08-9637-914fd233d3c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:45.500288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:45.501179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:45.501987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:45.501987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:45.501987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:45.501987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:45.501987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:45.501987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:45.501987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:45.501987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:45.501987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:45.501987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:45.501987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:20:45.501987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:20:45.501987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 38/80] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:45.502646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461ebb0-0f1d-4c08-9637-914fd233d3c3 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:45.519102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f9e93-ad29-4cc9-80a7-96b7e13446ce None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:45.553533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407421af-e4da-4c4b-a4a2-5775c02463da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:45.554104 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407421af-e4da-4c4b-a4a2-5775c02463da None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:45.554385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407421af-e4da-4c4b-a4a2-5775c02463da None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:45.554660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407421af-e4da-4c4b-a4a2-5775c02463da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:45.600479 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461ebb0-0f1d-4c08-9637-914fd233d3c3 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:45.611040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:45.621311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407421af-e4da-4c4b-a4a2-5775c02463da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:45.622770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407421af-e4da-4c4b-a4a2-5775c02463da None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:45.633565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67061e-aae8-45cc-ba74-4a35fbe36cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:45.634976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67061e-aae8-45cc-ba74-4a35fbe36cbc None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:45.635256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67061e-aae8-45cc-ba74-4a35fbe36cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:45.635555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67061e-aae8-45cc-ba74-4a35fbe36cbc None admin] PATH_INFO: `/v3/users/e524aa79ee4a4cec95734314eb804eae` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:45.636764 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67061e-aae8-45cc-ba74-4a35fbe36cbc None admin] RBAC: Authorizing `identity:get_user(user_id=e524aa79ee4a4cec95734314eb804eae)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:45.638206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67061e-aae8-45cc-ba74-4a35fbe36cbc None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:45.640122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 39/81] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:45 2022] GET /identity/v3/users/e524aa79ee4a4cec95734314eb804eae => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:45.640824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67061e-aae8-45cc-ba74-4a35fbe36cbc None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:45.697629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:45.722775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 43/82] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:20:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:45.723638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407421af-e4da-4c4b-a4a2-5775c02463da None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:45.740625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67061e-aae8-45cc-ba74-4a35fbe36cbc None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:45.774856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a03e6-cd39-484f-9043-4fb0e88b5ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:45.775538 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a03e6-cd39-484f-9043-4fb0e88b5ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:45.775824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a03e6-cd39-484f-9043-4fb0e88b5ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:45.776109 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a03e6-cd39-484f-9043-4fb0e88b5ec2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:45.817008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:45.826874 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407421af-e4da-4c4b-a4a2-5775c02463da None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:45.843233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a03e6-cd39-484f-9043-4fb0e88b5ec2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:45.844770 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a03e6-cd39-484f-9043-4fb0e88b5ec2 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:45.862716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4df794-5497-475d-9c2d-5c642682f805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:45.863526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4df794-5497-475d-9c2d-5c642682f805 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:45.863818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4df794-5497-475d-9c2d-5c642682f805 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:45.864097 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4df794-5497-475d-9c2d-5c642682f805 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:45.865265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4df794-5497-475d-9c2d-5c642682f805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:45.866970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4df794-5497-475d-9c2d-5c642682f805 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:45.869170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 44/83] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:20:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:45.869936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4df794-5497-475d-9c2d-5c642682f805 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:45.900887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:45.946197 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 40/84] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:20:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:45.947057 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a03e6-cd39-484f-9043-4fb0e88b5ec2 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:45.973524 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4df794-5497-475d-9c2d-5c642682f805 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:46.011686 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829d87-cc7e-4bf7-8f80-333342177b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:46.012340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829d87-cc7e-4bf7-8f80-333342177b3e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:46.012624 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829d87-cc7e-4bf7-8f80-333342177b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:46.012898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829d87-cc7e-4bf7-8f80-333342177b3e None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:46.013644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b829d87-cc7e-4bf7-8f80-333342177b3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:46.013949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b829d87-cc7e-4bf7-8f80-333342177b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:46.015328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b829d87-cc7e-4bf7-8f80-333342177b3e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:46.023125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 45/85] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:20:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:46.023923 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829d87-cc7e-4bf7-8f80-333342177b3e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:46.049892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:46.051305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a03e6-cd39-484f-9043-4fb0e88b5ec2 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:46.085205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d45da-7ff6-435b-85bd-03c9a69556aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:46.085771 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d45da-7ff6-435b-85bd-03c9a69556aa None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:46.086054 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d45da-7ff6-435b-85bd-03c9a69556aa None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:46.086334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d45da-7ff6-435b-85bd-03c9a69556aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:46.110843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:46.124979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829d87-cc7e-4bf7-8f80-333342177b3e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:46.153423 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d45da-7ff6-435b-85bd-03c9a69556aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:46.154963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d45da-7ff6-435b-85bd-03c9a69556aa None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:46.156648 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafaec4-a5be-4935-aebb-6c61459b21e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:46.157522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafaec4-a5be-4935-aebb-6c61459b21e0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:46.157804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafaec4-a5be-4935-aebb-6c61459b21e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:46.158079 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafaec4-a5be-4935-aebb-6c61459b21e0 None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:46.159239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafaec4-a5be-4935-aebb-6c61459b21e0 None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:46.160697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafaec4-a5be-4935-aebb-6c61459b21e0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:46.162381 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 46/86] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:20:46 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:46.163114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafaec4-a5be-4935-aebb-6c61459b21e0 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:46.257275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 41/87] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:20:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:46.258130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d45da-7ff6-435b-85bd-03c9a69556aa None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:46.258263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:46.271792 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafaec4-a5be-4935-aebb-6c61459b21e0 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:46.304860 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85519d-8da3-4423-ba94-aa50828bac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:46.305517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85519d-8da3-4423-ba94-aa50828bac13 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:46.305827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85519d-8da3-4423-ba94-aa50828bac13 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:46.306107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85519d-8da3-4423-ba94-aa50828bac13 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:46.306818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85519d-8da3-4423-ba94-aa50828bac13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:46.308286 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85519d-8da3-4423-ba94-aa50828bac13 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:46.314242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:46.327436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 47/88] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:20:46 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:20:46.328114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85519d-8da3-4423-ba94-aa50828bac13 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:46.372452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d45da-7ff6-435b-85bd-03c9a69556aa None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:46.412033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2d200-105e-41d7-a172-3ba0a606d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:46.412915 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2d200-105e-41d7-a172-3ba0a606d6aa None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:46.413196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2d200-105e-41d7-a172-3ba0a606d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:46.413469 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2d200-105e-41d7-a172-3ba0a606d6aa None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:46.414808 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2d200-105e-41d7-a172-3ba0a606d6aa None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:46.416914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2d200-105e-41d7-a172-3ba0a606d6aa None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:46.418746 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 42/89] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:20:46 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:46.424609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2d200-105e-41d7-a172-3ba0a606d6aa None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:46.447179 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85519d-8da3-4423-ba94-aa50828bac13 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:46.487540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f26727-94fc-4fa5-843f-4bdc89442e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:46.488485 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f26727-94fc-4fa5-843f-4bdc89442e6d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:46.488768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f26727-94fc-4fa5-843f-4bdc89442e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:46.489098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f26727-94fc-4fa5-843f-4bdc89442e6d None admin] PATH_INFO: `/v3/users/e524aa79ee4a4cec95734314eb804eae` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:46.490531 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f26727-94fc-4fa5-843f-4bdc89442e6d None admin] RBAC: Authorizing `identity:get_user(user_id=e524aa79ee4a4cec95734314eb804eae)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:46.492281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f26727-94fc-4fa5-843f-4bdc89442e6d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:46.494281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 48/90] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:46 2022] GET /identity/v3/users/e524aa79ee4a4cec95734314eb804eae => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:46.495033 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f26727-94fc-4fa5-843f-4bdc89442e6d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:46.511720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:46.536351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2d200-105e-41d7-a172-3ba0a606d6aa None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:46.562608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:46.576164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26808d-f735-4ccb-bfea-a6128c767a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:46.576826 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26808d-f735-4ccb-bfea-a6128c767a24 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:46.577110 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26808d-f735-4ccb-bfea-a6128c767a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:46.577391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26808d-f735-4ccb-bfea-a6128c767a24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:46.578231 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26808d-f735-4ccb-bfea-a6128c767a24 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76, user.id=283045f7f6ca4861bfbecc3aa402c697) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:46.578539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26808d-f735-4ccb-bfea-a6128c767a24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:46.580140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26808d-f735-4ccb-bfea-a6128c767a24 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:46.588398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 43/91] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:20:46 2022] GET /identity/v3/role_assignments?user.id=283045f7f6ca4861bfbecc3aa402c697&scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76&role.id=e1a2021d08e14daa969362b3d23face3 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:46.589229 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26808d-f735-4ccb-bfea-a6128c767a24 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:46.632036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f26727-94fc-4fa5-843f-4bdc89442e6d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:46.687995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70a078-5979-4353-9132-4006ba6e9eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:46.688975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70a078-5979-4353-9132-4006ba6e9eec None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:46.689258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70a078-5979-4353-9132-4006ba6e9eec None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:46.689544 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70a078-5979-4353-9132-4006ba6e9eec None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:46.691818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70a078-5979-4353-9132-4006ba6e9eec None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:46.693312 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70a078-5979-4353-9132-4006ba6e9eec None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:46.695522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 49/92] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:20:46 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:46.696331 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70a078-5979-4353-9132-4006ba6e9eec None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:46.736136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26808d-f735-4ccb-bfea-a6128c767a24 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:46.787820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ae69b-644a-4f93-8d11-cd0001541dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:46.788840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ae69b-644a-4f93-8d11-cd0001541dcc None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:46.789321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ae69b-644a-4f93-8d11-cd0001541dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:46.789792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ae69b-644a-4f93-8d11-cd0001541dcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:46.790885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ae69b-644a-4f93-8d11-cd0001541dcc None admin] RBAC: Adding query filter params (role.id=484f610225884740911a5c3333f22221, scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76, user.id=e524aa79ee4a4cec95734314eb804eae) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:46.791424 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ae69b-644a-4f93-8d11-cd0001541dcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:46.794033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ae69b-644a-4f93-8d11-cd0001541dcc None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:46.800881 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:46.803162 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 44/93] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:20:46 2022] GET /identity/v3/role_assignments?user.id=e524aa79ee4a4cec95734314eb804eae&scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76&role.id=484f610225884740911a5c3333f22221 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:46.804693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ae69b-644a-4f93-8d11-cd0001541dcc None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:46.831815 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70a078-5979-4353-9132-4006ba6e9eec None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:46.908941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c64ce3-44a6-421f-8862-b4ad34918089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:46.909530 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c64ce3-44a6-421f-8862-b4ad34918089 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:46.909816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c64ce3-44a6-421f-8862-b4ad34918089 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:46.910093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c64ce3-44a6-421f-8862-b4ad34918089 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:46.910943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:46.974308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ae69b-644a-4f93-8d11-cd0001541dcc None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:47.011367 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073702d-ccf5-4454-bb7a-d0b3784c1104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:47.012061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073702d-ccf5-4454-bb7a-d0b3784c1104 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:47.012346 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073702d-ccf5-4454-bb7a-d0b3784c1104 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:47.012625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073702d-ccf5-4454-bb7a-d0b3784c1104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:47.013477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073702d-ccf5-4454-bb7a-d0b3784c1104 None admin] RBAC: Adding query filter params (role.id=9c6db94ddc204b7e860aa2a9d622e14b, scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76, user.id=e524aa79ee4a4cec95734314eb804eae) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:47.013790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073702d-ccf5-4454-bb7a-d0b3784c1104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:47.015292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073702d-ccf5-4454-bb7a-d0b3784c1104 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:47.021521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 45/94] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:20:46 2022] GET /identity/v3/role_assignments?user.id=e524aa79ee4a4cec95734314eb804eae&scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76&role.id=9c6db94ddc204b7e860aa2a9d622e14b => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:47.044142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c64ce3-44a6-421f-8862-b4ad34918089 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:47.045703 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c64ce3-44a6-421f-8862-b4ad34918089 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:47.210607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:47.244877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 50/95] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:20:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:47.252044 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073702d-ccf5-4454-bb7a-d0b3784c1104 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:47.410161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073702d-ccf5-4454-bb7a-d0b3784c1104 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:47.431856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:47.447232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf59957-0481-44d9-a0ca-024fb41e080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:47.448174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf59957-0481-44d9-a0ca-024fb41e080e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:47.448459 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf59957-0481-44d9-a0ca-024fb41e080e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:47.448738 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf59957-0481-44d9-a0ca-024fb41e080e None admin] PATH_INFO: `/v3/projects/a705345d665f4632afccb5c440460242` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:47.449940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf59957-0481-44d9-a0ca-024fb41e080e None admin] RBAC: Authorizing `identity:get_project(project_id=a705345d665f4632afccb5c440460242)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:47.451402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf59957-0481-44d9-a0ca-024fb41e080e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:47.453600 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 46/96] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:20:47 2022] GET /identity/v3/projects/a705345d665f4632afccb5c440460242 => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:47.468698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c64ce3-44a6-421f-8862-b4ad34918089 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:47.628186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c64ce3-44a6-421f-8862-b4ad34918089 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:47.679490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a1225-bc55-487a-b79f-6c096006e34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:47.679490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a1225-bc55-487a-b79f-6c096006e34c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:47.679490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a1225-bc55-487a-b79f-6c096006e34c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:47.679490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a1225-bc55-487a-b79f-6c096006e34c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:47.679831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a1225-bc55-487a-b79f-6c096006e34c None admin] RBAC: Adding query filter params (role.id=484f610225884740911a5c3333f22221, scope.project.id=a705345d665f4632afccb5c440460242, user.id=e524aa79ee4a4cec95734314eb804eae) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:47.679831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a1225-bc55-487a-b79f-6c096006e34c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:47.679831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a1225-bc55-487a-b79f-6c096006e34c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:47.687862 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 51/97] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:20:47 2022] GET /identity/v3/role_assignments?user.id=e524aa79ee4a4cec95734314eb804eae&scope.project.id=a705345d665f4632afccb5c440460242&role.id=484f610225884740911a5c3333f22221 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:49.407405 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b8c31-3432-48a6-87a8-60f03320e2d6 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:49.407937 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b8c31-3432-48a6-87a8-60f03320e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:49.408013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b8c31-3432-48a6-87a8-60f03320e2d6 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:49.409623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 47/98] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:49.414829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e411aa-2b2f-47b7-bbab-9ea1b3836011 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:49.415346 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e411aa-2b2f-47b7-bbab-9ea1b3836011 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:49.415424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e411aa-2b2f-47b7-bbab-9ea1b3836011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:49.444522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a4e411aa-2b2f-47b7-bbab-9ea1b3836011 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:49.445751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a4e411aa-2b2f-47b7-bbab-9ea1b3836011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:49.496488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:49.537995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 52/99] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:49.580060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b8c31-3432-48a6-87a8-60f03320e2d6 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:49.681813 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e36ff1-4d45-450f-bfe3-c5e4d7c39046 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:49.682098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e36ff1-4d45-450f-bfe3-c5e4d7c39046 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:49.682604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e36ff1-4d45-450f-bfe3-c5e4d7c39046 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:49.684479 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 53/100] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:49.689748 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db458b-ae54-473d-bbb7-b6aecb0dd129 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:49.690332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db458b-ae54-473d-bbb7-b6aecb0dd129 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:49.690815 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db458b-ae54-473d-bbb7-b6aecb0dd129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:49.702964 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b8c31-3432-48a6-87a8-60f03320e2d6 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:49.721832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-72db458b-ae54-473d-bbb7-b6aecb0dd129 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:49.723425 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-72db458b-ae54-473d-bbb7-b6aecb0dd129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:49.751793 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bb395-312f-426b-bc98-e430f1c1841e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:49.752607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bb395-312f-426b-bc98-e430f1c1841e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:49.752890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bb395-312f-426b-bc98-e430f1c1841e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:49.753163 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bb395-312f-426b-bc98-e430f1c1841e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:49.754482 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bb395-312f-426b-bc98-e430f1c1841e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:49.755981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bb395-312f-426b-bc98-e430f1c1841e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:49.757610 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 48/101] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:20:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:49.758783 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f9ce2-cdb3-4d21-a1b9-baed64f9ee0c None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:49.759098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f9ce2-cdb3-4d21-a1b9-baed64f9ee0c None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:49.759377 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f9ce2-cdb3-4d21-a1b9-baed64f9ee0c None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:49.760636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 49/102] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:49.766722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f9ce2-cdb3-4d21-a1b9-baed64f9ee0c None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:49.861157 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 54/103] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:20:49.862482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603251f-00ff-44b6-8bcd-8025c685b5ae None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:49.862773 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603251f-00ff-44b6-8bcd-8025c685b5ae None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:49.863050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603251f-00ff-44b6-8bcd-8025c685b5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:49.884624 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:49.898986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2603251f-00ff-44b6-8bcd-8025c685b5ae None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:49.900814 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2603251f-00ff-44b6-8bcd-8025c685b5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:49.977376 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 55/104] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:49.979094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603251f-00ff-44b6-8bcd-8025c685b5ae None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:50.016168 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:50.038694 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f9ce2-cdb3-4d21-a1b9-baed64f9ee0c None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:50.110400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d823ff-d636-48a2-98a4-aecbe72e3b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:50.111496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d823ff-d636-48a2-98a4-aecbe72e3b88 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:50.113043 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d823ff-d636-48a2-98a4-aecbe72e3b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:50.113520 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d823ff-d636-48a2-98a4-aecbe72e3b88 None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:50.114429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d823ff-d636-48a2-98a4-aecbe72e3b88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:50.117117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d823ff-d636-48a2-98a4-aecbe72e3b88 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:50.127672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603251f-00ff-44b6-8bcd-8025c685b5ae None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:50.176927 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 50/105] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Jun 15 10:20:49 2022] POST /identity/v3/projects => generated 302 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:20:50.178079 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d823ff-d636-48a2-98a4-aecbe72e3b88 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:50.201352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32a42b-926f-45ec-bc06-f589083f5a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:50.202710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32a42b-926f-45ec-bc06-f589083f5a7c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:50.203357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32a42b-926f-45ec-bc06-f589083f5a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:50.203882 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32a42b-926f-45ec-bc06-f589083f5a7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:50.225874 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb32a42b-926f-45ec-bc06-f589083f5a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-bb32a42b-926f-45ec-bc06-f589083f5a7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:50.245803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:50.246811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:50.247951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:50.247951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:50.247951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:50.247951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:50.247951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:50.247951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:50.247951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:50.247951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:50.247951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:50.247951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:50.247951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:20:50.247951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:20:50.248909 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 56/106] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:50.253982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7be7c-5092-4789-9dd1-83c8bbdd42fb None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:50.253982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7be7c-5092-4789-9dd1-83c8bbdd42fb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:50.253982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7be7c-5092-4789-9dd1-83c8bbdd42fb None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:50.253982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 57/107] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:50.255611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7be7c-5092-4789-9dd1-83c8bbdd42fb None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:50.369994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d823ff-d636-48a2-98a4-aecbe72e3b88 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:50.373021 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:50.429805 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:50.440638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7be7c-5092-4789-9dd1-83c8bbdd42fb None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:50.458286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12484d44-a326-4f6f-8bf3-e49ad86180c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:50.459739 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12484d44-a326-4f6f-8bf3-e49ad86180c7 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:50.460174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12484d44-a326-4f6f-8bf3-e49ad86180c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:50.460598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12484d44-a326-4f6f-8bf3-e49ad86180c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:50.476127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12484d44-a326-4f6f-8bf3-e49ad86180c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-12484d44-a326-4f6f-8bf3-e49ad86180c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:50.484616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:50.485518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:50.487811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:50.487811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:50.487811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:50.487811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:50.487811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:50.487811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:50.487811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:50.487811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:50.487811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:50.487811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:50.487811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:20:50.487811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:20:50.487811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 51/108] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:20:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:50.487811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611f001-68ba-4046-8b20-d237251fa321 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:50.488549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611f001-68ba-4046-8b20-d237251fa321 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:50.488549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611f001-68ba-4046-8b20-d237251fa321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:50.492138 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f178ed-4905-4d9a-b58e-145aa3867dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:50.492825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f178ed-4905-4d9a-b58e-145aa3867dec None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:50.493116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f178ed-4905-4d9a-b58e-145aa3867dec None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:50.493964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f178ed-4905-4d9a-b58e-145aa3867dec None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:50.495069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f178ed-4905-4d9a-b58e-145aa3867dec None admin] RBAC: Adding query filter params (name=reader) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:50.495069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f178ed-4905-4d9a-b58e-145aa3867dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:50.497224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f178ed-4905-4d9a-b58e-145aa3867dec None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:50.507693 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 58/109] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:20:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:50.508045 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8611f001-68ba-4046-8b20-d237251fa321 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:50.509032 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121240a-de22-441b-b9f4-1a785c178560 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:50.509291 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8611f001-68ba-4046-8b20-d237251fa321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:50.509385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121240a-de22-441b-b9f4-1a785c178560 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:50.509593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121240a-de22-441b-b9f4-1a785c178560 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:50.511001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 59/110] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:50.516352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121240a-de22-441b-b9f4-1a785c178560 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:50.585503 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 52/111] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:50.586841 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611f001-68ba-4046-8b20-d237251fa321 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:50.630026 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121240a-de22-441b-b9f4-1a785c178560 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:50.668989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6f0da-a69c-4ccb-8b43-49b4abf2d1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:50.670299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6f0da-a69c-4ccb-8b43-49b4abf2d1cc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:50.670818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6f0da-a69c-4ccb-8b43-49b4abf2d1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:50.671368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6f0da-a69c-4ccb-8b43-49b4abf2d1cc None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:50.673286 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6f0da-a69c-4ccb-8b43-49b4abf2d1cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:50.674215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6f0da-a69c-4ccb-8b43-49b4abf2d1cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:50.676149 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6f0da-a69c-4ccb-8b43-49b4abf2d1cc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:50.689419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 60/112] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:50.690500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85167398-548e-4afa-9f6a-ee9105148f91 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:50.690791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85167398-548e-4afa-9f6a-ee9105148f91 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:50.691072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85167398-548e-4afa-9f6a-ee9105148f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:50.708092 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-85167398-548e-4afa-9f6a-ee9105148f91 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:50.709092 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-85167398-548e-4afa-9f6a-ee9105148f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:50.715980 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:50.724938 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:50.731366 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611f001-68ba-4046-8b20-d237251fa321 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:50.769732 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a4dea-9e56-4c87-98d7-c471381d6c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:50.770364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a4dea-9e56-4c87-98d7-c471381d6c15 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:50.770649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a4dea-9e56-4c87-98d7-c471381d6c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:50.770928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a4dea-9e56-4c87-98d7-c471381d6c15 None admin] PATH_INFO: `/v3/users/2c09d5dccf8b45979f5cc050b2d12a28` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:50.785553 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a4dea-9e56-4c87-98d7-c471381d6c15 None admin] RBAC: Authorizing `identity:get_user(user_id=2c09d5dccf8b45979f5cc050b2d12a28)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:50.787054 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a4dea-9e56-4c87-98d7-c471381d6c15 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:50.788993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 53/113] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:50 2022] GET /identity/v3/users/2c09d5dccf8b45979f5cc050b2d12a28 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:50.789563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a4dea-9e56-4c87-98d7-c471381d6c15 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:50.804267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 61/114] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:50.806304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85167398-548e-4afa-9f6a-ee9105148f91 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:50.914821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a4dea-9e56-4c87-98d7-c471381d6c15 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:50.943583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85167398-548e-4afa-9f6a-ee9105148f91 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:50.950580 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea052c5-c8b0-49f8-a8c9-d2a56b8277d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:50.951397 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea052c5-c8b0-49f8-a8c9-d2a56b8277d9 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:50.951708 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea052c5-c8b0-49f8-a8c9-d2a56b8277d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:50.951985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea052c5-c8b0-49f8-a8c9-d2a56b8277d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:50.965089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea052c5-c8b0-49f8-a8c9-d2a56b8277d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-0ea052c5-c8b0-49f8-a8c9-d2a56b8277d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:50.973133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:50.974138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:50.980046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:50.980046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:50.980046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:50.980046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:50.980046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:50.980046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:50.980046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:50.980046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:50.980046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:50.980046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:50.980046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:20:50.980046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:20:50.980046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 54/115] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:50.980046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea052c5-c8b0-49f8-a8c9-d2a56b8277d9 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:50.998098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46540897-7784-40cf-a921-0dc3297045a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:50.999270 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46540897-7784-40cf-a921-0dc3297045a3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:51.001913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46540897-7784-40cf-a921-0dc3297045a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:51.002105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:51.002539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46540897-7784-40cf-a921-0dc3297045a3 None admin] PATH_INFO: `/v3/users/283045f7f6ca4861bfbecc3aa402c697` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:51.004968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46540897-7784-40cf-a921-0dc3297045a3 None admin] RBAC: Authorizing `identity:get_user(user_id=283045f7f6ca4861bfbecc3aa402c697)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:51.006857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46540897-7784-40cf-a921-0dc3297045a3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:51.009573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 62/116] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:50 2022] GET /identity/v3/users/283045f7f6ca4861bfbecc3aa402c697 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:51.011122 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46540897-7784-40cf-a921-0dc3297045a3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:51.033907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:51.100421 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea052c5-c8b0-49f8-a8c9-d2a56b8277d9 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:51.131302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46540897-7784-40cf-a921-0dc3297045a3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:51.141979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d99100-a709-4cb7-a16b-2cdaabd6bc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:51.142637 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d99100-a709-4cb7-a16b-2cdaabd6bc61 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:51.143043 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d99100-a709-4cb7-a16b-2cdaabd6bc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:51.143321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d99100-a709-4cb7-a16b-2cdaabd6bc61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:51.167172 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f322cd3-37d6-4944-b42c-11f07fd01da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:51.168010 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f322cd3-37d6-4944-b42c-11f07fd01da2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:51.168288 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f322cd3-37d6-4944-b42c-11f07fd01da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:51.168560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f322cd3-37d6-4944-b42c-11f07fd01da2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:51.179267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f322cd3-37d6-4944-b42c-11f07fd01da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-3f322cd3-37d6-4944-b42c-11f07fd01da2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:51.187220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:51.188352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:51.189359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:51.189359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:51.189359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:51.189359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:51.189359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:51.189359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:51.189359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:51.189359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:51.189359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:51.189359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:51.189359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:20:51.189359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:20:51.189359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 63/117] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:20:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:51.189359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f322cd3-37d6-4944-b42c-11f07fd01da2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:51.222898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d99100-a709-4cb7-a16b-2cdaabd6bc61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:51.224585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d99100-a709-4cb7-a16b-2cdaabd6bc61 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:51.239633 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:51.281517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:51.305698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f322cd3-37d6-4944-b42c-11f07fd01da2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:51.326035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 55/118] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:20:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:51.327053 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d99100-a709-4cb7-a16b-2cdaabd6bc61 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:51.346931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7e840-37e5-49fd-ab16-aa82d0fa3276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:51.347628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7e840-37e5-49fd-ab16-aa82d0fa3276 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:51.347913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7e840-37e5-49fd-ab16-aa82d0fa3276 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:51.348190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7e840-37e5-49fd-ab16-aa82d0fa3276 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:51.348936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7e840-37e5-49fd-ab16-aa82d0fa3276 None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:51.349241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7e840-37e5-49fd-ab16-aa82d0fa3276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:51.350628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7e840-37e5-49fd-ab16-aa82d0fa3276 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:51.359505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 64/119] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:20:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:51.360317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb699e-b1b5-453e-9248-068bf71d3e63 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:51.360600 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb699e-b1b5-453e-9248-068bf71d3e63 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:51.360875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb699e-b1b5-453e-9248-068bf71d3e63 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:51.362271 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 65/120] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:51.366949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb699e-b1b5-453e-9248-068bf71d3e63 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:51.443300 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d99100-a709-4cb7-a16b-2cdaabd6bc61 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:51.457528 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:51.469722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb699e-b1b5-453e-9248-068bf71d3e63 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:51.481850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b41c9-6d39-4a7a-b377-ceb478d341e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:51.482793 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b41c9-6d39-4a7a-b377-ceb478d341e6 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:51.483076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b41c9-6d39-4a7a-b377-ceb478d341e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:51.483350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b41c9-6d39-4a7a-b377-ceb478d341e6 None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:51.484791 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b41c9-6d39-4a7a-b377-ceb478d341e6 None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:51.486255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b41c9-6d39-4a7a-b377-ceb478d341e6 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:51.492911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 56/121] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:20:51 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:51.492911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b41c9-6d39-4a7a-b377-ceb478d341e6 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:51.509845 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b4b33-01b2-4a35-8252-d8564ee775e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:51.510576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b4b33-01b2-4a35-8252-d8564ee775e0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:51.510860 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b4b33-01b2-4a35-8252-d8564ee775e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:51.511198 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b4b33-01b2-4a35-8252-d8564ee775e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:51.512015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b4b33-01b2-4a35-8252-d8564ee775e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:51.512323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b4b33-01b2-4a35-8252-d8564ee775e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:51.513747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b4b33-01b2-4a35-8252-d8564ee775e0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:51.522760 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 66/122] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:20:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:51.523650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b4b33-01b2-4a35-8252-d8564ee775e0 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:51.526558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:51.609006 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b41c9-6d39-4a7a-b377-ceb478d341e6 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:51.627826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b4b33-01b2-4a35-8252-d8564ee775e0 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:51.645671 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1546b94-2991-437b-b1df-8b83104338c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:51.646532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1546b94-2991-437b-b1df-8b83104338c9 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:51.646813 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1546b94-2991-437b-b1df-8b83104338c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:51.647089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1546b94-2991-437b-b1df-8b83104338c9 None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:51.648417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1546b94-2991-437b-b1df-8b83104338c9 None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:51.649914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1546b94-2991-437b-b1df-8b83104338c9 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:51.652166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 57/123] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:20:51 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:51.658439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b924-6a9f-477a-9d80-911868a8c181 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:51.658566 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b924-6a9f-477a-9d80-911868a8c181 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:51.658986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064b924-6a9f-477a-9d80-911868a8c181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:51.667692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915409a-e7de-403a-b917-f66068335794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:51.670652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915409a-e7de-403a-b917-f66068335794 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:51.670652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915409a-e7de-403a-b917-f66068335794 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:51.670652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915409a-e7de-403a-b917-f66068335794 None admin] PATH_INFO: `/v3/users/e524aa79ee4a4cec95734314eb804eae` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:51.672045 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915409a-e7de-403a-b917-f66068335794 None admin] RBAC: Authorizing `identity:get_user(user_id=e524aa79ee4a4cec95734314eb804eae)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:51.673668 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915409a-e7de-403a-b917-f66068335794 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:51.675269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 67/124] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:51 2022] GET /identity/v3/users/e524aa79ee4a4cec95734314eb804eae => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:51.675872 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915409a-e7de-403a-b917-f66068335794 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:51.679866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-d064b924-6a9f-477a-9d80-911868a8c181 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:51.681688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d064b924-6a9f-477a-9d80-911868a8c181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:51.728404 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:51.747064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:51.757517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 58/125] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:51.758165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b924-6a9f-477a-9d80-911868a8c181 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:51.787583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915409a-e7de-403a-b917-f66068335794 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:51.824516 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e36b70-3004-4d2e-a5dd-d5a12eec1166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:51.825399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e36b70-3004-4d2e-a5dd-d5a12eec1166 None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:51.825931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e36b70-3004-4d2e-a5dd-d5a12eec1166 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:51.826218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e36b70-3004-4d2e-a5dd-d5a12eec1166 None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76/users/283045f7f6ca4861bfbecc3aa402c697/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:51.828177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e36b70-3004-4d2e-a5dd-d5a12eec1166 None admin] RBAC: Authorizing `identity:create_grant(project_id=16a031f7af0b46f9ae4b92c1457e0e76, user_id=283045f7f6ca4861bfbecc3aa402c697, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:51.829613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e36b70-3004-4d2e-a5dd-d5a12eec1166 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:51.844360 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 68/126] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:20:51 2022] PUT /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76/users/283045f7f6ca4861bfbecc3aa402c697/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:20:51.845034 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e36b70-3004-4d2e-a5dd-d5a12eec1166 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:51.890563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064b924-6a9f-477a-9d80-911868a8c181 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:51.930807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7efde-b842-4966-acad-9005d8ae74c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:51.932239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7efde-b842-4966-acad-9005d8ae74c6 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:51.932523 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7efde-b842-4966-acad-9005d8ae74c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:51.932798 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7efde-b842-4966-acad-9005d8ae74c6 None admin] PATH_INFO: `/v3/users/e524aa79ee4a4cec95734314eb804eae` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:51.934167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7efde-b842-4966-acad-9005d8ae74c6 None admin] RBAC: Authorizing `identity:get_user(user_id=e524aa79ee4a4cec95734314eb804eae)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:51.935721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7efde-b842-4966-acad-9005d8ae74c6 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:51.937788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 59/127] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:51 2022] GET /identity/v3/users/e524aa79ee4a4cec95734314eb804eae => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:51.938834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7efde-b842-4966-acad-9005d8ae74c6 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:51.992362 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:51.999498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e36b70-3004-4d2e-a5dd-d5a12eec1166 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:52.036445 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:52.045195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31081e-8c87-4f06-953b-570a47133311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:52.046318 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31081e-8c87-4f06-953b-570a47133311 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:52.046608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31081e-8c87-4f06-953b-570a47133311 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:52.047173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31081e-8c87-4f06-953b-570a47133311 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:52.048220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31081e-8c87-4f06-953b-570a47133311 None admin] RBAC: Adding query filter params (role.id=12bc45a7126d4529b9a76b4e74a28d44, scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76, user.id=2c09d5dccf8b45979f5cc050b2d12a28) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:52.048615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31081e-8c87-4f06-953b-570a47133311 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:52.050929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31081e-8c87-4f06-953b-570a47133311 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:52.058778 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 69/128] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:20:51 2022] GET /identity/v3/role_assignments?user.id=2c09d5dccf8b45979f5cc050b2d12a28&scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76&role.id=12bc45a7126d4529b9a76b4e74a28d44 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:52.059641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31081e-8c87-4f06-953b-570a47133311 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:52.064552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7efde-b842-4966-acad-9005d8ae74c6 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:52.149369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc5d11-5c42-4aa3-99b8-5ae0ee0ef6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:52.150715 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc5d11-5c42-4aa3-99b8-5ae0ee0ef6df None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:52.151206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc5d11-5c42-4aa3-99b8-5ae0ee0ef6df None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:52.151688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc5d11-5c42-4aa3-99b8-5ae0ee0ef6df None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:52.153162 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc5d11-5c42-4aa3-99b8-5ae0ee0ef6df None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:52.154843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc5d11-5c42-4aa3-99b8-5ae0ee0ef6df None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:52.163986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 60/129] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:20:51 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:52.165800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc5d11-5c42-4aa3-99b8-5ae0ee0ef6df None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:52.256944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31081e-8c87-4f06-953b-570a47133311 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:52.299545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b158277-952c-4e9a-bc2e-14fb2a71c460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:52.301192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b158277-952c-4e9a-bc2e-14fb2a71c460 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:52.301678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b158277-952c-4e9a-bc2e-14fb2a71c460 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:52.302173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b158277-952c-4e9a-bc2e-14fb2a71c460 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:52.313993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b158277-952c-4e9a-bc2e-14fb2a71c460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-3b158277-952c-4e9a-bc2e-14fb2a71c460 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:52.333357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:52.334332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:52.335137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:52.335137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:52.335137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:52.335137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:52.335137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:52.335137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:52.335137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:52.335137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:52.335137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:52.335137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:52.335137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:20:52.335137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:20:52.338256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 70/130] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:52.339345 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b158277-952c-4e9a-bc2e-14fb2a71c460 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:52.358963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc5d11-5c42-4aa3-99b8-5ae0ee0ef6df None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:52.384147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:52.403597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd5de1-38a8-4dc7-8201-f7cc97b6eb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:52.404454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd5de1-38a8-4dc7-8201-f7cc97b6eb4a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:52.404742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd5de1-38a8-4dc7-8201-f7cc97b6eb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:52.405022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd5de1-38a8-4dc7-8201-f7cc97b6eb4a None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:52.410399 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd5de1-38a8-4dc7-8201-f7cc97b6eb4a None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:52.411927 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd5de1-38a8-4dc7-8201-f7cc97b6eb4a None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:52.413750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 61/131] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:20:52 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:52.414524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd5de1-38a8-4dc7-8201-f7cc97b6eb4a None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:52.448008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:52.542154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b158277-952c-4e9a-bc2e-14fb2a71c460 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:52.555573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd5de1-38a8-4dc7-8201-f7cc97b6eb4a None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:52.600249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597effc-74c8-45e2-95cb-275ddf2213cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:52.600946 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597effc-74c8-45e2-95cb-275ddf2213cd None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:52.601234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597effc-74c8-45e2-95cb-275ddf2213cd None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:52.601512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597effc-74c8-45e2-95cb-275ddf2213cd None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:52.602284 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597effc-74c8-45e2-95cb-275ddf2213cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:52.603139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597effc-74c8-45e2-95cb-275ddf2213cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:52.604621 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aaa2d-815f-472b-b03e-5c7d40eaea06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:52.605531 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aaa2d-815f-472b-b03e-5c7d40eaea06 None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:52.605811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aaa2d-815f-472b-b03e-5c7d40eaea06 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:52.606139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aaa2d-815f-472b-b03e-5c7d40eaea06 None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76/users/e524aa79ee4a4cec95734314eb804eae/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:52.608517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597effc-74c8-45e2-95cb-275ddf2213cd None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:52.611706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479aaa2d-815f-472b-b03e-5c7d40eaea06 None admin] RBAC: Authorizing `identity:create_grant(project_id=16a031f7af0b46f9ae4b92c1457e0e76, user_id=e524aa79ee4a4cec95734314eb804eae, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:52.613193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479aaa2d-815f-472b-b03e-5c7d40eaea06 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:52.625981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 62/132] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:20:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:52.626860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597effc-74c8-45e2-95cb-275ddf2213cd None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:52.646080 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 71/133] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:20:52 2022] PUT /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76/users/e524aa79ee4a4cec95734314eb804eae/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:20:52.646930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aaa2d-815f-472b-b03e-5c7d40eaea06 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:52.728138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:52.797560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597effc-74c8-45e2-95cb-275ddf2213cd None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:52.836685 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68c99d-965e-452b-b5b3-294370cd5fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:52.837753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68c99d-965e-452b-b5b3-294370cd5fc0 None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:52.838049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68c99d-965e-452b-b5b3-294370cd5fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:52.838332 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68c99d-965e-452b-b5b3-294370cd5fc0 None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76/users/e524aa79ee4a4cec95734314eb804eae/roles/9c6db94ddc204b7e860aa2a9d622e14b` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:52.840658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68c99d-965e-452b-b5b3-294370cd5fc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=16a031f7af0b46f9ae4b92c1457e0e76, user_id=e524aa79ee4a4cec95734314eb804eae, role_id=9c6db94ddc204b7e860aa2a9d622e14b)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:52.842334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68c99d-965e-452b-b5b3-294370cd5fc0 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:52.870330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 63/134] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:20:52 2022] PUT /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76/users/e524aa79ee4a4cec95734314eb804eae/roles/9c6db94ddc204b7e860aa2a9d622e14b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:20:52.871696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15a885-1bf8-4d73-a1ff-cfce033735bb None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:52.871993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15a885-1bf8-4d73-a1ff-cfce033735bb None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:52.872205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aaa2d-815f-472b-b03e-5c7d40eaea06 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:52.872320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15a885-1bf8-4d73-a1ff-cfce033735bb None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:52.873694 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 64/135] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:52.879454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087a42b-6fba-4415-be4f-1041de9cdcff None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:52.879772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087a42b-6fba-4415-be4f-1041de9cdcff None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:52.880090 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087a42b-6fba-4415-be4f-1041de9cdcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:52.890377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:52.913767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-4087a42b-6fba-4415-be4f-1041de9cdcff None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:52.916031 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4087a42b-6fba-4415-be4f-1041de9cdcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:52.928257 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99034ad2-e0d9-4826-9177-51a2771d5a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:52.929445 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99034ad2-e0d9-4826-9177-51a2771d5a07 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:52.929911 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99034ad2-e0d9-4826-9177-51a2771d5a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:52.930383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99034ad2-e0d9-4826-9177-51a2771d5a07 None admin] PATH_INFO: `/v3/users/e524aa79ee4a4cec95734314eb804eae` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:52.934027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99034ad2-e0d9-4826-9177-51a2771d5a07 None admin] RBAC: Authorizing `identity:get_user(user_id=e524aa79ee4a4cec95734314eb804eae)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:52.935787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99034ad2-e0d9-4826-9177-51a2771d5a07 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:52.939189 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 72/136] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:52 2022] GET /identity/v3/users/e524aa79ee4a4cec95734314eb804eae => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:52.950039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99034ad2-e0d9-4826-9177-51a2771d5a07 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:53.044924 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 65/137] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 15 10:20:53.079634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087a42b-6fba-4415-be4f-1041de9cdcff None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:53.124362 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99034ad2-e0d9-4826-9177-51a2771d5a07 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:53.170720 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:53.204870 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3ad7c-414f-4016-9554-e5fb93f32b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:53.206128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3ad7c-414f-4016-9554-e5fb93f32b90 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:53.206608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3ad7c-414f-4016-9554-e5fb93f32b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:53.207067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3ad7c-414f-4016-9554-e5fb93f32b90 None admin] PATH_INFO: `/v3/projects/a705345d665f4632afccb5c440460242` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:53.211602 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3ad7c-414f-4016-9554-e5fb93f32b90 None admin] RBAC: Authorizing `identity:get_project(project_id=a705345d665f4632afccb5c440460242)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:53.213866 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3ad7c-414f-4016-9554-e5fb93f32b90 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:53.215850 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 73/138] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:20:52 2022] GET /identity/v3/projects/a705345d665f4632afccb5c440460242 => generated 312 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:20:53.221635 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3ad7c-414f-4016-9554-e5fb93f32b90 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:53.242293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087a42b-6fba-4415-be4f-1041de9cdcff None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:53.278182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a1364-bd2b-471f-887f-1399f4a8835e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:53.278985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a1364-bd2b-471f-887f-1399f4a8835e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:53.279268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a1364-bd2b-471f-887f-1399f4a8835e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:53.279573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a1364-bd2b-471f-887f-1399f4a8835e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:53.280751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a1364-bd2b-471f-887f-1399f4a8835e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:53.282222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a1364-bd2b-471f-887f-1399f4a8835e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:53.284215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 66/139] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:20:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:20:53.289956 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a1364-bd2b-471f-887f-1399f4a8835e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:53.347751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:53.430574 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3ad7c-414f-4016-9554-e5fb93f32b90 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:53.496406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a1364-bd2b-471f-887f-1399f4a8835e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:53.501903 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:53.513226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1a879-fa4d-421c-9982-65b3acf3e3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:53.514132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1a879-fa4d-421c-9982-65b3acf3e3f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:53.514417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1a879-fa4d-421c-9982-65b3acf3e3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:53.514695 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1a879-fa4d-421c-9982-65b3acf3e3f5 None admin] PATH_INFO: `/v3/projects/a705345d665f4632afccb5c440460242/users/e524aa79ee4a4cec95734314eb804eae/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:53.518591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1a879-fa4d-421c-9982-65b3acf3e3f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a705345d665f4632afccb5c440460242, user_id=e524aa79ee4a4cec95734314eb804eae, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:53.520260 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1a879-fa4d-421c-9982-65b3acf3e3f5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:53.555588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 74/140] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:20:53 2022] PUT /identity/v3/projects/a705345d665f4632afccb5c440460242/users/e524aa79ee4a4cec95734314eb804eae/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:20:53.560875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc265ed3-68c7-4f31-a636-e54356131c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:53.562280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc265ed3-68c7-4f31-a636-e54356131c13 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:53.562770 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc265ed3-68c7-4f31-a636-e54356131c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:53.563330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc265ed3-68c7-4f31-a636-e54356131c13 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:53.564698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc265ed3-68c7-4f31-a636-e54356131c13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:53.566513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc265ed3-68c7-4f31-a636-e54356131c13 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:53.598577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 67/141] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:20:53 2022] POST /identity/v3/users => generated 283 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:20:54.522584 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb3dba-32ea-4bf9-bbb7-20054111dc79 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:54.523304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb3dba-32ea-4bf9-bbb7-20054111dc79 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:54.523812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb3dba-32ea-4bf9-bbb7-20054111dc79 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:54.525931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 75/142] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:54.543875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511126a6-200e-4d70-bdcf-d950f7f51fcd None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:54.544521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511126a6-200e-4d70-bdcf-d950f7f51fcd None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:54.545027 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511126a6-200e-4d70-bdcf-d950f7f51fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:54.564612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-511126a6-200e-4d70-bdcf-d950f7f51fcd None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:54.565868 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-511126a6-200e-4d70-bdcf-d950f7f51fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:54.652893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 68/143] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:54.702101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb3dba-32ea-4bf9-bbb7-20054111dc79 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:54.845875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb3dba-32ea-4bf9-bbb7-20054111dc79 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:54.857988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:54.888370 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7ecf4-c935-452c-ae15-f05d64409181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:54.889479 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ecf4-c935-452c-ae15-f05d64409181 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:54.889907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ecf4-c935-452c-ae15-f05d64409181 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:54.890342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7ecf4-c935-452c-ae15-f05d64409181 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:54.912595 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7ecf4-c935-452c-ae15-f05d64409181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-aae7ecf4-c935-452c-ae15-f05d64409181 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:54.920762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:54.921865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:54.922863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:54.922863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:54.922863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:54.922863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:54.922863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:54.922863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:54.922863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:54.922863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:54.922863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:54.922863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:54.922863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:20:54.922863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:20:54.924941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 76/144] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:20:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:54.932598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511126a6-200e-4d70-bdcf-d950f7f51fcd None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:55.056781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:55.069824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511126a6-200e-4d70-bdcf-d950f7f51fcd None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:55.116726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4603029-df13-4d50-ae63-8df3fc6ed810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:55.117343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4603029-df13-4d50-ae63-8df3fc6ed810 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:55.117628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4603029-df13-4d50-ae63-8df3fc6ed810 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:55.117911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4603029-df13-4d50-ae63-8df3fc6ed810 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:55.118734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4603029-df13-4d50-ae63-8df3fc6ed810 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:55.119047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4603029-df13-4d50-ae63-8df3fc6ed810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:55.120501 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4603029-df13-4d50-ae63-8df3fc6ed810 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:55.129529 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 69/145] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:55.136490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7ecf4-c935-452c-ae15-f05d64409181 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:55.207119 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147f13-fcad-4df1-b7ea-79ec1a3437b6 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:55.207425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147f13-fcad-4df1-b7ea-79ec1a3437b6 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:55.207716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147f13-fcad-4df1-b7ea-79ec1a3437b6 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:55.209265 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 70/146] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:20:55.216722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c712-de4c-4746-80a6-3ff33a023014 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:55.217015 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c712-de4c-4746-80a6-3ff33a023014 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:55.217311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c712-de4c-4746-80a6-3ff33a023014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:55.247247 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ab03c712-de4c-4746-80a6-3ff33a023014 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:55.247729 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ab03c712-de4c-4746-80a6-3ff33a023014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:55.289796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7ecf4-c935-452c-ae15-f05d64409181 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:55.330252 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67583c0a-ce00-4c84-923c-d09270d63445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:55.331659 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67583c0a-ce00-4c84-923c-d09270d63445 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:55.332146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67583c0a-ce00-4c84-923c-d09270d63445 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:55.332643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67583c0a-ce00-4c84-923c-d09270d63445 None admin] PATH_INFO: `/v3/users/283045f7f6ca4861bfbecc3aa402c697` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:55.334082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67583c0a-ce00-4c84-923c-d09270d63445 None admin] RBAC: Authorizing `identity:get_user(user_id=283045f7f6ca4861bfbecc3aa402c697)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:55.335809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67583c0a-ce00-4c84-923c-d09270d63445 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:55.337729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 77/147] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:55 2022] GET /identity/v3/users/283045f7f6ca4861bfbecc3aa402c697 => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:55.343282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67583c0a-ce00-4c84-923c-d09270d63445 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:55.415299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:55.425166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 71/148] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:20:55.472187 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03c712-de4c-4746-80a6-3ff33a023014 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:55.520127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67583c0a-ce00-4c84-923c-d09270d63445 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:55.592169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421998f8-4099-440c-bd6f-5b59e184811d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:55.594142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421998f8-4099-440c-bd6f-5b59e184811d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:55.594808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421998f8-4099-440c-bd6f-5b59e184811d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:55.596500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421998f8-4099-440c-bd6f-5b59e184811d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:55.621363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:55.648560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03c712-de4c-4746-80a6-3ff33a023014 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:55.720200 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5eeaa-21f8-49f4-bf92-e295dded35e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:55.721005 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5eeaa-21f8-49f4-bf92-e295dded35e0 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:55.721292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5eeaa-21f8-49f4-bf92-e295dded35e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:55.721565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5eeaa-21f8-49f4-bf92-e295dded35e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:55.730369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421998f8-4099-440c-bd6f-5b59e184811d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:55.731950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421998f8-4099-440c-bd6f-5b59e184811d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:55.746528 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5eeaa-21f8-49f4-bf92-e295dded35e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-1ac5eeaa-21f8-49f4-bf92-e295dded35e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:55.758157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:55.759100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:55.759971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:55.759971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:55.759971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:55.759971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:55.759971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:55.759971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:55.759971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:55.759971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:55.759971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:55.759971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:55.759971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:20:55.759971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:20:55.759971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 72/149] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:20:55.765769 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5eeaa-21f8-49f4-bf92-e295dded35e0 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:55.804759 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:55.905717 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 78/150] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:20:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:55.912039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421998f8-4099-440c-bd6f-5b59e184811d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:56.012585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5eeaa-21f8-49f4-bf92-e295dded35e0 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:56.052259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421998f8-4099-440c-bd6f-5b59e184811d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:56.104359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae3c22-77a7-4e15-b42f-7dc861cc27bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:56.105352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae3c22-77a7-4e15-b42f-7dc861cc27bc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:56.105636 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae3c22-77a7-4e15-b42f-7dc861cc27bc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:56.105903 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae3c22-77a7-4e15-b42f-7dc861cc27bc None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:56.107286 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae3c22-77a7-4e15-b42f-7dc861cc27bc None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:56.108955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae3c22-77a7-4e15-b42f-7dc861cc27bc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:56.110870 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 79/151] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:20:55 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:20:56.112185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4443573-e80a-47b0-a69c-4a48f6c06ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:56.112868 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443573-e80a-47b0-a69c-4a48f6c06ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:56.113154 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443573-e80a-47b0-a69c-4a48f6c06ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:56.113433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4443573-e80a-47b0-a69c-4a48f6c06ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:56.114200 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4443573-e80a-47b0-a69c-4a48f6c06ab6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:56.114508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4443573-e80a-47b0-a69c-4a48f6c06ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:56.116199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4443573-e80a-47b0-a69c-4a48f6c06ab6 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:56.116800 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae3c22-77a7-4e15-b42f-7dc861cc27bc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:56.130792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 73/152] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:20:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:56.132680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:56.136492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4443573-e80a-47b0-a69c-4a48f6c06ab6 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:56.152573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:56.254139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae3c22-77a7-4e15-b42f-7dc861cc27bc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:56.291360 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b5c04-8cc5-49ba-804e-d16854b98da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:56.291992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b5c04-8cc5-49ba-804e-d16854b98da8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:56.292262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b5c04-8cc5-49ba-804e-d16854b98da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:56.292526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b5c04-8cc5-49ba-804e-d16854b98da8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:56.293378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b5c04-8cc5-49ba-804e-d16854b98da8 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76, user.id=283045f7f6ca4861bfbecc3aa402c697) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:56.293684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b5c04-8cc5-49ba-804e-d16854b98da8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:56.295131 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b5c04-8cc5-49ba-804e-d16854b98da8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:56.301668 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 80/153] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:20:56 2022] GET /identity/v3/role_assignments?user.id=283045f7f6ca4861bfbecc3aa402c697&scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76&role.id=e1a2021d08e14daa969362b3d23face3 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:20:56.303039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f936d8-9411-4334-b00a-5bc54ab80cb9 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:56.303328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f936d8-9411-4334-b00a-5bc54ab80cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:56.303625 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f936d8-9411-4334-b00a-5bc54ab80cb9 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:56.305052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 81/154] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:56.311215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d17e8e-dc76-488f-af68-2272c270bc23 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:56.311565 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d17e8e-dc76-488f-af68-2272c270bc23 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:56.311790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d17e8e-dc76-488f-af68-2272c270bc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:56.339594 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c5d17e8e-dc76-488f-af68-2272c270bc23 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:56.340824 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c5d17e8e-dc76-488f-af68-2272c270bc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:56.403240 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4443573-e80a-47b0-a69c-4a48f6c06ab6 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:56.411988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:56.417947 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 82/155] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:20:56.441442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d17e8e-dc76-488f-af68-2272c270bc23 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:56.480228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c3ae2-5601-4ab2-81bb-bb8babbaca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:56.481128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c3ae2-5601-4ab2-81bb-bb8babbaca59 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:56.481410 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c3ae2-5601-4ab2-81bb-bb8babbaca59 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:56.481684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c3ae2-5601-4ab2-81bb-bb8babbaca59 None admin] PATH_INFO: `/v3/users/2c09d5dccf8b45979f5cc050b2d12a28` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:56.482961 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c3ae2-5601-4ab2-81bb-bb8babbaca59 None admin] RBAC: Authorizing `identity:get_user(user_id=2c09d5dccf8b45979f5cc050b2d12a28)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:56.488140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c3ae2-5601-4ab2-81bb-bb8babbaca59 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:56.488140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 74/156] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:56 2022] GET /identity/v3/users/2c09d5dccf8b45979f5cc050b2d12a28 => generated 289 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:20:56.488140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cb269-e5b7-4533-b976-8f1719d1a766 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:56.488140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cb269-e5b7-4533-b976-8f1719d1a766 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:56.488140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cb269-e5b7-4533-b976-8f1719d1a766 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:56.490602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 75/157] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:56.495707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cb269-e5b7-4533-b976-8f1719d1a766 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:56.583085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d17e8e-dc76-488f-af68-2272c270bc23 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:56.659261 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8877f98-be6c-40ce-a12d-e167e0a41ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:56.660098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8877f98-be6c-40ce-a12d-e167e0a41ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:56.660380 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8877f98-be6c-40ce-a12d-e167e0a41ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:56.660655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8877f98-be6c-40ce-a12d-e167e0a41ad8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:56.684787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8877f98-be6c-40ce-a12d-e167e0a41ad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-f8877f98-be6c-40ce-a12d-e167e0a41ad8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:56.699407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:56.700487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:56.701291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:56.701291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:56.701291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:56.701291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:56.701291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:56.701291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:56.701291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:56.701291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:56.701291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:56.701291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:56.701291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:20:56.701291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:20:56.701291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 83/158] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:56.702688 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5bd8c-d497-4833-b02d-4c7501b6fd69 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:56.702688 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5bd8c-d497-4833-b02d-4c7501b6fd69 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:56.702894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5bd8c-d497-4833-b02d-4c7501b6fd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:56.713455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:56.734858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7ef5bd8c-d497-4833-b02d-4c7501b6fd69 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:56.736129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7ef5bd8c-d497-4833-b02d-4c7501b6fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:56.780165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cb269-e5b7-4533-b976-8f1719d1a766 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:56.832192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581a93a-b454-4a5a-9675-8dcfb7425005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:56.833071 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581a93a-b454-4a5a-9675-8dcfb7425005 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:56.833411 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581a93a-b454-4a5a-9675-8dcfb7425005 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:56.833633 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581a93a-b454-4a5a-9675-8dcfb7425005 None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:56.834864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581a93a-b454-4a5a-9675-8dcfb7425005 None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:56.836361 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581a93a-b454-4a5a-9675-8dcfb7425005 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:56.838775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 76/159] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:20:56 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:20:56.839364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581a93a-b454-4a5a-9675-8dcfb7425005 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:56.869242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:56.902069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 84/160] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:56.902987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5bd8c-d497-4833-b02d-4c7501b6fd69 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:56.982228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581a93a-b454-4a5a-9675-8dcfb7425005 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:57.038555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5481960-161c-4f4e-be99-c71d994002a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:57.039237 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5481960-161c-4f4e-be99-c71d994002a9 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:57.039541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5481960-161c-4f4e-be99-c71d994002a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:57.039820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5481960-161c-4f4e-be99-c71d994002a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:57.041143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5481960-161c-4f4e-be99-c71d994002a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:57.041451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5481960-161c-4f4e-be99-c71d994002a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:57.042855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5481960-161c-4f4e-be99-c71d994002a9 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:57.048401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:57.056564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 77/161] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:20:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:57.057272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5481960-161c-4f4e-be99-c71d994002a9 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:57.120385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5bd8c-d497-4833-b02d-4c7501b6fd69 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:57.194925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5481960-161c-4f4e-be99-c71d994002a9 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:57.228215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca393ec-c64b-4d87-90d7-daa62b780a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:57.229125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca393ec-c64b-4d87-90d7-daa62b780a7d None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:57.229403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca393ec-c64b-4d87-90d7-daa62b780a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:57.229684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca393ec-c64b-4d87-90d7-daa62b780a7d None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76/users/2c09d5dccf8b45979f5cc050b2d12a28/roles/12bc45a7126d4529b9a76b4e74a28d44` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:57.244542 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca393ec-c64b-4d87-90d7-daa62b780a7d None admin] RBAC: Authorizing `identity:create_grant(project_id=16a031f7af0b46f9ae4b92c1457e0e76, user_id=2c09d5dccf8b45979f5cc050b2d12a28, role_id=12bc45a7126d4529b9a76b4e74a28d44)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:57.246049 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca393ec-c64b-4d87-90d7-daa62b780a7d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:57.246942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b1977-a31a-441c-8962-71ef7ba9532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:57.247796 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b1977-a31a-441c-8962-71ef7ba9532b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:57.248094 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b1977-a31a-441c-8962-71ef7ba9532b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:57.248341 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b1977-a31a-441c-8962-71ef7ba9532b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:57.264743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b1977-a31a-441c-8962-71ef7ba9532b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-ba5b1977-a31a-441c-8962-71ef7ba9532b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:57.280871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:57.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:57.282706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:57.282706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:57.282706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:57.282706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:57.282706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:57.282706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:57.282706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:57.282706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:57.282706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:57.282706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:57.282706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:20:57.282706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:20:57.282706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 78/162] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:20:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:57.283375 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b1977-a31a-441c-8962-71ef7ba9532b None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:57.286452 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 85/163] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:20:56 2022] PUT /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76/users/2c09d5dccf8b45979f5cc050b2d12a28/roles/12bc45a7126d4529b9a76b4e74a28d44 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:20:57.289718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca393ec-c64b-4d87-90d7-daa62b780a7d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:57.376560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:57.407097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:57.464035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca393ec-c64b-4d87-90d7-daa62b780a7d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:57.465073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b1977-a31a-441c-8962-71ef7ba9532b None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:57.523496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e16d23-005d-4c81-b23b-f94619dd8d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:57.524514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16d23-005d-4c81-b23b-f94619dd8d73 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:57.524801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16d23-005d-4c81-b23b-f94619dd8d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:57.525078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e16d23-005d-4c81-b23b-f94619dd8d73 None admin] PATH_INFO: `/v3/users/e524aa79ee4a4cec95734314eb804eae` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:57.527861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e16d23-005d-4c81-b23b-f94619dd8d73 None admin] RBAC: Authorizing `identity:get_user(user_id=e524aa79ee4a4cec95734314eb804eae)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:57.528701 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6708f-7bac-43c0-9baa-ee9231c83b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:57.529327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e16d23-005d-4c81-b23b-f94619dd8d73 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:57.530003 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6708f-7bac-43c0-9baa-ee9231c83b38 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:57.530541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6708f-7bac-43c0-9baa-ee9231c83b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:57.531145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 79/164] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:57 2022] GET /identity/v3/users/e524aa79ee4a4cec95734314eb804eae => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:57.531494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6708f-7bac-43c0-9baa-ee9231c83b38 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:57.532457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6708f-7bac-43c0-9baa-ee9231c83b38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:57.532954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6708f-7bac-43c0-9baa-ee9231c83b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:57.543494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b6708f-7bac-43c0-9baa-ee9231c83b38 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:57.545074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e16d23-005d-4c81-b23b-f94619dd8d73 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:57.561682 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 86/165] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:20:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:57.567330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6708f-7bac-43c0-9baa-ee9231c83b38 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:57.799779 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e16d23-005d-4c81-b23b-f94619dd8d73 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:57.802243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6708f-7bac-43c0-9baa-ee9231c83b38 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:57.838468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:57.867269 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:57.886621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dcd45-72e1-421b-8a7d-8bdff974d4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:57.888051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dcd45-72e1-421b-8a7d-8bdff974d4ce None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:57.888334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dcd45-72e1-421b-8a7d-8bdff974d4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:57.888614 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dcd45-72e1-421b-8a7d-8bdff974d4ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:57.914310 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e62f51-fa3a-40b9-a279-44eb132e8a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:57.916145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e62f51-fa3a-40b9-a279-44eb132e8a92 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:57.916690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e62f51-fa3a-40b9-a279-44eb132e8a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:57.918632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e62f51-fa3a-40b9-a279-44eb132e8a92 None admin] PATH_INFO: `/v3/users/e524aa79ee4a4cec95734314eb804eae` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:57.921327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e62f51-fa3a-40b9-a279-44eb132e8a92 None admin] RBAC: Authorizing `identity:get_user(user_id=e524aa79ee4a4cec95734314eb804eae)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:57.923011 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e62f51-fa3a-40b9-a279-44eb132e8a92 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:57.925553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 87/166] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:57 2022] GET /identity/v3/users/e524aa79ee4a4cec95734314eb804eae => generated 275 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:57.932511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e62f51-fa3a-40b9-a279-44eb132e8a92 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:58.037811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15dcd45-72e1-421b-8a7d-8bdff974d4ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:58.039645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15dcd45-72e1-421b-8a7d-8bdff974d4ce None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:58.100182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e62f51-fa3a-40b9-a279-44eb132e8a92 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:58.138407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb8383-ed80-4cd8-a250-9a995970c459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:58.139072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb8383-ed80-4cd8-a250-9a995970c459 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:58.139356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb8383-ed80-4cd8-a250-9a995970c459 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:58.139662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb8383-ed80-4cd8-a250-9a995970c459 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:58.212430 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:58.216379 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb8383-ed80-4cd8-a250-9a995970c459 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:58.217855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb8383-ed80-4cd8-a250-9a995970c459 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:58.318608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 80/167] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:20:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 774 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:58.319959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757bc6b-9c17-4247-ba4a-949ca8b4a1d9 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:58.320256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757bc6b-9c17-4247-ba4a-949ca8b4a1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:58.320535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757bc6b-9c17-4247-ba4a-949ca8b4a1d9 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:58.324024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 81/168] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:58.325672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cc666-6c36-49cc-84bf-9ebc1f8b1ffd None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:58.325959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cc666-6c36-49cc-84bf-9ebc1f8b1ffd None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:58.326237 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cc666-6c36-49cc-84bf-9ebc1f8b1ffd None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:58.336222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 82/169] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:58 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:58.337336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cc666-6c36-49cc-84bf-9ebc1f8b1ffd None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:58.352688 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 88/170] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:20:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:20:58.354554 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea6747-7b5e-41a8-95b5-9efc1a9561f1 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:58.354554 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea6747-7b5e-41a8-95b5-9efc1a9561f1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:58.354772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea6747-7b5e-41a8-95b5-9efc1a9561f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:58.380706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4fea6747-7b5e-41a8-95b5-9efc1a9561f1 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:58.382311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4fea6747-7b5e-41a8-95b5-9efc1a9561f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:58.436245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:58.460873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 89/171] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:58.462086 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f26b3-8a13-4a35-80eb-8533bed99106 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:58.462374 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f26b3-8a13-4a35-80eb-8533bed99106 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:58.462707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f26b3-8a13-4a35-80eb-8533bed99106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:58.479088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a04f26b3-8a13-4a35-80eb-8533bed99106 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:58.480296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a04f26b3-8a13-4a35-80eb-8533bed99106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:58.483980 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:58.545622 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cc666-6c36-49cc-84bf-9ebc1f8b1ffd None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:58.554807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 90/172] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:58.563925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f26b3-8a13-4a35-80eb-8533bed99106 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:58.587844 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba48bb-7340-48de-8fa5-68a17f7b9e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:58.589435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba48bb-7340-48de-8fa5-68a17f7b9e93 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:58.589914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba48bb-7340-48de-8fa5-68a17f7b9e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:58.590373 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba48bb-7340-48de-8fa5-68a17f7b9e93 None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:58.592064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba48bb-7340-48de-8fa5-68a17f7b9e93 None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:58.593947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba48bb-7340-48de-8fa5-68a17f7b9e93 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:58.596564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 83/173] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:20:58 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:58.603885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04367ff-1032-4c57-9a1a-255aaabb738a None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:58.604420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04367ff-1032-4c57-9a1a-255aaabb738a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:58.605150 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04367ff-1032-4c57-9a1a-255aaabb738a None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:58.606922 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 84/174] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:58.608272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04367ff-1032-4c57-9a1a-255aaabb738a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:58.702500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f26b3-8a13-4a35-80eb-8533bed99106 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:58.736111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:58.738886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e925d0-c217-4606-8dbd-893c8897b780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:58.739930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e925d0-c217-4606-8dbd-893c8897b780 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:58.740287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e925d0-c217-4606-8dbd-893c8897b780 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:58.740629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e925d0-c217-4606-8dbd-893c8897b780 None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:58.742496 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e925d0-c217-4606-8dbd-893c8897b780 None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:58.745355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e925d0-c217-4606-8dbd-893c8897b780 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:58.747327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 91/175] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:20:58 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:58.748644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04367ff-1032-4c57-9a1a-255aaabb738a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:58.752869 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e925d0-c217-4606-8dbd-893c8897b780 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:58.765610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:58.791754 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcf9a4-ef35-437e-959d-1522cc48fd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:58.792650 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf9a4-ef35-437e-959d-1522cc48fd65 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:58.793002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf9a4-ef35-437e-959d-1522cc48fd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:58.793370 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcf9a4-ef35-437e-959d-1522cc48fd65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:58.804157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcf9a4-ef35-437e-959d-1522cc48fd65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-6edcf9a4-ef35-437e-959d-1522cc48fd65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:58.812781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:58.813697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:58.814524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:58.814524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:58.814524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:58.814524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:58.814524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:58.814524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:58.814524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:58.814524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:58.814524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:58.814524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:58.814524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:20:58.814524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:20:58.814524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 85/176] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:58.815206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcf9a4-ef35-437e-959d-1522cc48fd65 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:58.888430 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e925d0-c217-4606-8dbd-893c8897b780 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:58.920286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcf9a4-ef35-437e-959d-1522cc48fd65 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:58.936747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f192e0-79c3-4257-a915-a23a82a092c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:58.938015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f192e0-79c3-4257-a915-a23a82a092c0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:58.938844 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f192e0-79c3-4257-a915-a23a82a092c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:58.939310 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f192e0-79c3-4257-a915-a23a82a092c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:58.954371 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f192e0-79c3-4257-a915-a23a82a092c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:58.956165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c86436-5724-4cbf-a886-ba628a78b792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:58.956953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c86436-5724-4cbf-a886-ba628a78b792 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:58.957302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c86436-5724-4cbf-a886-ba628a78b792 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:58.957645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c86436-5724-4cbf-a886-ba628a78b792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:58.958630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c86436-5724-4cbf-a886-ba628a78b792 None admin] RBAC: Adding query filter params (role.id=484f610225884740911a5c3333f22221, scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76, user.id=e524aa79ee4a4cec95734314eb804eae) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:58.959012 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c86436-5724-4cbf-a886-ba628a78b792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:58.960722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c86436-5724-4cbf-a886-ba628a78b792 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-08f192e0-79c3-4257-a915-a23a82a092c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:58.965987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:58.966996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:58.967892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:58.967892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:58.967892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:58.967892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:58.967892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:58.967892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:58.967892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:58.967892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:58.967892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:58.967892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:58.967892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:20:58.967892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:20:58.969242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 92/177] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:20:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:58.971926 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 86/178] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:20:58 2022] GET /identity/v3/role_assignments?user.id=e524aa79ee4a4cec95734314eb804eae&scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76&role.id=484f610225884740911a5c3333f22221 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:58.973291 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c86436-5724-4cbf-a886-ba628a78b792 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:58.975454 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba986a4-509d-4929-a53b-19f776f991a6 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:58.975772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba986a4-509d-4929-a53b-19f776f991a6 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:58.976057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba986a4-509d-4929-a53b-19f776f991a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:58.996056 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-aba986a4-509d-4929-a53b-19f776f991a6 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:58.997218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-aba986a4-509d-4929-a53b-19f776f991a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:59.006011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:59.112016 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:59.120301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 93/179] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:59.121577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba986a4-509d-4929-a53b-19f776f991a6 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:59.155177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c86436-5724-4cbf-a886-ba628a78b792 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:59.194335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823810e-6042-4593-9310-44b97e55b11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:59.194993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823810e-6042-4593-9310-44b97e55b11d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:59.195277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823810e-6042-4593-9310-44b97e55b11d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:59.195605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823810e-6042-4593-9310-44b97e55b11d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:59.196998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823810e-6042-4593-9310-44b97e55b11d None admin] RBAC: Adding query filter params (role.id=9c6db94ddc204b7e860aa2a9d622e14b, scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76, user.id=e524aa79ee4a4cec95734314eb804eae) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:59.197311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823810e-6042-4593-9310-44b97e55b11d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:59.198767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823810e-6042-4593-9310-44b97e55b11d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:59.205795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 87/180] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:20:58 2022] GET /identity/v3/role_assignments?user.id=e524aa79ee4a4cec95734314eb804eae&scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76&role.id=9c6db94ddc204b7e860aa2a9d622e14b => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:59.206444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823810e-6042-4593-9310-44b97e55b11d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:59.266245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba986a4-509d-4929-a53b-19f776f991a6 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:59.308881 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65784e1-90a3-4a3e-abb0-2e34a1fde465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:59.309168 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65784e1-90a3-4a3e-abb0-2e34a1fde465 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:59.309398 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65784e1-90a3-4a3e-abb0-2e34a1fde465 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:59.309723 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65784e1-90a3-4a3e-abb0-2e34a1fde465 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:59.310499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65784e1-90a3-4a3e-abb0-2e34a1fde465 None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:59.310805 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65784e1-90a3-4a3e-abb0-2e34a1fde465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:59.312262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65784e1-90a3-4a3e-abb0-2e34a1fde465 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:59.322728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 94/181] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:20:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:59.328117 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb4a7a-4523-4c7f-9311-05989495f383 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:59.328486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb4a7a-4523-4c7f-9311-05989495f383 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:59.328844 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb4a7a-4523-4c7f-9311-05989495f383 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:59.330281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 95/182] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:20:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:20:59.331021 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb4a7a-4523-4c7f-9311-05989495f383 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:59.338467 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:59.370225 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823810e-6042-4593-9310-44b97e55b11d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:59.412160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee69d8b-ef3d-4893-8019-40d780b5d8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:59.413130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:59.413244 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee69d8b-ef3d-4893-8019-40d780b5d8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:59.413447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee69d8b-ef3d-4893-8019-40d780b5d8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:59.414175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee69d8b-ef3d-4893-8019-40d780b5d8e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:59.415552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee69d8b-ef3d-4893-8019-40d780b5d8e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:59.415869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee69d8b-ef3d-4893-8019-40d780b5d8e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:59.417323 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee69d8b-ef3d-4893-8019-40d780b5d8e2 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:59.426352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 88/183] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:20:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:59.432204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee69d8b-ef3d-4893-8019-40d780b5d8e2 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:59.472348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb4a7a-4523-4c7f-9311-05989495f383 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:59.512797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8808e-c021-4228-a933-dd3c47fe2386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:59.513609 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8808e-c021-4228-a933-dd3c47fe2386 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:59.513889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8808e-c021-4228-a933-dd3c47fe2386 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:59.514164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8808e-c021-4228-a933-dd3c47fe2386 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:59.526360 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8808e-c021-4228-a933-dd3c47fe2386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-a2a8808e-c021-4228-a933-dd3c47fe2386 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:20:59.534424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:20:59.535299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:20:59.536253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:20:59.536253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:20:59.536253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:20:59.536253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:20:59.536253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:20:59.536253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:20:59.536253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:20:59.536253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:20:59.536253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:20:59.536253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:20:59.536253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:20:59.536253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:20:59.539786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 96/184] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:20:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:20:59.541851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b56cc-eb85-4ec5-9829-20eac5791b9e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:59.542286 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b56cc-eb85-4ec5-9829-20eac5791b9e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:59.542569 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b56cc-eb85-4ec5-9829-20eac5791b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:59.549356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee69d8b-ef3d-4893-8019-40d780b5d8e2 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:59.559182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-538b56cc-eb85-4ec5-9829-20eac5791b9e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:20:59.560384 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-538b56cc-eb85-4ec5-9829-20eac5791b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:20:59.584444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52e560-b0af-43ad-a223-595ece06f9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:59.585321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52e560-b0af-43ad-a223-595ece06f9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:59.585607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52e560-b0af-43ad-a223-595ece06f9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:59.585885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52e560-b0af-43ad-a223-595ece06f9e4 None admin] PATH_INFO: `/v3/users/e524aa79ee4a4cec95734314eb804eae` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:59.587315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52e560-b0af-43ad-a223-595ece06f9e4 None admin] RBAC: Authorizing `identity:get_user(user_id=e524aa79ee4a4cec95734314eb804eae)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:59.589325 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52e560-b0af-43ad-a223-595ece06f9e4 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:59.595285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 89/185] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:59 2022] GET /identity/v3/users/e524aa79ee4a4cec95734314eb804eae => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:59.595285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52e560-b0af-43ad-a223-595ece06f9e4 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:59.610281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:59.638291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 97/186] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:20:59.644340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b56cc-eb85-4ec5-9829-20eac5791b9e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:59.707086 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:59.710367 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52e560-b0af-43ad-a223-595ece06f9e4 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:59.746420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cb415-09a8-40c7-86c7-bf6ffbbd8893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:59.747347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cb415-09a8-40c7-86c7-bf6ffbbd8893 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:59.747606 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cb415-09a8-40c7-86c7-bf6ffbbd8893 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:59.748301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cb415-09a8-40c7-86c7-bf6ffbbd8893 None admin] PATH_INFO: `/v3/users/266725f7a9d145dca74471699b4bcd02` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:59.762925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cb415-09a8-40c7-86c7-bf6ffbbd8893 None admin] RBAC: Authorizing `identity:get_user(user_id=266725f7a9d145dca74471699b4bcd02)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:59.764491 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cb415-09a8-40c7-86c7-bf6ffbbd8893 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:59.765226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b56cc-eb85-4ec5-9829-20eac5791b9e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:59.766335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 90/187] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:20:59 2022] GET /identity/v3/users/266725f7a9d145dca74471699b4bcd02 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:59.766933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cb415-09a8-40c7-86c7-bf6ffbbd8893 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:59.804486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdec18-d4db-476a-bfd2-e939cd1a2519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:59.805072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdec18-d4db-476a-bfd2-e939cd1a2519 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:59.805355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdec18-d4db-476a-bfd2-e939cd1a2519 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:59.806167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdec18-d4db-476a-bfd2-e939cd1a2519 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:59.806916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdec18-d4db-476a-bfd2-e939cd1a2519 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:20:59.807223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdec18-d4db-476a-bfd2-e939cd1a2519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:59.808655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdec18-d4db-476a-bfd2-e939cd1a2519 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:59.816909 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 98/188] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:20:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:59.822609 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdec18-d4db-476a-bfd2-e939cd1a2519 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:59.839983 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:59.872314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cb415-09a8-40c7-86c7-bf6ffbbd8893 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:59.907685 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78733aee-cf92-4c9f-a009-b9857604ffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:59.908335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78733aee-cf92-4c9f-a009-b9857604ffe9 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:59.908617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78733aee-cf92-4c9f-a009-b9857604ffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:59.908887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78733aee-cf92-4c9f-a009-b9857604ffe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:59.923367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdec18-d4db-476a-bfd2-e939cd1a2519 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:20:59.936595 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:20:59.959209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9845767-0526-43d4-b6e9-812b0c05cd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:20:59.960029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9845767-0526-43d4-b6e9-812b0c05cd58 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:20:59.960309 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9845767-0526-43d4-b6e9-812b0c05cd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:20:59.960582 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9845767-0526-43d4-b6e9-812b0c05cd58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:20:59.961803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9845767-0526-43d4-b6e9-812b0c05cd58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:59.963258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9845767-0526-43d4-b6e9-812b0c05cd58 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:20:59.969411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 99/189] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:20:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:20:59.969411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9845767-0526-43d4-b6e9-812b0c05cd58 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:20:59.984240 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78733aee-cf92-4c9f-a009-b9857604ffe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:20:59.985703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78733aee-cf92-4c9f-a009-b9857604ffe9 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:00.068948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:00.075898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9845767-0526-43d4-b6e9-812b0c05cd58 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:00.102237 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 91/190] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:20:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:00.104490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78733aee-cf92-4c9f-a009-b9857604ffe9 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:00.109394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3fe0a-3754-4c9f-b538-bda4053378de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:00.110036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3fe0a-3754-4c9f-b538-bda4053378de None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:00.110312 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3fe0a-3754-4c9f-b538-bda4053378de None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:00.110582 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3fe0a-3754-4c9f-b538-bda4053378de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:00.160322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:00.181615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3fe0a-3754-4c9f-b538-bda4053378de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:00.183071 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3fe0a-3754-4c9f-b538-bda4053378de None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:00.200099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78733aee-cf92-4c9f-a009-b9857604ffe9 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:00.232604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef47b6-eb45-403d-a760-00d6275bd1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:00.233460 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef47b6-eb45-403d-a760-00d6275bd1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:00.233737 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef47b6-eb45-403d-a760-00d6275bd1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:00.234008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef47b6-eb45-403d-a760-00d6275bd1a0 None admin] PATH_INFO: `/v3/users/266725f7a9d145dca74471699b4bcd02` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:00.235183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef47b6-eb45-403d-a760-00d6275bd1a0 None admin] RBAC: Authorizing `identity:get_user(user_id=266725f7a9d145dca74471699b4bcd02)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:00.236644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef47b6-eb45-403d-a760-00d6275bd1a0 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:00.238253 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 92/191] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:00 2022] GET /identity/v3/users/266725f7a9d145dca74471699b4bcd02 => generated 283 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:00.238983 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef47b6-eb45-403d-a760-00d6275bd1a0 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:00.279340 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:00.285412 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 100/192] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:20:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:00.291805 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5397e2-8783-4636-a38b-9c17359ed57e None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:00.292100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5397e2-8783-4636-a38b-9c17359ed57e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:00.292383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5397e2-8783-4636-a38b-9c17359ed57e None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:00.293671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 101/193] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:00.294370 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5397e2-8783-4636-a38b-9c17359ed57e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:00.338558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef47b6-eb45-403d-a760-00d6275bd1a0 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:00.379596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:00.379873 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a4521-0fd0-41b9-8815-f178da79cb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:00.380620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a4521-0fd0-41b9-8815-f178da79cb31 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:00.380923 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a4521-0fd0-41b9-8815-f178da79cb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:00.381324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a4521-0fd0-41b9-8815-f178da79cb31 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:00.382263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a4521-0fd0-41b9-8815-f178da79cb31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:00.383650 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a4521-0fd0-41b9-8815-f178da79cb31 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:00.400478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5397e2-8783-4636-a38b-9c17359ed57e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:00.402824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 93/194] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:21:00 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:21:00.403688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a4521-0fd0-41b9-8815-f178da79cb31 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:00.446795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6307c-f0b9-478b-9b03-c8455f3699f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:00.448801 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6307c-f0b9-478b-9b03-c8455f3699f7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:00.449568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6307c-f0b9-478b-9b03-c8455f3699f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:00.450067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6307c-f0b9-478b-9b03-c8455f3699f7 None admin] PATH_INFO: `/v3/projects/a705345d665f4632afccb5c440460242` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:00.452658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6307c-f0b9-478b-9b03-c8455f3699f7 None admin] RBAC: Authorizing `identity:get_project(project_id=a705345d665f4632afccb5c440460242)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:00.455054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6307c-f0b9-478b-9b03-c8455f3699f7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:00.457179 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 102/195] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:00 2022] GET /identity/v3/projects/a705345d665f4632afccb5c440460242 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:00.458392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6307c-f0b9-478b-9b03-c8455f3699f7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:00.530581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:00.537492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a4521-0fd0-41b9-8815-f178da79cb31 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:00.575784 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec44db-e68f-4ecb-90e2-e8147a874fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:00.576433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec44db-e68f-4ecb-90e2-e8147a874fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:00.576715 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec44db-e68f-4ecb-90e2-e8147a874fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:00.576990 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec44db-e68f-4ecb-90e2-e8147a874fc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:00.579790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6307c-f0b9-478b-9b03-c8455f3699f7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:00.619458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3019fa-df74-466a-82a6-7bae2bda1322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:00.620324 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3019fa-df74-466a-82a6-7bae2bda1322 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:00.623453 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3019fa-df74-466a-82a6-7bae2bda1322 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:00.623453 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3019fa-df74-466a-82a6-7bae2bda1322 None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:00.623453 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3019fa-df74-466a-82a6-7bae2bda1322 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:00.623732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3019fa-df74-466a-82a6-7bae2bda1322 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:00.625526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 103/196] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:00 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:00.631482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0d288-fa92-497a-9974-b2f7fb7adcb6 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:00.631845 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0d288-fa92-497a-9974-b2f7fb7adcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:00.632132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0d288-fa92-497a-9974-b2f7fb7adcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:00.649458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9ec0d288-fa92-497a-9974-b2f7fb7adcb6 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:00.650644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9ec0d288-fa92-497a-9974-b2f7fb7adcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:00.661593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec44db-e68f-4ecb-90e2-e8147a874fc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:00.663508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec44db-e68f-4ecb-90e2-e8147a874fc0 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:00.665702 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:00.747620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 104/197] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:00.747620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0d288-fa92-497a-9974-b2f7fb7adcb6 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:00.782334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:00.791404 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 94/198] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:00.792224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec44db-e68f-4ecb-90e2-e8147a874fc0 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:00.864145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0d288-fa92-497a-9974-b2f7fb7adcb6 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:00.910832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec44db-e68f-4ecb-90e2-e8147a874fc0 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:00.917545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7dff8-c649-49a1-ac08-9590fe838dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:00.918480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7dff8-c649-49a1-ac08-9590fe838dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:00.918974 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7dff8-c649-49a1-ac08-9590fe838dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:00.920006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7dff8-c649-49a1-ac08-9590fe838dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:00.921075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7dff8-c649-49a1-ac08-9590fe838dc7 None admin] RBAC: Adding query filter params (role.id=484f610225884740911a5c3333f22221, scope.project.id=a705345d665f4632afccb5c440460242, user.id=e524aa79ee4a4cec95734314eb804eae) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:00.922053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7dff8-c649-49a1-ac08-9590fe838dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:00.924423 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7dff8-c649-49a1-ac08-9590fe838dc7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:00.934394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 105/199] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:00 2022] GET /identity/v3/role_assignments?user.id=e524aa79ee4a4cec95734314eb804eae&scope.project.id=a705345d665f4632afccb5c440460242&role.id=484f610225884740911a5c3333f22221 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:00.935883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7dff8-c649-49a1-ac08-9590fe838dc7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:00.950529 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48689fcb-20ee-4d91-83b4-6f5624246260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:00.951189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48689fcb-20ee-4d91-83b4-6f5624246260 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:00.951583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48689fcb-20ee-4d91-83b4-6f5624246260 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:00.951756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48689fcb-20ee-4d91-83b4-6f5624246260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:00.952602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48689fcb-20ee-4d91-83b4-6f5624246260 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb, user.id=266725f7a9d145dca74471699b4bcd02) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:00.952910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48689fcb-20ee-4d91-83b4-6f5624246260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:00.954347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48689fcb-20ee-4d91-83b4-6f5624246260 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:00.955040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:00.961698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 95/200] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:00 2022] GET /identity/v3/role_assignments?user.id=266725f7a9d145dca74471699b4bcd02&scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb&role.id=e1a2021d08e14daa969362b3d23face3 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:00.962826 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48689fcb-20ee-4d91-83b4-6f5624246260 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:01.075407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7dff8-c649-49a1-ac08-9590fe838dc7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:01.120759 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732737a-cc4a-499d-83ef-4c8e970128bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:01.121962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732737a-cc4a-499d-83ef-4c8e970128bf None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:01.123214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732737a-cc4a-499d-83ef-4c8e970128bf None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:01.123764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732737a-cc4a-499d-83ef-4c8e970128bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:01.137631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732737a-cc4a-499d-83ef-4c8e970128bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:01.143767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-0732737a-cc4a-499d-83ef-4c8e970128bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:01.148855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:01.150275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:01.151152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:01.151152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:01.151152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:01.151152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:01.151152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:01.151152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:01.151152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:01.151152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:01.151152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:01.151152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:01.151152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:21:01.151152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:01.153896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 106/201] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:01.159963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732737a-cc4a-499d-83ef-4c8e970128bf None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:01.261538 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48689fcb-20ee-4d91-83b4-6f5624246260 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:01.296884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:01.316429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c93bc3-0af2-447b-9edb-cf37f487417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:01.317283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93bc3-0af2-447b-9edb-cf37f487417e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:01.317567 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93bc3-0af2-447b-9edb-cf37f487417e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:01.317840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93bc3-0af2-447b-9edb-cf37f487417e None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:01.319037 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c93bc3-0af2-447b-9edb-cf37f487417e None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:01.320678 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c93bc3-0af2-447b-9edb-cf37f487417e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:01.322527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 96/202] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:00 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:01.328249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c93bc3-0af2-447b-9edb-cf37f487417e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:01.339017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732737a-cc4a-499d-83ef-4c8e970128bf None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:01.377966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312fe5-8ef1-43b4-a797-038dc82d9229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:01.379053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312fe5-8ef1-43b4-a797-038dc82d9229 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:01.379579 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312fe5-8ef1-43b4-a797-038dc82d9229 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:01.380055 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312fe5-8ef1-43b4-a797-038dc82d9229 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:01.381033 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5312fe5-8ef1-43b4-a797-038dc82d9229 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:01.381539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5312fe5-8ef1-43b4-a797-038dc82d9229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:01.383655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5312fe5-8ef1-43b4-a797-038dc82d9229 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:01.393416 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 107/203] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:01.398898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312fe5-8ef1-43b4-a797-038dc82d9229 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:01.472419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c93bc3-0af2-447b-9edb-cf37f487417e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:01.523609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:01.542500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8e520-194d-4d25-8232-efc1b714e38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:01.543164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e520-194d-4d25-8232-efc1b714e38d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:01.543445 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e520-194d-4d25-8232-efc1b714e38d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:01.543742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e520-194d-4d25-8232-efc1b714e38d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:01.544668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8e520-194d-4d25-8232-efc1b714e38d None admin] RBAC: Adding query filter params (role.id=9c6db94ddc204b7e860aa2a9d622e14b, scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb, user.id=266725f7a9d145dca74471699b4bcd02) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:01.544979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8e520-194d-4d25-8232-efc1b714e38d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:01.546439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8e520-194d-4d25-8232-efc1b714e38d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:01.556364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 97/204] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:01 2022] GET /identity/v3/role_assignments?user.id=266725f7a9d145dca74471699b4bcd02&scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb&role.id=9c6db94ddc204b7e860aa2a9d622e14b => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:01.580279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312fe5-8ef1-43b4-a797-038dc82d9229 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:01.615402 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:01.622346 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19b755-0c40-4922-a446-51ef5aab7975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:01.623306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b755-0c40-4922-a446-51ef5aab7975 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:01.623634 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b755-0c40-4922-a446-51ef5aab7975 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:01.624174 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b755-0c40-4922-a446-51ef5aab7975 None admin] PATH_INFO: `/v3/users/2c09d5dccf8b45979f5cc050b2d12a28` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:01.625522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19b755-0c40-4922-a446-51ef5aab7975 None admin] RBAC: Authorizing `identity:get_user(user_id=2c09d5dccf8b45979f5cc050b2d12a28)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:01.627059 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19b755-0c40-4922-a446-51ef5aab7975 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:01.629188 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 108/205] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:01 2022] GET /identity/v3/users/2c09d5dccf8b45979f5cc050b2d12a28 => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:01.636657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8e520-194d-4d25-8232-efc1b714e38d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:01.774689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8e520-194d-4d25-8232-efc1b714e38d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:01.809458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d378c-aa1d-484b-8cb7-d81a44e0446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:01.810166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d378c-aa1d-484b-8cb7-d81a44e0446c None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:01.810447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d378c-aa1d-484b-8cb7-d81a44e0446c None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:01.810724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d378c-aa1d-484b-8cb7-d81a44e0446c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:01.872832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:01.886940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d378c-aa1d-484b-8cb7-d81a44e0446c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:01.888576 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d378c-aa1d-484b-8cb7-d81a44e0446c None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:02.003496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 98/206] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:02.009209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19b755-0c40-4922-a446-51ef5aab7975 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:02.137592 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19b755-0c40-4922-a446-51ef5aab7975 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:02.171975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64211b-3b15-4551-8e6a-23b296dee46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:02.172833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64211b-3b15-4551-8e6a-23b296dee46b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:02.173114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64211b-3b15-4551-8e6a-23b296dee46b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:02.173392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64211b-3b15-4551-8e6a-23b296dee46b None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:02.174672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64211b-3b15-4551-8e6a-23b296dee46b None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:02.176228 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64211b-3b15-4551-8e6a-23b296dee46b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:02.178116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 109/207] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:02 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:02.184032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d378c-aa1d-484b-8cb7-d81a44e0446c None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:02.286080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:02.295397 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d378c-aa1d-484b-8cb7-d81a44e0446c None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:02.330709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe11d6-1ad6-4ac5-8ff0-ac37006abce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:02.331392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe11d6-1ad6-4ac5-8ff0-ac37006abce2 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:02.331718 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe11d6-1ad6-4ac5-8ff0-ac37006abce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:02.331975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe11d6-1ad6-4ac5-8ff0-ac37006abce2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:02.332808 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe11d6-1ad6-4ac5-8ff0-ac37006abce2 None admin] RBAC: Adding query filter params (role.id=12bc45a7126d4529b9a76b4e74a28d44, scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76, user.id=2c09d5dccf8b45979f5cc050b2d12a28) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:02.333120 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe11d6-1ad6-4ac5-8ff0-ac37006abce2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:02.334581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe11d6-1ad6-4ac5-8ff0-ac37006abce2 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:02.341428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 99/208] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:02 2022] GET /identity/v3/role_assignments?user.id=2c09d5dccf8b45979f5cc050b2d12a28&scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76&role.id=12bc45a7126d4529b9a76b4e74a28d44 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:02.949081 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0070ee-9a83-4043-9099-6750b1f6c4d3 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:02.949449 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0070ee-9a83-4043-9099-6750b1f6c4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:02.949552 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0070ee-9a83-4043-9099-6750b1f6c4d3 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:02.951261 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 110/209] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:02.956168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588b39-53b2-4bd4-a0e8-5da8745b1bd7 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:02.956461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588b39-53b2-4bd4-a0e8-5da8745b1bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:02.956740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588b39-53b2-4bd4-a0e8-5da8745b1bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:02.974809 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8c588b39-53b2-4bd4-a0e8-5da8745b1bd7 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:02.976016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8c588b39-53b2-4bd4-a0e8-5da8745b1bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:03.061950 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 100/210] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:03.084150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0070ee-9a83-4043-9099-6750b1f6c4d3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:03.152847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:03.199223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0070ee-9a83-4043-9099-6750b1f6c4d3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:03.234181 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853932d6-468a-4adf-9e4f-9cfe735a801f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:03.234982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853932d6-468a-4adf-9e4f-9cfe735a801f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:03.235265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853932d6-468a-4adf-9e4f-9cfe735a801f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:03.235577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853932d6-468a-4adf-9e4f-9cfe735a801f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:03.239998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c0904-bea6-4dfb-868d-04b4fc85323a None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:03.240513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c0904-bea6-4dfb-868d-04b4fc85323a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:03.241249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c0904-bea6-4dfb-868d-04b4fc85323a None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:03.243049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 101/211] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:03.247242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853932d6-468a-4adf-9e4f-9cfe735a801f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:03.248949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281fbee-10fe-4b4d-8c58-a744c3fd3a8e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:03.249438 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281fbee-10fe-4b4d-8c58-a744c3fd3a8e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:03.249907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281fbee-10fe-4b4d-8c58-a744c3fd3a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-853932d6-468a-4adf-9e4f-9cfe735a801f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:03.255725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:03.256677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:03.258064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:03.258064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:03.258064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:03.258064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:03.258064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:03.258064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:03.258064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:03.258064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:03.258064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:03.258064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:03.258064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:03.258064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:03.258064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 111/212] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:03.262434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853932d6-468a-4adf-9e4f-9cfe735a801f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:03.271107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-c281fbee-10fe-4b4d-8c58-a744c3fd3a8e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:03.272580 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c281fbee-10fe-4b4d-8c58-a744c3fd3a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:03.339838 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 102/213] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:03.364595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281fbee-10fe-4b4d-8c58-a744c3fd3a8e None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:03.383996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853932d6-468a-4adf-9e4f-9cfe735a801f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:03.384826 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:03.422941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:03.433145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a166d03-e2c2-49cd-82da-f5c7d5f120ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:03.434179 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a166d03-e2c2-49cd-82da-f5c7d5f120ff None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:03.434541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a166d03-e2c2-49cd-82da-f5c7d5f120ff None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:03.434893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a166d03-e2c2-49cd-82da-f5c7d5f120ff None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:03.435929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a166d03-e2c2-49cd-82da-f5c7d5f120ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:03.436338 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a166d03-e2c2-49cd-82da-f5c7d5f120ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:03.438416 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a166d03-e2c2-49cd-82da-f5c7d5f120ff None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:03.453483 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 112/214] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:03.455610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a166d03-e2c2-49cd-82da-f5c7d5f120ff None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:03.490163 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281fbee-10fe-4b4d-8c58-a744c3fd3a8e None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:03.526979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de6c07-e7e2-465e-bf5c-2dfba454fbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:03.528161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de6c07-e7e2-465e-bf5c-2dfba454fbbc None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:03.528645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de6c07-e7e2-465e-bf5c-2dfba454fbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:03.529110 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de6c07-e7e2-465e-bf5c-2dfba454fbbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:03.530600 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de6c07-e7e2-465e-bf5c-2dfba454fbbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:03.532331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de6c07-e7e2-465e-bf5c-2dfba454fbbc None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:03.534646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 103/215] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:03.541371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de6c07-e7e2-465e-bf5c-2dfba454fbbc None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:03.571222 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a166d03-e2c2-49cd-82da-f5c7d5f120ff None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:03.607402 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4bdd2-6bff-40f9-9c31-72d22f0d7a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:03.608311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4bdd2-6bff-40f9-9c31-72d22f0d7a1c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:03.608616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4bdd2-6bff-40f9-9c31-72d22f0d7a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:03.608977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4bdd2-6bff-40f9-9c31-72d22f0d7a1c None admin] PATH_INFO: `/v3/users/914cf387b2e442d9885af05221cf8894` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:03.627751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4bdd2-6bff-40f9-9c31-72d22f0d7a1c None admin] RBAC: Authorizing `identity:get_user(user_id=914cf387b2e442d9885af05221cf8894)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:03.629205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4bdd2-6bff-40f9-9c31-72d22f0d7a1c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:03.630925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 113/216] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:03 2022] GET /identity/v3/users/914cf387b2e442d9885af05221cf8894 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:03.636411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4bdd2-6bff-40f9-9c31-72d22f0d7a1c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:03.647778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:03.676453 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de6c07-e7e2-465e-bf5c-2dfba454fbbc None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:03.700857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:03.733602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eee60-a0e3-4f42-b7d9-27cf5e0b93da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:03.734358 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eee60-a0e3-4f42-b7d9-27cf5e0b93da None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:03.734746 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eee60-a0e3-4f42-b7d9-27cf5e0b93da None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:03.737027 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eee60-a0e3-4f42-b7d9-27cf5e0b93da None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:03.738437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eee60-a0e3-4f42-b7d9-27cf5e0b93da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:03.740572 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eee60-a0e3-4f42-b7d9-27cf5e0b93da None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:03.775559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 104/217] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:21:03 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:21:03.783348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4bdd2-6bff-40f9-9c31-72d22f0d7a1c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:03.814265 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf49c93-9c73-4d2a-bd88-dabb1560a7c3 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:03.814774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf49c93-9c73-4d2a-bd88-dabb1560a7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:03.815260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf49c93-9c73-4d2a-bd88-dabb1560a7c3 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:03.817303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 105/218] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:03.825691 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bd205-3ffd-4581-ab75-1a8924ba71a7 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:03.825972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bd205-3ffd-4581-ab75-1a8924ba71a7 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:03.826311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bd205-3ffd-4581-ab75-1a8924ba71a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:03.831061 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21467f6b-dcd9-4267-b878-dee6eec00888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:03.832048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21467f6b-dcd9-4267-b878-dee6eec00888 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:03.832527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21467f6b-dcd9-4267-b878-dee6eec00888 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:03.832953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21467f6b-dcd9-4267-b878-dee6eec00888 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:03.848824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-6d4bd205-3ffd-4581-ab75-1a8924ba71a7 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:03.850388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6d4bd205-3ffd-4581-ab75-1a8924ba71a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:03.932342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21467f6b-dcd9-4267-b878-dee6eec00888 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:03.932342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21467f6b-dcd9-4267-b878-dee6eec00888 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:03.933077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 106/219] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:03.952320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bd205-3ffd-4581-ab75-1a8924ba71a7 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:03.990925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:04.055820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:04.082873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 114/220] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:04.082873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21467f6b-dcd9-4267-b878-dee6eec00888 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:04.099416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bd205-3ffd-4581-ab75-1a8924ba71a7 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:04.151839 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86357ec4-8b8f-4993-95a4-1ad1b1af8537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:04.152764 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357ec4-8b8f-4993-95a4-1ad1b1af8537 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:04.153052 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357ec4-8b8f-4993-95a4-1ad1b1af8537 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:04.153327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357ec4-8b8f-4993-95a4-1ad1b1af8537 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:04.164814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86357ec4-8b8f-4993-95a4-1ad1b1af8537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-86357ec4-8b8f-4993-95a4-1ad1b1af8537 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:04.172635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:04.173574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:04.174400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:04.174400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:04.174400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:04.174400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:04.174400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:04.174400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:04.174400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:04.174400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:04.174400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:04.174400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:04.174400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:21:04.174400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:04.174400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 107/221] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:21:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:04.175092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f3c9e-3242-49a9-95ba-24e140c188f7 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:04.175680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f3c9e-3242-49a9-95ba-24e140c188f7 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:04.178751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f3c9e-3242-49a9-95ba-24e140c188f7 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:04.180116 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 108/222] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:04.184488 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f3c9e-3242-49a9-95ba-24e140c188f7 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:04.202094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21467f6b-dcd9-4267-b878-dee6eec00888 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:04.238923 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c031330-0a96-43f9-b9e9-6aedd2241d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:04.239812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c031330-0a96-43f9-b9e9-6aedd2241d9a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:04.240090 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c031330-0a96-43f9-b9e9-6aedd2241d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:04.240361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c031330-0a96-43f9-b9e9-6aedd2241d9a None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:04.241969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c031330-0a96-43f9-b9e9-6aedd2241d9a None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:04.244387 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c031330-0a96-43f9-b9e9-6aedd2241d9a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:04.246386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 115/223] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:04 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:04.247588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8785b1-77c7-4a13-a4b0-5d2bd5ffa025 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:04.247874 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8785b1-77c7-4a13-a4b0-5d2bd5ffa025 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:04.248146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8785b1-77c7-4a13-a4b0-5d2bd5ffa025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:04.268547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-af8785b1-77c7-4a13-a4b0-5d2bd5ffa025 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:04.269745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-af8785b1-77c7-4a13-a4b0-5d2bd5ffa025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:04.281259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:04.326683 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f3c9e-3242-49a9-95ba-24e140c188f7 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:04.348205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 116/224] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:04.348205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8785b1-77c7-4a13-a4b0-5d2bd5ffa025 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:04.363351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:04.377508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e0ebc-2162-49b0-a39f-ffa1b6f616f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:04.378198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e0ebc-2162-49b0-a39f-ffa1b6f616f1 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:04.378536 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e0ebc-2162-49b0-a39f-ffa1b6f616f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:04.378811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e0ebc-2162-49b0-a39f-ffa1b6f616f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:04.379700 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e0ebc-2162-49b0-a39f-ffa1b6f616f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:04.380010 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e0ebc-2162-49b0-a39f-ffa1b6f616f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:04.381898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e0ebc-2162-49b0-a39f-ffa1b6f616f1 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:04.396259 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 109/225] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:04.397114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e0ebc-2162-49b0-a39f-ffa1b6f616f1 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:04.502982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8785b1-77c7-4a13-a4b0-5d2bd5ffa025 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:04.517164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e0ebc-2162-49b0-a39f-ffa1b6f616f1 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:04.551411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def46e0-b97c-4192-be48-505910a9f84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:04.552041 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def46e0-b97c-4192-be48-505910a9f84f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:04.552410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def46e0-b97c-4192-be48-505910a9f84f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:04.552797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def46e0-b97c-4192-be48-505910a9f84f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:04.553641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def46e0-b97c-4192-be48-505910a9f84f None admin] RBAC: Adding query filter params (role.id=484f610225884740911a5c3333f22221, scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb, user.id=914cf387b2e442d9885af05221cf8894) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:04.553853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a1a7e-a348-4e50-87dd-92084753dc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:04.554036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def46e0-b97c-4192-be48-505910a9f84f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:04.554631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a1a7e-a348-4e50-87dd-92084753dc84 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:04.554917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a1a7e-a348-4e50-87dd-92084753dc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:04.555196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a1a7e-a348-4e50-87dd-92084753dc84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:04.555356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def46e0-b97c-4192-be48-505910a9f84f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:04.566729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 117/226] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:04 2022] GET /identity/v3/role_assignments?user.id=914cf387b2e442d9885af05221cf8894&scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb&role.id=484f610225884740911a5c3333f22221 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:04.567758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def46e0-b97c-4192-be48-505910a9f84f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:04.583603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a1a7e-a348-4e50-87dd-92084753dc84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-bc9a1a7e-a348-4e50-87dd-92084753dc84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:04.595900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:04.598085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:04.600184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:04.600184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:04.600184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:04.600184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:04.600184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:04.600184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:04.600184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:04.600184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:04.600184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:04.600184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:04.600184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:04.600184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:04.604552 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:04.604786 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 110/227] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:21:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:04.607866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a1a7e-a348-4e50-87dd-92084753dc84 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:04.713726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:04.767759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a1a7e-a348-4e50-87dd-92084753dc84 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:04.795378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def46e0-b97c-4192-be48-505910a9f84f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:04.805352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7cd4-0c3a-4cfd-996e-ebde09fe2adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:04.806068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7cd4-0c3a-4cfd-996e-ebde09fe2adf None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:04.806354 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7cd4-0c3a-4cfd-996e-ebde09fe2adf None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:04.806637 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d7cd4-0c3a-4cfd-996e-ebde09fe2adf None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:04.807557 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d7cd4-0c3a-4cfd-996e-ebde09fe2adf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:04.807919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d7cd4-0c3a-4cfd-996e-ebde09fe2adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:04.809324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d7cd4-0c3a-4cfd-996e-ebde09fe2adf None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:04.818499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 111/228] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:04.824974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7cd4-0c3a-4cfd-996e-ebde09fe2adf None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:04.836027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371617c7-52cd-4f88-96ef-49a5202463a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:04.837460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371617c7-52cd-4f88-96ef-49a5202463a5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:04.837741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371617c7-52cd-4f88-96ef-49a5202463a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:04.838044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371617c7-52cd-4f88-96ef-49a5202463a5 None admin] PATH_INFO: `/v3/users/266725f7a9d145dca74471699b4bcd02` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:04.839330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371617c7-52cd-4f88-96ef-49a5202463a5 None admin] RBAC: Authorizing `identity:get_user(user_id=266725f7a9d145dca74471699b4bcd02)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:04.840939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371617c7-52cd-4f88-96ef-49a5202463a5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:04.842968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 118/229] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:04 2022] GET /identity/v3/users/266725f7a9d145dca74471699b4bcd02 => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:04.848354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371617c7-52cd-4f88-96ef-49a5202463a5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:04.935728 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d7cd4-0c3a-4cfd-996e-ebde09fe2adf None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:04.950951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:04.972093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423cc8a-9df2-4801-8b9b-8efd424b3eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:04.973161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423cc8a-9df2-4801-8b9b-8efd424b3eff None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:04.973452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423cc8a-9df2-4801-8b9b-8efd424b3eff None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:04.973733 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423cc8a-9df2-4801-8b9b-8efd424b3eff None admin] PATH_INFO: `/v3/users/266725f7a9d145dca74471699b4bcd02` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:04.974945 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423cc8a-9df2-4801-8b9b-8efd424b3eff None admin] RBAC: Authorizing `identity:get_user(user_id=266725f7a9d145dca74471699b4bcd02)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:04.976448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423cc8a-9df2-4801-8b9b-8efd424b3eff None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:04.978502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 112/230] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:04 2022] GET /identity/v3/users/266725f7a9d145dca74471699b4bcd02 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:04.983823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423cc8a-9df2-4801-8b9b-8efd424b3eff None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:04.988904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:05.019439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371617c7-52cd-4f88-96ef-49a5202463a5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:05.054848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f075a3e-9ad3-4546-b05b-0eb6aab053c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:05.056281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f075a3e-9ad3-4546-b05b-0eb6aab053c5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:05.056569 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f075a3e-9ad3-4546-b05b-0eb6aab053c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:05.056848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f075a3e-9ad3-4546-b05b-0eb6aab053c5 None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:05.058247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f075a3e-9ad3-4546-b05b-0eb6aab053c5 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:05.059965 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f075a3e-9ad3-4546-b05b-0eb6aab053c5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:05.061676 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 119/231] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:04 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:05.067257 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f075a3e-9ad3-4546-b05b-0eb6aab053c5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:05.089587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423cc8a-9df2-4801-8b9b-8efd424b3eff None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:05.124776 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae8d38-9fe0-4856-9dd8-785e9598abec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:05.125646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae8d38-9fe0-4856-9dd8-785e9598abec None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:05.125934 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae8d38-9fe0-4856-9dd8-785e9598abec None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:05.126215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae8d38-9fe0-4856-9dd8-785e9598abec None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:05.127417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae8d38-9fe0-4856-9dd8-785e9598abec None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:05.128934 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae8d38-9fe0-4856-9dd8-785e9598abec None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:05.130872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 113/232] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:04 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:05.136866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae8d38-9fe0-4856-9dd8-785e9598abec None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:05.189611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:05.208482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f075a3e-9ad3-4546-b05b-0eb6aab053c5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:05.245208 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae8d38-9fe0-4856-9dd8-785e9598abec None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:05.280399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ab2f5-e153-4189-b0cf-7b18dec6aba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:05.281472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ab2f5-e153-4189-b0cf-7b18dec6aba6 None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:05.281762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ab2f5-e153-4189-b0cf-7b18dec6aba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:05.282043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ab2f5-e153-4189-b0cf-7b18dec6aba6 None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb/users/266725f7a9d145dca74471699b4bcd02/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:05.285543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ab2f5-e153-4189-b0cf-7b18dec6aba6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2e9da0fae424c80aea374ac5ff2cefb, user_id=266725f7a9d145dca74471699b4bcd02, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:05.287020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ab2f5-e153-4189-b0cf-7b18dec6aba6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:05.305686 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d3801-8283-43c8-a493-5e98d2341b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:05.306654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d3801-8283-43c8-a493-5e98d2341b09 None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:05.307077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d3801-8283-43c8-a493-5e98d2341b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:05.307360 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d3801-8283-43c8-a493-5e98d2341b09 None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb/users/266725f7a9d145dca74471699b4bcd02/roles/9c6db94ddc204b7e860aa2a9d622e14b` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:05.311959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d3801-8283-43c8-a493-5e98d2341b09 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2e9da0fae424c80aea374ac5ff2cefb, user_id=266725f7a9d145dca74471699b4bcd02, role_id=9c6db94ddc204b7e860aa2a9d622e14b)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:05.317300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 120/233] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:21:05 2022] PUT /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb/users/266725f7a9d145dca74471699b4bcd02/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:21:05.318832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d3801-8283-43c8-a493-5e98d2341b09 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:05.339218 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 114/234] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:21:05 2022] PUT /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb/users/266725f7a9d145dca74471699b4bcd02/roles/9c6db94ddc204b7e860aa2a9d622e14b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:21:06.393602 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c4617-3838-43f1-98b9-1d46a819aa3e None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:06.394414 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c4617-3838-43f1-98b9-1d46a819aa3e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:06.394414 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c4617-3838-43f1-98b9-1d46a819aa3e None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:06.395540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 121/235] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:06.414554 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ba063-cc99-4e19-bdbd-58b39a652805 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:06.415089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ba063-cc99-4e19-bdbd-58b39a652805 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:06.415168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ba063-cc99-4e19-bdbd-58b39a652805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:06.432573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-c37ba063-cc99-4e19-bdbd-58b39a652805 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:06.433785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c37ba063-cc99-4e19-bdbd-58b39a652805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:06.513967 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 115/236] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:06.549468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c4617-3838-43f1-98b9-1d46a819aa3e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:06.559769 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:06.701686 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c4617-3838-43f1-98b9-1d46a819aa3e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:06.722926 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42ebca-0448-40ba-aa48-28d106797afd None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:06.723214 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42ebca-0448-40ba-aa48-28d106797afd None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:06.723533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42ebca-0448-40ba-aa48-28d106797afd None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:06.725194 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 116/237] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:06.732317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fea49-3eb0-40c8-b034-61850f3194d8 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:06.732607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fea49-3eb0-40c8-b034-61850f3194d8 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:06.732883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fea49-3eb0-40c8-b034-61850f3194d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:06.743676 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fd92d-5cc6-4adc-af2a-8c9badd7e6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:06.744471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fd92d-5cc6-4adc-af2a-8c9badd7e6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:06.744754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fd92d-5cc6-4adc-af2a-8c9badd7e6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:06.745029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fd92d-5cc6-4adc-af2a-8c9badd7e6e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:06.748631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fd92d-5cc6-4adc-af2a-8c9badd7e6e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:06.750095 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fd92d-5cc6-4adc-af2a-8c9badd7e6e3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:06.751771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 122/238] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:06.761629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fd92d-5cc6-4adc-af2a-8c9badd7e6e3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:06.776991 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ea1fea49-3eb0-40c8-b034-61850f3194d8 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:06.778183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ea1fea49-3eb0-40c8-b034-61850f3194d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:06.856199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:06.900336 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:06.926948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 117/239] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:06.948449 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fd92d-5cc6-4adc-af2a-8c9badd7e6e3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:06.949954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fea49-3eb0-40c8-b034-61850f3194d8 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:07.014933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8db08-c9b2-4a15-97e6-06d64f6aa7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:07.016143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8db08-c9b2-4a15-97e6-06d64f6aa7b5 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:07.016630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8db08-c9b2-4a15-97e6-06d64f6aa7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:07.017105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8db08-c9b2-4a15-97e6-06d64f6aa7b5 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:07.018114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8db08-c9b2-4a15-97e6-06d64f6aa7b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:07.019840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8db08-c9b2-4a15-97e6-06d64f6aa7b5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:07.045047 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 123/240] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:21:06 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:21:07.108584 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fea49-3eb0-40c8-b034-61850f3194d8 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:07.157027 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99d1dd-ac8f-424e-812b-1c3c714bec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:07.158288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99d1dd-ac8f-424e-812b-1c3c714bec6a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:07.158854 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99d1dd-ac8f-424e-812b-1c3c714bec6a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:07.159358 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99d1dd-ac8f-424e-812b-1c3c714bec6a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:07.173280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99d1dd-ac8f-424e-812b-1c3c714bec6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-2a99d1dd-ac8f-424e-812b-1c3c714bec6a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:07.181887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:07.182883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:07.184391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:07.184391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:07.184391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:07.184391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:07.184391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:07.184391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:07.184391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:07.184391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:07.184391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:07.184391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:07.184391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:21:07.184391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:07.184391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 118/241] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:07.188945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8db08-c9b2-4a15-97e6-06d64f6aa7b5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:07.304240 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1976f8-7b02-4934-bd97-3582c6815083 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:07.304947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1976f8-7b02-4934-bd97-3582c6815083 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:07.305576 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1976f8-7b02-4934-bd97-3582c6815083 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:07.307957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 119/242] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:07.312715 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6556175-a559-4037-a9d9-ae523befeb83 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:07.313009 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6556175-a559-4037-a9d9-ae523befeb83 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:07.313296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6556175-a559-4037-a9d9-ae523befeb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:07.332130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-f6556175-a559-4037-a9d9-ae523befeb83 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:07.333328 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f6556175-a559-4037-a9d9-ae523befeb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:07.349600 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8db08-c9b2-4a15-97e6-06d64f6aa7b5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:07.366851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:07.382299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:07.391792 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6daf2-b864-44e3-8f7b-9597f2ce9594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:07.392468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6daf2-b864-44e3-8f7b-9597f2ce9594 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:07.392765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6daf2-b864-44e3-8f7b-9597f2ce9594 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:07.393031 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6daf2-b864-44e3-8f7b-9597f2ce9594 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:07.393789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6daf2-b864-44e3-8f7b-9597f2ce9594 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:07.394328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6daf2-b864-44e3-8f7b-9597f2ce9594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:07.395524 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6daf2-b864-44e3-8f7b-9597f2ce9594 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:07.405883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 124/243] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:07.410897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6daf2-b864-44e3-8f7b-9597f2ce9594 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:07.429274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 120/244] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:07.454871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6556175-a559-4037-a9d9-ae523befeb83 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:07.536236 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6daf2-b864-44e3-8f7b-9597f2ce9594 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:07.579853 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae66438-d823-4ac5-bbd3-2a462b8f2a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:07.580724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae66438-d823-4ac5-bbd3-2a462b8f2a4a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:07.581008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae66438-d823-4ac5-bbd3-2a462b8f2a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:07.581335 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae66438-d823-4ac5-bbd3-2a462b8f2a4a None admin] PATH_INFO: `/v3/users/fb09b0adff704a809d740b49143d3bb6` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:07.589425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6556175-a559-4037-a9d9-ae523befeb83 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:07.597749 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae66438-d823-4ac5-bbd3-2a462b8f2a4a None admin] RBAC: Authorizing `identity:get_user(user_id=fb09b0adff704a809d740b49143d3bb6)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:07.599223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae66438-d823-4ac5-bbd3-2a462b8f2a4a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:07.601917 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 125/245] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:07 2022] GET /identity/v3/users/fb09b0adff704a809d740b49143d3bb6 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:07.607660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae66438-d823-4ac5-bbd3-2a462b8f2a4a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:07.632971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26d44c-292e-4956-8124-3ba7054722c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:07.633843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26d44c-292e-4956-8124-3ba7054722c3 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:07.634130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26d44c-292e-4956-8124-3ba7054722c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:07.634409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26d44c-292e-4956-8124-3ba7054722c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:07.650307 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26d44c-292e-4956-8124-3ba7054722c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-9c26d44c-292e-4956-8124-3ba7054722c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:07.659575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:07.660577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:07.662294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:07.662294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:07.662294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:07.662294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:07.662294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:07.662294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:07.662294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:07.662294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:07.662294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:07.662294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:07.662294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:07.662294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:07.662294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 121/246] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:07.668076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26d44c-292e-4956-8124-3ba7054722c3 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:07.683006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:07.699916 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:07.753417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae66438-d823-4ac5-bbd3-2a462b8f2a4a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:07.797380 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd00c5-d0ed-41bf-8412-6245bb5730f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:07.798051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd00c5-d0ed-41bf-8412-6245bb5730f2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:07.798336 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd00c5-d0ed-41bf-8412-6245bb5730f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:07.798608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd00c5-d0ed-41bf-8412-6245bb5730f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:07.816857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26d44c-292e-4956-8124-3ba7054722c3 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:07.862088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48187b0-cdbe-4445-aa2b-50e34df8f787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:07.862907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48187b0-cdbe-4445-aa2b-50e34df8f787 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:07.863196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48187b0-cdbe-4445-aa2b-50e34df8f787 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:07.863489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48187b0-cdbe-4445-aa2b-50e34df8f787 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:07.864543 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48187b0-cdbe-4445-aa2b-50e34df8f787 None admin] RBAC: Adding query filter params (name=member) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:07.864854 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48187b0-cdbe-4445-aa2b-50e34df8f787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:07.867068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48187b0-cdbe-4445-aa2b-50e34df8f787 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:07.880843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 122/247] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:07.882166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337192e-fc3b-46f5-9b8b-9a4e7d40bc8b None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:07.882455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337192e-fc3b-46f5-9b8b-9a4e7d40bc8b None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:07.882728 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337192e-fc3b-46f5-9b8b-9a4e7d40bc8b None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:07.884027 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 123/248] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:07.888344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337192e-fc3b-46f5-9b8b-9a4e7d40bc8b None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:07.898608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd00c5-d0ed-41bf-8412-6245bb5730f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:07.900140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd00c5-d0ed-41bf-8412-6245bb5730f2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:07.963844 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:07.999200 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:08.020077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337192e-fc3b-46f5-9b8b-9a4e7d40bc8b None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:08.031343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 126/249] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:08.033071 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa4612-1c7a-47e5-a074-da72bfafe2e5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:08.033359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa4612-1c7a-47e5-a074-da72bfafe2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:08.034035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa4612-1c7a-47e5-a074-da72bfafe2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:08.056827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4cfa4612-1c7a-47e5-a074-da72bfafe2e5 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:08.058327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4cfa4612-1c7a-47e5-a074-da72bfafe2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:08.064523 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7fd26-bd48-4c49-85b4-55d15a25dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:08.065537 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7fd26-bd48-4c49-85b4-55d15a25dd99 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:08.065924 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7fd26-bd48-4c49-85b4-55d15a25dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:08.066303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7fd26-bd48-4c49-85b4-55d15a25dd99 None admin] PATH_INFO: `/v3/users/914cf387b2e442d9885af05221cf8894` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:08.067660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7fd26-bd48-4c49-85b4-55d15a25dd99 None admin] RBAC: Authorizing `identity:get_user(user_id=914cf387b2e442d9885af05221cf8894)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:08.069240 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7fd26-bd48-4c49-85b4-55d15a25dd99 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:08.071323 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 124/250] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:07 2022] GET /identity/v3/users/914cf387b2e442d9885af05221cf8894 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:08.076333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7fd26-bd48-4c49-85b4-55d15a25dd99 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:08.180442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 127/251] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:08.181323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa4612-1c7a-47e5-a074-da72bfafe2e5 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:08.222645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7fd26-bd48-4c49-85b4-55d15a25dd99 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:08.258112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99faac2-5b5c-467b-a0f8-e482eb00bb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:08.259016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99faac2-5b5c-467b-a0f8-e482eb00bb63 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:08.259300 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99faac2-5b5c-467b-a0f8-e482eb00bb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:08.259621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99faac2-5b5c-467b-a0f8-e482eb00bb63 None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:08.260842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99faac2-5b5c-467b-a0f8-e482eb00bb63 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:08.262304 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99faac2-5b5c-467b-a0f8-e482eb00bb63 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:08.264051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 125/252] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:08 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:08.265252 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef706ca4-026d-4edc-9968-da6d98eadabb None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:08.265541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef706ca4-026d-4edc-9968-da6d98eadabb None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:08.265819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef706ca4-026d-4edc-9968-da6d98eadabb None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:08.267317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 126/253] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:08.268073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef706ca4-026d-4edc-9968-da6d98eadabb None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:08.277144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:08.288634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:08.299159 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa4612-1c7a-47e5-a074-da72bfafe2e5 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:08.336273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2754604-f3c4-4750-86c2-148acdc4362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:08.337759 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2754604-f3c4-4750-86c2-148acdc4362d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:08.338040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2754604-f3c4-4750-86c2-148acdc4362d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:08.338369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2754604-f3c4-4750-86c2-148acdc4362d None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:08.339661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2754604-f3c4-4750-86c2-148acdc4362d None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:08.341218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2754604-f3c4-4750-86c2-148acdc4362d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:08.342936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 128/254] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:08 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:08.343876 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2754604-f3c4-4750-86c2-148acdc4362d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:08.395056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef706ca4-026d-4edc-9968-da6d98eadabb None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:08.452410 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f0c21-dd92-42d7-816c-0bd49a0e7ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:08.453218 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f0c21-dd92-42d7-816c-0bd49a0e7ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:08.453711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f0c21-dd92-42d7-816c-0bd49a0e7ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:08.454182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f0c21-dd92-42d7-816c-0bd49a0e7ef0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:08.465910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f0c21-dd92-42d7-816c-0bd49a0e7ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-f23f0c21-dd92-42d7-816c-0bd49a0e7ef0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:08.474260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:08.475219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:08.476097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:08.476097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:08.476097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:08.476097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:08.476097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:08.476097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:08.476097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:08.476097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:08.476097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:08.476097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:08.476097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:08.476097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:08.478563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 127/255] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:21:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:08.480083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf2f81-a75f-4011-a282-dc5d50fd14a4 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:08.480600 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf2f81-a75f-4011-a282-dc5d50fd14a4 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:08.481077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf2f81-a75f-4011-a282-dc5d50fd14a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:08.486425 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2754604-f3c4-4750-86c2-148acdc4362d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:08.499376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-72cf2f81-a75f-4011-a282-dc5d50fd14a4 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:08.500987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-72cf2f81-a75f-4011-a282-dc5d50fd14a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:08.533755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074db819-285a-4dda-ada9-2f7676f20dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:08.534508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db819-285a-4dda-ada9-2f7676f20dff None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:08.534910 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db819-285a-4dda-ada9-2f7676f20dff None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:08.535196 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074db819-285a-4dda-ada9-2f7676f20dff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:08.536198 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074db819-285a-4dda-ada9-2f7676f20dff None admin] RBAC: Adding query filter params (role.id=12bc45a7126d4529b9a76b4e74a28d44, scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb, user.id=fb09b0adff704a809d740b49143d3bb6) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:08.536577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074db819-285a-4dda-ada9-2f7676f20dff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:08.538280 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074db819-285a-4dda-ada9-2f7676f20dff None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:08.549977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 129/256] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:08 2022] GET /identity/v3/role_assignments?user.id=fb09b0adff704a809d740b49143d3bb6&scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb&role.id=12bc45a7126d4529b9a76b4e74a28d44 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:08.551058 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074db819-285a-4dda-ada9-2f7676f20dff None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:08.570850 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:08.593152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 128/257] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:08.594478 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf2f81-a75f-4011-a282-dc5d50fd14a4 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:08.606203 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:08.708442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074db819-285a-4dda-ada9-2f7676f20dff None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:08.721130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf2f81-a75f-4011-a282-dc5d50fd14a4 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:08.760029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a25ae7-3b74-4fa7-bc0f-ec8ecb69dea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:08.761448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25ae7-3b74-4fa7-bc0f-ec8ecb69dea1 None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:08.761940 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25ae7-3b74-4fa7-bc0f-ec8ecb69dea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:08.762461 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25ae7-3b74-4fa7-bc0f-ec8ecb69dea1 None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb/users/914cf387b2e442d9885af05221cf8894/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:08.762925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5e6df-c617-4fa9-9208-3e4dc5f95764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:08.763802 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5e6df-c617-4fa9-9208-3e4dc5f95764 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:08.764188 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5e6df-c617-4fa9-9208-3e4dc5f95764 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:08.764566 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5e6df-c617-4fa9-9208-3e4dc5f95764 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:08.765375 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a25ae7-3b74-4fa7-bc0f-ec8ecb69dea1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2e9da0fae424c80aea374ac5ff2cefb, user_id=914cf387b2e442d9885af05221cf8894, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:08.765553 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5e6df-c617-4fa9-9208-3e4dc5f95764 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:08.765961 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5e6df-c617-4fa9-9208-3e4dc5f95764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:08.767319 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a25ae7-3b74-4fa7-bc0f-ec8ecb69dea1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:08.767544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5e6df-c617-4fa9-9208-3e4dc5f95764 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:08.779852 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 129/258] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:08.781066 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5e6df-c617-4fa9-9208-3e4dc5f95764 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:08.793633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 130/259] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:21:08 2022] PUT /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb/users/914cf387b2e442d9885af05221cf8894/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:21:08.796472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a25ae7-3b74-4fa7-bc0f-ec8ecb69dea1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:08.907602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:08.927903 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:08.962758 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5e6df-c617-4fa9-9208-3e4dc5f95764 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:09.010061 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a25ae7-3b74-4fa7-bc0f-ec8ecb69dea1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:09.024727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca66af9-aa96-4742-a9cd-11c4c2cba049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:09.025538 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca66af9-aa96-4742-a9cd-11c4c2cba049 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:09.025825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca66af9-aa96-4742-a9cd-11c4c2cba049 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:09.026104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca66af9-aa96-4742-a9cd-11c4c2cba049 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:09.060925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca66af9-aa96-4742-a9cd-11c4c2cba049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-3ca66af9-aa96-4742-a9cd-11c4c2cba049 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:09.068425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:09.069439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:09.070996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:09.070996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:09.070996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:09.070996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:09.070996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:09.070996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:09.070996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:09.070996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:09.070996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:09.070996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:09.070996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:21:09.070996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:09.070996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 130/260] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:21:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:09.076699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca66af9-aa96-4742-a9cd-11c4c2cba049 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:09.125883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf60021-4d31-4b07-963c-7b0f8a49e370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:09.126775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf60021-4d31-4b07-963c-7b0f8a49e370 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:09.127060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf60021-4d31-4b07-963c-7b0f8a49e370 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:09.127341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf60021-4d31-4b07-963c-7b0f8a49e370 None admin] PATH_INFO: `/v3/users/266725f7a9d145dca74471699b4bcd02` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:09.132345 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf60021-4d31-4b07-963c-7b0f8a49e370 None admin] RBAC: Authorizing `identity:get_user(user_id=266725f7a9d145dca74471699b4bcd02)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:09.133899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf60021-4d31-4b07-963c-7b0f8a49e370 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:09.135672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 131/261] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:08 2022] GET /identity/v3/users/266725f7a9d145dca74471699b4bcd02 => generated 283 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:09.146516 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf60021-4d31-4b07-963c-7b0f8a49e370 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:09.301214 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca66af9-aa96-4742-a9cd-11c4c2cba049 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:09.354163 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:09.365282 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2dd66-b8be-4e94-8cf1-c1959a17162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:09.366475 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2dd66-b8be-4e94-8cf1-c1959a17162d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:09.367159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2dd66-b8be-4e94-8cf1-c1959a17162d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:09.367446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2dd66-b8be-4e94-8cf1-c1959a17162d None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:09.368816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2dd66-b8be-4e94-8cf1-c1959a17162d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:09.369130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2dd66-b8be-4e94-8cf1-c1959a17162d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:09.370513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2dd66-b8be-4e94-8cf1-c1959a17162d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:09.381771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf60021-4d31-4b07-963c-7b0f8a49e370 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:09.387184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 131/262] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:09.396484 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2dd66-b8be-4e94-8cf1-c1959a17162d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:09.464227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6ea64-8aaf-444c-8a5a-425e136f2150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:09.464896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6ea64-8aaf-444c-8a5a-425e136f2150 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:09.465185 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6ea64-8aaf-444c-8a5a-425e136f2150 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:09.465466 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6ea64-8aaf-444c-8a5a-425e136f2150 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:09.476966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:09.540514 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6ea64-8aaf-444c-8a5a-425e136f2150 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:09.541975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6ea64-8aaf-444c-8a5a-425e136f2150 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:09.564783 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2dd66-b8be-4e94-8cf1-c1959a17162d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:09.633157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca078cf-7090-4aac-9afa-cd1214e89b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:09.634003 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca078cf-7090-4aac-9afa-cd1214e89b04 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:09.634287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca078cf-7090-4aac-9afa-cd1214e89b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:09.634563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca078cf-7090-4aac-9afa-cd1214e89b04 None admin] PATH_INFO: `/v3/users/266725f7a9d145dca74471699b4bcd02` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:09.640180 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca078cf-7090-4aac-9afa-cd1214e89b04 None admin] RBAC: Authorizing `identity:get_user(user_id=266725f7a9d145dca74471699b4bcd02)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:09.641647 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca078cf-7090-4aac-9afa-cd1214e89b04 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:09.643632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 132/263] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:09 2022] GET /identity/v3/users/266725f7a9d145dca74471699b4bcd02 => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:09.656140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 132/264] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:09.658403 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca078cf-7090-4aac-9afa-cd1214e89b04 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:09.661824 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6ea64-8aaf-444c-8a5a-425e136f2150 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:09.743851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:09.788433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:09.814114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6ea64-8aaf-444c-8a5a-425e136f2150 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:09.853966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075de241-bca0-4926-bf02-1817c9a8011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:09.854829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075de241-bca0-4926-bf02-1817c9a8011a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:09.855115 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075de241-bca0-4926-bf02-1817c9a8011a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:09.855906 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075de241-bca0-4926-bf02-1817c9a8011a None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:09.857184 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075de241-bca0-4926-bf02-1817c9a8011a None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:09.858842 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075de241-bca0-4926-bf02-1817c9a8011a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:09.860923 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 133/265] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:09 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:09.867296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075de241-bca0-4926-bf02-1817c9a8011a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:09.878810 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca078cf-7090-4aac-9afa-cd1214e89b04 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:09.940277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edade37-de9a-4fcd-9a0f-677f2a8d0a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:09.940850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edade37-de9a-4fcd-9a0f-677f2a8d0a45 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:09.941133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edade37-de9a-4fcd-9a0f-677f2a8d0a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:09.941473 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edade37-de9a-4fcd-9a0f-677f2a8d0a45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:09.983152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075de241-bca0-4926-bf02-1817c9a8011a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:09.993573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:10.022969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06991d-4a05-4c0b-9ca1-6314c837cbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:10.023778 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06991d-4a05-4c0b-9ca1-6314c837cbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:10.024735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06991d-4a05-4c0b-9ca1-6314c837cbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:10.025089 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06991d-4a05-4c0b-9ca1-6314c837cbb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:10.026510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06991d-4a05-4c0b-9ca1-6314c837cbb3 None admin] RBAC: Adding query filter params (role.id=9c6db94ddc204b7e860aa2a9d622e14b, scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb, user.id=266725f7a9d145dca74471699b4bcd02) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:10.026901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06991d-4a05-4c0b-9ca1-6314c837cbb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:10.028466 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06991d-4a05-4c0b-9ca1-6314c837cbb3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:10.035916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 134/266] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:09 2022] GET /identity/v3/role_assignments?user.id=266725f7a9d145dca74471699b4bcd02&scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb&role.id=9c6db94ddc204b7e860aa2a9d622e14b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:10.099427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edade37-de9a-4fcd-9a0f-677f2a8d0a45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:10.101099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edade37-de9a-4fcd-9a0f-677f2a8d0a45 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:10.194112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:10.250624 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 133/267] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:10.256587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06991d-4a05-4c0b-9ca1-6314c837cbb3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:10.368673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06991d-4a05-4c0b-9ca1-6314c837cbb3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:10.408132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b969c3-8f3b-4f44-a2bd-dfe5ff8c3279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:10.409021 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b969c3-8f3b-4f44-a2bd-dfe5ff8c3279 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:10.409295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b969c3-8f3b-4f44-a2bd-dfe5ff8c3279 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:10.409571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b969c3-8f3b-4f44-a2bd-dfe5ff8c3279 None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:10.410802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b969c3-8f3b-4f44-a2bd-dfe5ff8c3279 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:10.412327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b969c3-8f3b-4f44-a2bd-dfe5ff8c3279 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:10.414441 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 135/268] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:10 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:10.421071 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edade37-de9a-4fcd-9a0f-677f2a8d0a45 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:10.503945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737a821-13bd-4a6a-8868-38cff410d11e None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:10.504216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737a821-13bd-4a6a-8868-38cff410d11e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:10.504437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737a821-13bd-4a6a-8868-38cff410d11e None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:10.506837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 136/269] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:10.513272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c54f43-970a-4a1a-aad3-f6704aa19642 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:10.513564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c54f43-970a-4a1a-aad3-f6704aa19642 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:10.513851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c54f43-970a-4a1a-aad3-f6704aa19642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:10.542481 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-40c54f43-970a-4a1a-aad3-f6704aa19642 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:10.543789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-40c54f43-970a-4a1a-aad3-f6704aa19642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:10.566052 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edade37-de9a-4fcd-9a0f-677f2a8d0a45 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:10.595287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:10.606814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b694a99-68c8-455a-bcde-4e0217a173e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:10.607494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b694a99-68c8-455a-bcde-4e0217a173e9 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:10.607833 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b694a99-68c8-455a-bcde-4e0217a173e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:10.608115 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b694a99-68c8-455a-bcde-4e0217a173e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:10.608960 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b694a99-68c8-455a-bcde-4e0217a173e9 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb, user.id=266725f7a9d145dca74471699b4bcd02) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:10.609277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b694a99-68c8-455a-bcde-4e0217a173e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:10.610744 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b694a99-68c8-455a-bcde-4e0217a173e9 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:10.624888 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 134/270] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:10 2022] GET /identity/v3/role_assignments?user.id=266725f7a9d145dca74471699b4bcd02&scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb&role.id=e1a2021d08e14daa969362b3d23face3 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:10.642301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 137/271] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:10.691249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b694a99-68c8-455a-bcde-4e0217a173e9 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:10.730898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:10.835024 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0bf37-b276-4456-b521-4f077218fafe None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:10.835207 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0bf37-b276-4456-b521-4f077218fafe None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:10.835508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0bf37-b276-4456-b521-4f077218fafe None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:10.837075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 138/272] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:21:10.844144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b694a99-68c8-455a-bcde-4e0217a173e9 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:10.846727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640ee8-3f77-4e95-98be-366e41dffb5d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:10.847070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640ee8-3f77-4e95-98be-366e41dffb5d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:10.847359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640ee8-3f77-4e95-98be-366e41dffb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:10.876854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3c640ee8-3f77-4e95-98be-366e41dffb5d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:10.879379 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3c640ee8-3f77-4e95-98be-366e41dffb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:10.921029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa601427-f868-45f1-a079-e015108e5b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:10.922213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa601427-f868-45f1-a079-e015108e5b81 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:10.922688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa601427-f868-45f1-a079-e015108e5b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:10.923149 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa601427-f868-45f1-a079-e015108e5b81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:10.924660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa601427-f868-45f1-a079-e015108e5b81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:10.926314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa601427-f868-45f1-a079-e015108e5b81 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:10.928506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 135/273] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:10.934175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa601427-f868-45f1-a079-e015108e5b81 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:10.990179 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 139/274] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:11.016148 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c640ee8-3f77-4e95-98be-366e41dffb5d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:11.035454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:11.045261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa601427-f868-45f1-a079-e015108e5b81 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:11.083806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde2c39-780f-4c56-bbd0-9dea09dff4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:11.084818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde2c39-780f-4c56-bbd0-9dea09dff4c7 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:11.085400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde2c39-780f-4c56-bbd0-9dea09dff4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:11.085870 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde2c39-780f-4c56-bbd0-9dea09dff4c7 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:11.087316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde2c39-780f-4c56-bbd0-9dea09dff4c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:11.088967 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde2c39-780f-4c56-bbd0-9dea09dff4c7 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:11.114999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 136/275] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:21:10 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:21:11.132074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:11.136278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c640ee8-3f77-4e95-98be-366e41dffb5d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:11.176143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3157221-ef20-4b3b-a895-37e23cb8afb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:11.177389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3157221-ef20-4b3b-a895-37e23cb8afb6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:11.177873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3157221-ef20-4b3b-a895-37e23cb8afb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:11.178355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3157221-ef20-4b3b-a895-37e23cb8afb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:11.191219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3157221-ef20-4b3b-a895-37e23cb8afb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-a3157221-ef20-4b3b-a895-37e23cb8afb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:11.199736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:11.200741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:11.201671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:11.201671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:11.201671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:11.201671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:11.201671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:11.201671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:11.201671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:11.201671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:11.201671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:11.201671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:11.201671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:11.201671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:11.204524 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 140/276] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:11.209943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde2c39-780f-4c56-bbd0-9dea09dff4c7 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:11.327601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde2c39-780f-4c56-bbd0-9dea09dff4c7 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:11.362839 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bccfd-559f-4831-b789-679ffacf2ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:11.363548 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bccfd-559f-4831-b789-679ffacf2ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:11.363836 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bccfd-559f-4831-b789-679ffacf2ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:11.364157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bccfd-559f-4831-b789-679ffacf2ae2 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:11.364953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bccfd-559f-4831-b789-679ffacf2ae2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:11.365260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bccfd-559f-4831-b789-679ffacf2ae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:11.366989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bccfd-559f-4831-b789-679ffacf2ae2 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:11.377896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 137/277] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:11.384563 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3157221-ef20-4b3b-a895-37e23cb8afb6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:11.439726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba897b7-b956-4c4d-a1e4-5d2bdd389a4d None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:11.440015 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba897b7-b956-4c4d-a1e4-5d2bdd389a4d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:11.440295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba897b7-b956-4c4d-a1e4-5d2bdd389a4d None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:11.441811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 138/278] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:11.449273 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fa0ae-e628-4f1a-9ecb-bde7df50fd8a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:11.449273 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fa0ae-e628-4f1a-9ecb-bde7df50fd8a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:11.449273 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fa0ae-e628-4f1a-9ecb-bde7df50fd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:11.472502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-4d9fa0ae-e628-4f1a-9ecb-bde7df50fd8a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:11.474174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4d9fa0ae-e628-4f1a-9ecb-bde7df50fd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:11.484094 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:11.524960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3157221-ef20-4b3b-a895-37e23cb8afb6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:11.555063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 139/279] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:11.568913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722a4f7-f4f7-444e-85c5-8a0008a58ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:11.569928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722a4f7-f4f7-444e-85c5-8a0008a58ade None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:11.570311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722a4f7-f4f7-444e-85c5-8a0008a58ade None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:11.570685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722a4f7-f4f7-444e-85c5-8a0008a58ade None admin] PATH_INFO: `/v3/users/654e98db5028401c80654f2e4040739a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:11.580657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fa0ae-e628-4f1a-9ecb-bde7df50fd8a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:11.588335 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722a4f7-f4f7-444e-85c5-8a0008a58ade None admin] RBAC: Authorizing `identity:get_user(user_id=654e98db5028401c80654f2e4040739a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:11.589819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722a4f7-f4f7-444e-85c5-8a0008a58ade None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:11.591894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 141/280] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:11 2022] GET /identity/v3/users/654e98db5028401c80654f2e4040739a => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:11.597591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722a4f7-f4f7-444e-85c5-8a0008a58ade None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:11.617708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:11.708630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fa0ae-e628-4f1a-9ecb-bde7df50fd8a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:11.742095 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722a4f7-f4f7-444e-85c5-8a0008a58ade None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:11.745792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d258c51-f35f-4891-9dcd-71460ee56b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:11.746702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d258c51-f35f-4891-9dcd-71460ee56b99 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:11.747151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d258c51-f35f-4891-9dcd-71460ee56b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:11.747552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d258c51-f35f-4891-9dcd-71460ee56b99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:11.759211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d258c51-f35f-4891-9dcd-71460ee56b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:11.764882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-3d258c51-f35f-4891-9dcd-71460ee56b99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:11.768716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:11.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:11.770679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:11.770679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:11.770679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:11.770679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:11.770679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:11.770679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:11.770679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:11.770679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:11.770679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:11.770679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:11.770679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:21:11.770679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:11.771311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 140/281] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:11.777063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d258c51-f35f-4891-9dcd-71460ee56b99 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:11.848331 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8c50e-5e7d-4a6a-9fc4-b63df87f5bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:11.849016 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8c50e-5e7d-4a6a-9fc4-b63df87f5bce None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:11.849298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8c50e-5e7d-4a6a-9fc4-b63df87f5bce None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:11.849571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8c50e-5e7d-4a6a-9fc4-b63df87f5bce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:11.850423 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8c50e-5e7d-4a6a-9fc4-b63df87f5bce None admin] RBAC: Adding query filter params (role.id=484f610225884740911a5c3333f22221, user.id=654e98db5028401c80654f2e4040739a, scope.system=all) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:11.850735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8c50e-5e7d-4a6a-9fc4-b63df87f5bce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:11.852289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8c50e-5e7d-4a6a-9fc4-b63df87f5bce None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:11.873762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 142/282] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Jun 15 10:21:11 2022] GET /identity/v3/role_assignments?user.id=654e98db5028401c80654f2e4040739a&scope.system=all&role.id=484f610225884740911a5c3333f22221 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:11.888715 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d258c51-f35f-4891-9dcd-71460ee56b99 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:11.925382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace0e24-3aaf-4f15-847f-fd21d1b69b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:11.926263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace0e24-3aaf-4f15-847f-fd21d1b69b14 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:11.926544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace0e24-3aaf-4f15-847f-fd21d1b69b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:11.926817 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace0e24-3aaf-4f15-847f-fd21d1b69b14 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:11.927612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace0e24-3aaf-4f15-847f-fd21d1b69b14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:11.927919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace0e24-3aaf-4f15-847f-fd21d1b69b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:11.929428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace0e24-3aaf-4f15-847f-fd21d1b69b14 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:11.939695 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 141/283] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:11.945498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8c50e-5e7d-4a6a-9fc4-b63df87f5bce None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:11.969843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d5f13-d5f0-4979-b0e3-007c66d109d9 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:11.970184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d5f13-d5f0-4979-b0e3-007c66d109d9 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:11.970399 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d5f13-d5f0-4979-b0e3-007c66d109d9 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:11.971970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 142/284] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:21:11.977362 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838b21f-6353-4321-867d-6b75f3ca35a2 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:11.977644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838b21f-6353-4321-867d-6b75f3ca35a2 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:11.977939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838b21f-6353-4321-867d-6b75f3ca35a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:12.007866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-b838b21f-6353-4321-867d-6b75f3ca35a2 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:12.009671 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b838b21f-6353-4321-867d-6b75f3ca35a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:12.076182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:12.101054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8c50e-5e7d-4a6a-9fc4-b63df87f5bce None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:12.124224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:12.136326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 143/285] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:12.143947 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01cfbb-728f-442b-a2ca-3925bebc65fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:12.144818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01cfbb-728f-442b-a2ca-3925bebc65fb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:12.145101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01cfbb-728f-442b-a2ca-3925bebc65fb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:12.145376 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01cfbb-728f-442b-a2ca-3925bebc65fb None admin] PATH_INFO: `/v3/users/fb09b0adff704a809d740b49143d3bb6` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:12.146567 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01cfbb-728f-442b-a2ca-3925bebc65fb None admin] RBAC: Authorizing `identity:get_user(user_id=fb09b0adff704a809d740b49143d3bb6)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:12.148036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01cfbb-728f-442b-a2ca-3925bebc65fb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:12.149968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 143/286] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:11 2022] GET /identity/v3/users/fb09b0adff704a809d740b49143d3bb6 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:12.155392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838b21f-6353-4321-867d-6b75f3ca35a2 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:12.163424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01cfbb-728f-442b-a2ca-3925bebc65fb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:12.287625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838b21f-6353-4321-867d-6b75f3ca35a2 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:12.325207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c614b-6449-4ffc-affa-2e509b520e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:12.326081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c614b-6449-4ffc-affa-2e509b520e4b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:12.326363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c614b-6449-4ffc-affa-2e509b520e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:12.329588 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c614b-6449-4ffc-affa-2e509b520e4b None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:12.329588 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c614b-6449-4ffc-affa-2e509b520e4b None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:12.329761 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c614b-6449-4ffc-affa-2e509b520e4b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:12.331783 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 144/287] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:12 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:12.337289 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c614b-6449-4ffc-affa-2e509b520e4b None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:12.408529 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:12.421358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01cfbb-728f-442b-a2ca-3925bebc65fb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:12.450554 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c614b-6449-4ffc-affa-2e509b520e4b None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:12.500160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa9544-3d57-424d-969f-d0b39d1de2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:12.501104 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa9544-3d57-424d-969f-d0b39d1de2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:12.501484 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa9544-3d57-424d-969f-d0b39d1de2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:12.501860 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa9544-3d57-424d-969f-d0b39d1de2f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:12.516805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a240e-b99e-4a77-9f69-850661d3c603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:12.518536 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a240e-b99e-4a77-9f69-850661d3c603 None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:12.520837 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a240e-b99e-4a77-9f69-850661d3c603 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:12.521223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a240e-b99e-4a77-9f69-850661d3c603 None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb/users/fb09b0adff704a809d740b49143d3bb6/roles/12bc45a7126d4529b9a76b4e74a28d44` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:12.523333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa9544-3d57-424d-969f-d0b39d1de2f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:12.524743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a240e-b99e-4a77-9f69-850661d3c603 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2e9da0fae424c80aea374ac5ff2cefb, user_id=fb09b0adff704a809d740b49143d3bb6, role_id=12bc45a7126d4529b9a76b4e74a28d44)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:12.530822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a240e-b99e-4a77-9f69-850661d3c603 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-99aa9544-3d57-424d-969f-d0b39d1de2f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:12.537720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:12.538679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:12.539540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:12.539540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:12.539540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:12.539540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:12.539540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:12.539540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:12.539540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:12.539540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:12.539540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:12.539540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:12.539540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:12.539540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:12.541306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 144/288] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:12.548716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa9544-3d57-424d-969f-d0b39d1de2f3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:12.554515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 145/289] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:21:12 2022] PUT /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb/users/fb09b0adff704a809d740b49143d3bb6/roles/12bc45a7126d4529b9a76b4e74a28d44 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:21:12.583887 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:12.718937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa9544-3d57-424d-969f-d0b39d1de2f3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:12.767622 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b3c37-b8cf-4177-97f6-b77ed1b995c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:12.768292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b3c37-b8cf-4177-97f6-b77ed1b995c5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:12.768572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b3c37-b8cf-4177-97f6-b77ed1b995c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:12.768848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b3c37-b8cf-4177-97f6-b77ed1b995c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:12.769603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b3c37-b8cf-4177-97f6-b77ed1b995c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:12.769912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b3c37-b8cf-4177-97f6-b77ed1b995c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:12.771295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b3c37-b8cf-4177-97f6-b77ed1b995c5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:12.783429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 145/290] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:12.789140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a240e-b99e-4a77-9f69-850661d3c603 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:12.905207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a240e-b99e-4a77-9f69-850661d3c603 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:12.925643 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:12.947084 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b4d1e-4574-4fc2-8ad3-13d26db31569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:12.947984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b4d1e-4574-4fc2-8ad3-13d26db31569 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:12.948261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b4d1e-4574-4fc2-8ad3-13d26db31569 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:12.948531 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b4d1e-4574-4fc2-8ad3-13d26db31569 None admin] PATH_INFO: `/v3/users/914cf387b2e442d9885af05221cf8894` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:12.952178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b4d1e-4574-4fc2-8ad3-13d26db31569 None admin] RBAC: Authorizing `identity:get_user(user_id=914cf387b2e442d9885af05221cf8894)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:12.953701 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b4d1e-4574-4fc2-8ad3-13d26db31569 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:12.955410 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 146/291] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:12 2022] GET /identity/v3/users/914cf387b2e442d9885af05221cf8894 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:12.960994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b3c37-b8cf-4177-97f6-b77ed1b995c5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:13.073862 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:13.110825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b3c37-b8cf-4177-97f6-b77ed1b995c5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:13.158004 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dac7ab-93ac-4ed3-840b-3496cb52cb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:13.158655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dac7ab-93ac-4ed3-840b-3496cb52cb77 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:13.158940 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dac7ab-93ac-4ed3-840b-3496cb52cb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:13.159224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dac7ab-93ac-4ed3-840b-3496cb52cb77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:13.254441 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dac7ab-93ac-4ed3-840b-3496cb52cb77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:13.255872 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dac7ab-93ac-4ed3-840b-3496cb52cb77 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:13.336693 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:13.370318 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 146/292] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:13.377335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b4d1e-4574-4fc2-8ad3-13d26db31569 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:13.498689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b4d1e-4574-4fc2-8ad3-13d26db31569 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:13.538995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23009220-3488-4a6c-928a-da708b957443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:13.540667 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009220-3488-4a6c-928a-da708b957443 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:13.541088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009220-3488-4a6c-928a-da708b957443 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:13.541498 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009220-3488-4a6c-928a-da708b957443 None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:13.543017 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23009220-3488-4a6c-928a-da708b957443 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:13.544667 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23009220-3488-4a6c-928a-da708b957443 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:13.552412 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 147/293] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:13 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:13.558877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dac7ab-93ac-4ed3-840b-3496cb52cb77 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:13.684312 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dac7ab-93ac-4ed3-840b-3496cb52cb77 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:13.718419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb06ed-d20c-4fac-9b55-0b4095e38284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:13.719073 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb06ed-d20c-4fac-9b55-0b4095e38284 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:13.719357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb06ed-d20c-4fac-9b55-0b4095e38284 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:13.719662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb06ed-d20c-4fac-9b55-0b4095e38284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:13.720570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb06ed-d20c-4fac-9b55-0b4095e38284 None admin] RBAC: Adding query filter params (role.id=484f610225884740911a5c3333f22221, scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb, user.id=914cf387b2e442d9885af05221cf8894) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:13.720886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb06ed-d20c-4fac-9b55-0b4095e38284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:13.722320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb06ed-d20c-4fac-9b55-0b4095e38284 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:13.729399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 147/294] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:13 2022] GET /identity/v3/role_assignments?user.id=914cf387b2e442d9885af05221cf8894&scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb&role.id=484f610225884740911a5c3333f22221 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:13.934546 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf52d6a-b773-436e-8b7b-5d48434708eb None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:13.935459 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf52d6a-b773-436e-8b7b-5d48434708eb None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:13.936333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf52d6a-b773-436e-8b7b-5d48434708eb None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:13.938647 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 148/295] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:13.949264 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa413-81c9-4834-b081-38c3f0756cd3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:13.949735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa413-81c9-4834-b081-38c3f0756cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:13.950182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faa413-81c9-4834-b081-38c3f0756cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:13.971030 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957805b-c3ee-4955-8394-3eed31014f3e None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:13.971589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957805b-c3ee-4955-8394-3eed31014f3e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:13.972009 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957805b-c3ee-4955-8394-3eed31014f3e None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:13.973544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 149/296] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:13.975308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-73faa413-81c9-4834-b081-38c3f0756cd3 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:13.976664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-73faa413-81c9-4834-b081-38c3f0756cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:13.980873 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861af62-ff5b-42de-be3b-ca61833aacbb None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:13.981160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861af62-ff5b-42de-be3b-ca61833aacbb None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:13.981511 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861af62-ff5b-42de-be3b-ca61833aacbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:14.005604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-4861af62-ff5b-42de-be3b-ca61833aacbb None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:14.007434 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4861af62-ff5b-42de-be3b-ca61833aacbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:14.022730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:14.070597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:14.076981 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 148/297] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:14.097055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 150/298] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:14.099560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faa413-81c9-4834-b081-38c3f0756cd3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:14.135166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861af62-ff5b-42de-be3b-ca61833aacbb None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:14.217190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faa413-81c9-4834-b081-38c3f0756cd3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:14.256119 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18648c8-0344-4bbb-a2af-f6a7c6998805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:14.256480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861af62-ff5b-42de-be3b-ca61833aacbb None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:14.257489 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18648c8-0344-4bbb-a2af-f6a7c6998805 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:14.258085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18648c8-0344-4bbb-a2af-f6a7c6998805 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:14.258597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18648c8-0344-4bbb-a2af-f6a7c6998805 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:14.260100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18648c8-0344-4bbb-a2af-f6a7c6998805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:14.261729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18648c8-0344-4bbb-a2af-f6a7c6998805 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:14.263953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 149/299] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:14.273303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18648c8-0344-4bbb-a2af-f6a7c6998805 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:14.298221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af0d7c-38bc-4e57-b2e2-24667f0e050a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:14.299025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af0d7c-38bc-4e57-b2e2-24667f0e050a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:14.299303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af0d7c-38bc-4e57-b2e2-24667f0e050a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:14.299608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af0d7c-38bc-4e57-b2e2-24667f0e050a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:14.311123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af0d7c-38bc-4e57-b2e2-24667f0e050a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:14.318708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-e7af0d7c-38bc-4e57-b2e2-24667f0e050a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:14.320158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:14.321645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:14.322480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:14.322480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:14.322480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:14.322480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:14.322480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:14.322480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:14.322480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:14.322480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:14.322480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:14.322480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:14.322480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:21:14.322480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:14.322480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 151/300] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:14.327679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af0d7c-38bc-4e57-b2e2-24667f0e050a None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:14.383250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:14.399887 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18648c8-0344-4bbb-a2af-f6a7c6998805 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:14.434268 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316825c3-b030-4458-8904-df8606442068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:14.435314 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316825c3-b030-4458-8904-df8606442068 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:14.435715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316825c3-b030-4458-8904-df8606442068 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:14.436100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316825c3-b030-4458-8904-df8606442068 None admin] PATH_INFO: `/v3/groups` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:14.437458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316825c3-b030-4458-8904-df8606442068 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:14.439330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316825c3-b030-4458-8904-df8606442068 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:14.446508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af0d7c-38bc-4e57-b2e2-24667f0e050a None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:14.459543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 150/301] 10.222.0.50 () {60 vars in 1134 bytes} [Wed Jun 15 10:21:14 2022] POST /identity/v3/groups => generated 229 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:21:14.497711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430763d-fa2f-459d-82b0-fa34ad385163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:14.498722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430763d-fa2f-459d-82b0-fa34ad385163 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:14.499187 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430763d-fa2f-459d-82b0-fa34ad385163 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:14.499674 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430763d-fa2f-459d-82b0-fa34ad385163 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:14.500756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430763d-fa2f-459d-82b0-fa34ad385163 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:14.501342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430763d-fa2f-459d-82b0-fa34ad385163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:14.503030 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430763d-fa2f-459d-82b0-fa34ad385163 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:14.513962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 152/302] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:14.521618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316825c3-b030-4458-8904-df8606442068 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:14.547860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870e26-ca72-4c80-853b-3378e1a0b37a None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:14.549392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870e26-ca72-4c80-853b-3378e1a0b37a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:14.549847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870e26-ca72-4c80-853b-3378e1a0b37a None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:14.551853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 153/303] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:21:14.557515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0797c99-102d-4962-a97d-1099a3269823 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:14.557804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0797c99-102d-4962-a97d-1099a3269823 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:14.558087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0797c99-102d-4962-a97d-1099a3269823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:14.579312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-d0797c99-102d-4962-a97d-1099a3269823 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:14.581272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d0797c99-102d-4962-a97d-1099a3269823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:14.637021 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:14.646655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316825c3-b030-4458-8904-df8606442068 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:14.685791 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 154/304] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:14.699438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545720a3-b664-4356-8563-a55a62035f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:14.700434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545720a3-b664-4356-8563-a55a62035f31 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:14.700801 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545720a3-b664-4356-8563-a55a62035f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:14.701143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545720a3-b664-4356-8563-a55a62035f31 None admin] PATH_INFO: `/v3/users/dace0e27f21344aba5363d67a047643b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:14.709652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0797c99-102d-4962-a97d-1099a3269823 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:14.716994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545720a3-b664-4356-8563-a55a62035f31 None admin] RBAC: Authorizing `identity:get_user(user_id=dace0e27f21344aba5363d67a047643b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:14.718463 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545720a3-b664-4356-8563-a55a62035f31 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:14.720389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 151/305] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:14 2022] GET /identity/v3/users/dace0e27f21344aba5363d67a047643b => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:14.725837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545720a3-b664-4356-8563-a55a62035f31 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:14.764324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:14.827456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0797c99-102d-4962-a97d-1099a3269823 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:14.852232 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545720a3-b664-4356-8563-a55a62035f31 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:14.863290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e963000-7e79-45b2-aff6-53f21e093f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:14.864117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963000-7e79-45b2-aff6-53f21e093f9b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:14.864399 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963000-7e79-45b2-aff6-53f21e093f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:14.864674 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963000-7e79-45b2-aff6-53f21e093f9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:14.877235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e963000-7e79-45b2-aff6-53f21e093f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-9e963000-7e79-45b2-aff6-53f21e093f9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:14.886326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:14.887344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:14.888234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:14.888234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:14.888234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:14.888234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:14.888234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:14.888234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:14.888234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:14.888234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:14.888234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:14.888234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:14.888234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:14.888234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:14.892653 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 155/306] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:14.893502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e963000-7e79-45b2-aff6-53f21e093f9b None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:14.898596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c559458-db5e-4ee1-a783-b5660f4d8730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:14.899586 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c559458-db5e-4ee1-a783-b5660f4d8730 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:14.900085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c559458-db5e-4ee1-a783-b5660f4d8730 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:14.900552 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c559458-db5e-4ee1-a783-b5660f4d8730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:14.901586 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c559458-db5e-4ee1-a783-b5660f4d8730 None admin] RBAC: Adding query filter params (role.id=12bc45a7126d4529b9a76b4e74a28d44, user.id=dace0e27f21344aba5363d67a047643b, scope.system=all) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:14.902090 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c559458-db5e-4ee1-a783-b5660f4d8730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:14.904205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c559458-db5e-4ee1-a783-b5660f4d8730 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:14.911708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 152/307] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Jun 15 10:21:14 2022] GET /identity/v3/role_assignments?user.id=dace0e27f21344aba5363d67a047643b&scope.system=all&role.id=12bc45a7126d4529b9a76b4e74a28d44 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:15.011972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:15.016359 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e963000-7e79-45b2-aff6-53f21e093f9b None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:15.055939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ddf2f-9f4b-46d2-8f93-7307b07ea250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:15.056993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ddf2f-9f4b-46d2-8f93-7307b07ea250 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:15.057549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ddf2f-9f4b-46d2-8f93-7307b07ea250 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:15.058017 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ddf2f-9f4b-46d2-8f93-7307b07ea250 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:15.059032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ddf2f-9f4b-46d2-8f93-7307b07ea250 None admin] RBAC: Adding query filter params (name=member) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:15.059594 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ddf2f-9f4b-46d2-8f93-7307b07ea250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:15.061205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ddf2f-9f4b-46d2-8f93-7307b07ea250 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:15.071027 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 156/308] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:15.077187 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c559458-db5e-4ee1-a783-b5660f4d8730 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:15.103861 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:15.187515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c559458-db5e-4ee1-a783-b5660f4d8730 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:15.224519 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5275c-c844-4455-9cde-f344b0155707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:15.225483 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5275c-c844-4455-9cde-f344b0155707 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:15.225765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5275c-c844-4455-9cde-f344b0155707 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:15.226042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5275c-c844-4455-9cde-f344b0155707 None admin] PATH_INFO: `/v3/users/654e98db5028401c80654f2e4040739a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:15.228034 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5275c-c844-4455-9cde-f344b0155707 None admin] RBAC: Authorizing `identity:get_user(user_id=654e98db5028401c80654f2e4040739a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:15.229514 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5275c-c844-4455-9cde-f344b0155707 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:15.231622 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 153/309] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:15 2022] GET /identity/v3/users/654e98db5028401c80654f2e4040739a => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:15.240641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ddf2f-9f4b-46d2-8f93-7307b07ea250 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:15.280807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecf63d-05af-430c-a880-9feac03ff098 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:15.281085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecf63d-05af-430c-a880-9feac03ff098 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:15.281277 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecf63d-05af-430c-a880-9feac03ff098 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:15.286260 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 154/310] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:21:15.287662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236a3f8-124f-46e6-ab8e-748ab9d1de85 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:15.287944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236a3f8-124f-46e6-ab8e-748ab9d1de85 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:15.288213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236a3f8-124f-46e6-ab8e-748ab9d1de85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:15.306067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7236a3f8-124f-46e6-ab8e-748ab9d1de85 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:15.307265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7236a3f8-124f-46e6-ab8e-748ab9d1de85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:15.355676 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ddf2f-9f4b-46d2-8f93-7307b07ea250 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:15.378428 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 155/311] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:15.393600 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98284a0e-80b5-4aaa-a4fb-349893e96843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:15.394458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98284a0e-80b5-4aaa-a4fb-349893e96843 None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:15.394737 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98284a0e-80b5-4aaa-a4fb-349893e96843 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:15.395009 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98284a0e-80b5-4aaa-a4fb-349893e96843 None admin] PATH_INFO: `/v3/system/users/654e98db5028401c80654f2e4040739a/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:15.396530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98284a0e-80b5-4aaa-a4fb-349893e96843 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=654e98db5028401c80654f2e4040739a, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:15.397895 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98284a0e-80b5-4aaa-a4fb-349893e96843 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:15.403892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236a3f8-124f-46e6-ab8e-748ab9d1de85 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:15.407216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 157/312] 10.222.0.50 () {58 vars in 1334 bytes} [Wed Jun 15 10:21:15 2022] PUT /identity/v3/system/users/654e98db5028401c80654f2e4040739a/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:21:15.426570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:15.529516 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236a3f8-124f-46e6-ab8e-748ab9d1de85 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:15.572295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f60eb0-5af9-48fc-9cf5-0fd76eee6b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:15.573014 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f60eb0-5af9-48fc-9cf5-0fd76eee6b77 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:15.573292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f60eb0-5af9-48fc-9cf5-0fd76eee6b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:15.573617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f60eb0-5af9-48fc-9cf5-0fd76eee6b77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:15.583852 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f60eb0-5af9-48fc-9cf5-0fd76eee6b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-b5f60eb0-5af9-48fc-9cf5-0fd76eee6b77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:15.592468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:15.593410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:15.594241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:15.594241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:15.594241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:15.594241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:15.594241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:15.594241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:15.594241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:15.594241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:15.594241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:15.594241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:15.594241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:21:15.594241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:15.594241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 156/313] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:15.601141 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98284a0e-80b5-4aaa-a4fb-349893e96843 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:15.629473 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:15.710734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98284a0e-80b5-4aaa-a4fb-349893e96843 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:15.746544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73899ef5-e7f2-4a9b-b253-4db96677e07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:15.747229 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899ef5-e7f2-4a9b-b253-4db96677e07b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:15.747535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899ef5-e7f2-4a9b-b253-4db96677e07b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:15.747814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899ef5-e7f2-4a9b-b253-4db96677e07b None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:15.748569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73899ef5-e7f2-4a9b-b253-4db96677e07b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:15.748875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73899ef5-e7f2-4a9b-b253-4db96677e07b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:15.750268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73899ef5-e7f2-4a9b-b253-4db96677e07b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:15.759442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 158/314] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:15.764923 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f60eb0-5af9-48fc-9cf5-0fd76eee6b77 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:15.846174 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:15.873491 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f60eb0-5af9-48fc-9cf5-0fd76eee6b77 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:15.907500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99b636-98a1-4698-a6c3-7d1796bcdabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:15.908481 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99b636-98a1-4698-a6c3-7d1796bcdabc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:15.908767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99b636-98a1-4698-a6c3-7d1796bcdabc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:15.909042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99b636-98a1-4698-a6c3-7d1796bcdabc None admin] PATH_INFO: `/v3/users/fb09b0adff704a809d740b49143d3bb6` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:15.910242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99b636-98a1-4698-a6c3-7d1796bcdabc None admin] RBAC: Authorizing `identity:get_user(user_id=fb09b0adff704a809d740b49143d3bb6)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:15.911720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99b636-98a1-4698-a6c3-7d1796bcdabc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:15.913358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 157/315] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:15 2022] GET /identity/v3/users/fb09b0adff704a809d740b49143d3bb6 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:15.919333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73899ef5-e7f2-4a9b-b253-4db96677e07b None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:16.006788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:16.021925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73899ef5-e7f2-4a9b-b253-4db96677e07b None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:16.056213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584454fe-7856-4d5a-82ae-e23e7bab1505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:16.056968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584454fe-7856-4d5a-82ae-e23e7bab1505 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:16.057250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584454fe-7856-4d5a-82ae-e23e7bab1505 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:16.057525 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584454fe-7856-4d5a-82ae-e23e7bab1505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:16.128617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584454fe-7856-4d5a-82ae-e23e7bab1505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:16.130037 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584454fe-7856-4d5a-82ae-e23e7bab1505 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:16.215918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:16.233060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 159/316] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:16.238579 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99b636-98a1-4698-a6c3-7d1796bcdabc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:16.341572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99b636-98a1-4698-a6c3-7d1796bcdabc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:16.376365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c543737-8a96-475e-a50b-28e5f8fe994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:16.377221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c543737-8a96-475e-a50b-28e5f8fe994f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:16.377643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c543737-8a96-475e-a50b-28e5f8fe994f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:16.377920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c543737-8a96-475e-a50b-28e5f8fe994f None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:16.379167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c543737-8a96-475e-a50b-28e5f8fe994f None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:16.380585 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c543737-8a96-475e-a50b-28e5f8fe994f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:16.382580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 158/317] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:16 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:16.388480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584454fe-7856-4d5a-82ae-e23e7bab1505 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:16.493812 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584454fe-7856-4d5a-82ae-e23e7bab1505 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:16.530407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebafae7-c291-4e64-899b-0bd12009aa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:16.531115 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebafae7-c291-4e64-899b-0bd12009aa69 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:16.531401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebafae7-c291-4e64-899b-0bd12009aa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:16.531712 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebafae7-c291-4e64-899b-0bd12009aa69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:16.532707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebafae7-c291-4e64-899b-0bd12009aa69 None admin] RBAC: Adding query filter params (role.id=12bc45a7126d4529b9a76b4e74a28d44, scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb, user.id=fb09b0adff704a809d740b49143d3bb6) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:16.533025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebafae7-c291-4e64-899b-0bd12009aa69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:16.534458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebafae7-c291-4e64-899b-0bd12009aa69 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:16.541046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 160/318] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:16 2022] GET /identity/v3/role_assignments?user.id=fb09b0adff704a809d740b49143d3bb6&scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb&role.id=12bc45a7126d4529b9a76b4e74a28d44 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:16.773273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86291b5-8ae1-4d82-9993-9bef58d6cbaf None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:16.774765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86291b5-8ae1-4d82-9993-9bef58d6cbaf None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:16.775243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86291b5-8ae1-4d82-9993-9bef58d6cbaf None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:16.777106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 159/319] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:16.782609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1598a-58ed-4d58-a137-e8a8f4721c18 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:16.783149 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1598a-58ed-4d58-a137-e8a8f4721c18 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:16.783672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1598a-58ed-4d58-a137-e8a8f4721c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:16.800486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-9fc1598a-58ed-4d58-a137-e8a8f4721c18 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:16.801973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-9fc1598a-58ed-4d58-a137-e8a8f4721c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:16.850089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:16.872452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 161/320] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:16.894793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86291b5-8ae1-4d82-9993-9bef58d6cbaf None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:16.908348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:17.003691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86291b5-8ae1-4d82-9993-9bef58d6cbaf None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:17.038197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4f7fb-fefe-46ba-bff0-0645353c4342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:17.039048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4f7fb-fefe-46ba-bff0-0645353c4342 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:17.039336 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4f7fb-fefe-46ba-bff0-0645353c4342 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:17.039679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4f7fb-fefe-46ba-bff0-0645353c4342 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:17.040884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4f7fb-fefe-46ba-bff0-0645353c4342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:17.042368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4f7fb-fefe-46ba-bff0-0645353c4342 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:17.044192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 160/321] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:17.049570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1598a-58ed-4d58-a137-e8a8f4721c18 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:17.128695 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961851e-bff3-4c3f-8aa0-fcd6a5639187 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:17.128990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961851e-bff3-4c3f-8aa0-fcd6a5639187 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:17.129266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961851e-bff3-4c3f-8aa0-fcd6a5639187 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:17.130717 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 161/322] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:17.137899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d9e18-10e4-4f37-ac10-712cc6c7d7e2 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:17.138187 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d9e18-10e4-4f37-ac10-712cc6c7d7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:17.138460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d9e18-10e4-4f37-ac10-712cc6c7d7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:17.154744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7b1d9e18-10e4-4f37-ac10-712cc6c7d7e2 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:17.155971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7b1d9e18-10e4-4f37-ac10-712cc6c7d7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:17.161054 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1598a-58ed-4d58-a137-e8a8f4721c18 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:17.197657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecea060-b91b-4f03-b7f9-ba11f69ee432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:17.198326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecea060-b91b-4f03-b7f9-ba11f69ee432 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:17.198609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecea060-b91b-4f03-b7f9-ba11f69ee432 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:17.198884 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecea060-b91b-4f03-b7f9-ba11f69ee432 None admin] PATH_INFO: `/v3/groups` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:17.200027 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecea060-b91b-4f03-b7f9-ba11f69ee432 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:17.201863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecea060-b91b-4f03-b7f9-ba11f69ee432 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:17.226013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 162/323] 10.222.0.50 () {60 vars in 1134 bytes} [Wed Jun 15 10:21:17 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:21:17.227710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 162/324] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:17.252790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecea060-b91b-4f03-b7f9-ba11f69ee432 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:17.301148 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:17.365354 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecea060-b91b-4f03-b7f9-ba11f69ee432 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:17.401620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e289b93-fed4-40bf-bc54-6d5fafb42f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:17.402419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289b93-fed4-40bf-bc54-6d5fafb42f99 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:17.402699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289b93-fed4-40bf-bc54-6d5fafb42f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:17.402992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289b93-fed4-40bf-bc54-6d5fafb42f99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:17.414267 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e289b93-fed4-40bf-bc54-6d5fafb42f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-2e289b93-fed4-40bf-bc54-6d5fafb42f99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:17.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:17.423736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:17.424565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:17.424565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:17.424565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:17.424565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:17.424565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:17.424565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:17.424565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:17.424565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:17.424565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:17.424565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:17.424565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:21:17.424565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:17.424565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 163/325] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:17.429902 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d9e18-10e4-4f37-ac10-712cc6c7d7e2 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:17.441506 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:17.541916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d9e18-10e4-4f37-ac10-712cc6c7d7e2 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:17.578231 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b34f98-0132-4e9c-a400-9c44528ff474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:17.578839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b34f98-0132-4e9c-a400-9c44528ff474 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:17.579123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b34f98-0132-4e9c-a400-9c44528ff474 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:17.579401 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b34f98-0132-4e9c-a400-9c44528ff474 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:17.580222 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b34f98-0132-4e9c-a400-9c44528ff474 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:17.580533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b34f98-0132-4e9c-a400-9c44528ff474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:17.581972 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b34f98-0132-4e9c-a400-9c44528ff474 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:17.592414 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 163/326] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:17.598136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e289b93-fed4-40bf-bc54-6d5fafb42f99 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:17.656579 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76515c-36a8-4b3f-9b05-655b9a198875 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:17.656765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76515c-36a8-4b3f-9b05-655b9a198875 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:17.656996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76515c-36a8-4b3f-9b05-655b9a198875 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:17.658584 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 164/327] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:17.663913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cc622-c6bc-45e4-9b84-21c2b49490ad None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:17.664166 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cc622-c6bc-45e4-9b84-21c2b49490ad None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:17.664434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cc622-c6bc-45e4-9b84-21c2b49490ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:17.690427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9c5cc622-c6bc-45e4-9b84-21c2b49490ad None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:17.693455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9c5cc622-c6bc-45e4-9b84-21c2b49490ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:17.719545 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:17.722560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e289b93-fed4-40bf-bc54-6d5fafb42f99 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:17.764204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a517049-bc3c-4a08-8afb-fae76981f79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:17.765071 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a517049-bc3c-4a08-8afb-fae76981f79d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:17.765633 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a517049-bc3c-4a08-8afb-fae76981f79d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:17.766111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a517049-bc3c-4a08-8afb-fae76981f79d None admin] PATH_INFO: `/v3/users/dace0e27f21344aba5363d67a047643b` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:17.767660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a517049-bc3c-4a08-8afb-fae76981f79d None admin] RBAC: Authorizing `identity:get_user(user_id=dace0e27f21344aba5363d67a047643b)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:17.769363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a517049-bc3c-4a08-8afb-fae76981f79d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:17.771227 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 164/328] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:17 2022] GET /identity/v3/users/dace0e27f21344aba5363d67a047643b => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:17.777511 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a517049-bc3c-4a08-8afb-fae76981f79d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:17.782718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:17.792118 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 165/329] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:17.817977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cc622-c6bc-45e4-9b84-21c2b49490ad None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:17.904087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a517049-bc3c-4a08-8afb-fae76981f79d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:17.939726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f86565-0de0-4635-af79-3079b0b8cf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:17.940586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86565-0de0-4635-af79-3079b0b8cf4f None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:17.940964 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86565-0de0-4635-af79-3079b0b8cf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:17.941241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86565-0de0-4635-af79-3079b0b8cf4f None admin] PATH_INFO: `/v3/system/users/dace0e27f21344aba5363d67a047643b/roles/12bc45a7126d4529b9a76b4e74a28d44` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:17.942725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f86565-0de0-4635-af79-3079b0b8cf4f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dace0e27f21344aba5363d67a047643b, role_id=12bc45a7126d4529b9a76b4e74a28d44)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:17.943654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cc622-c6bc-45e4-9b84-21c2b49490ad None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:17.944160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f86565-0de0-4635-af79-3079b0b8cf4f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:17.952019 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 165/330] 10.222.0.50 () {58 vars in 1334 bytes} [Wed Jun 15 10:21:17 2022] PUT /identity/v3/system/users/dace0e27f21344aba5363d67a047643b/roles/12bc45a7126d4529b9a76b4e74a28d44 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:21:17.983110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70303c4a-a8cd-41ea-be91-4c82bd822760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:17.983964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70303c4a-a8cd-41ea-be91-4c82bd822760 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:17.984250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70303c4a-a8cd-41ea-be91-4c82bd822760 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:17.984527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70303c4a-a8cd-41ea-be91-4c82bd822760 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:17.997005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70303c4a-a8cd-41ea-be91-4c82bd822760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-70303c4a-a8cd-41ea-be91-4c82bd822760 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:18.004995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:18.005993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:18.006821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:18.006821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:18.006821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:18.006821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:18.006821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:18.006821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:18.006821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:18.006821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:18.006821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:18.006821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:18.006821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:18.006821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:18.006821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 166/331] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:18.012418 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f86565-0de0-4635-af79-3079b0b8cf4f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:18.053563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:18.141120 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f86565-0de0-4635-af79-3079b0b8cf4f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:18.178141 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da795fb0-e8ec-4cd6-beb9-9ea925bb7945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:18.178730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da795fb0-e8ec-4cd6-beb9-9ea925bb7945 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:18.179008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da795fb0-e8ec-4cd6-beb9-9ea925bb7945 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:18.179280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da795fb0-e8ec-4cd6-beb9-9ea925bb7945 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:18.180063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da795fb0-e8ec-4cd6-beb9-9ea925bb7945 None admin] RBAC: Adding query filter params (name=member) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:18.180456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da795fb0-e8ec-4cd6-beb9-9ea925bb7945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da795fb0-e8ec-4cd6-beb9-9ea925bb7945 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:18.191990 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 166/332] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:18.197161 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70303c4a-a8cd-41ea-be91-4c82bd822760 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:18.262956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:18.306993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70303c4a-a8cd-41ea-be91-4c82bd822760 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:18.347330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868fdf7-995d-4eab-ae56-bb15f654a842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:18.348229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868fdf7-995d-4eab-ae56-bb15f654a842 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:18.348503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868fdf7-995d-4eab-ae56-bb15f654a842 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:18.348775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868fdf7-995d-4eab-ae56-bb15f654a842 None admin] PATH_INFO: `/v3/users/654e98db5028401c80654f2e4040739a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:18.356165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868fdf7-995d-4eab-ae56-bb15f654a842 None admin] RBAC: Authorizing `identity:get_user(user_id=654e98db5028401c80654f2e4040739a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:18.357689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868fdf7-995d-4eab-ae56-bb15f654a842 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:18.359609 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 167/333] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:18 2022] GET /identity/v3/users/654e98db5028401c80654f2e4040739a => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:18.365446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da795fb0-e8ec-4cd6-beb9-9ea925bb7945 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:18.471611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:18.478913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da795fb0-e8ec-4cd6-beb9-9ea925bb7945 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:18.520573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b8fb5-e874-4ae6-a171-0810dff8a936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:18.521724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b8fb5-e874-4ae6-a171-0810dff8a936 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:18.522225 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b8fb5-e874-4ae6-a171-0810dff8a936 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:18.522720 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b8fb5-e874-4ae6-a171-0810dff8a936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:18.524467 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b8fb5-e874-4ae6-a171-0810dff8a936 None admin] RBAC: Adding query filter params (role.id=484f610225884740911a5c3333f22221, user.id=654e98db5028401c80654f2e4040739a, scope.system=all) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:18.525043 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b8fb5-e874-4ae6-a171-0810dff8a936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:18.527766 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b8fb5-e874-4ae6-a171-0810dff8a936 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:18.547833 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 167/334] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Jun 15 10:21:18 2022] GET /identity/v3/role_assignments?user.id=654e98db5028401c80654f2e4040739a&scope.system=all&role.id=484f610225884740911a5c3333f22221 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:19.913716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078236be-142a-475a-89c8-3754eef6cd6b None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:19.914392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078236be-142a-475a-89c8-3754eef6cd6b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:19.914392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078236be-142a-475a-89c8-3754eef6cd6b None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:19.915999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 168/335] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:19.922191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8eb35-19d3-4743-8706-bc2b3d77f556 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:19.922790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8eb35-19d3-4743-8706-bc2b3d77f556 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:19.922790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8eb35-19d3-4743-8706-bc2b3d77f556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:19.948558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-69d8eb35-19d3-4743-8706-bc2b3d77f556 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:19.949861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-69d8eb35-19d3-4743-8706-bc2b3d77f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:20.004404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78672a6c-00aa-4d5d-a45b-7df2ddf0883a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:20.004941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78672a6c-00aa-4d5d-a45b-7df2ddf0883a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:20.005135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78672a6c-00aa-4d5d-a45b-7df2ddf0883a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:20.006667 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 169/336] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:20.013663 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71277c1-3383-4685-81fa-11fed09221a7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:20.013941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71277c1-3383-4685-81fa-11fed09221a7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:20.014214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71277c1-3383-4685-81fa-11fed09221a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:20.044033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 168/337] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:20.044999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f71277c1-3383-4685-81fa-11fed09221a7 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:20.046276 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f71277c1-3383-4685-81fa-11fed09221a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:20.080238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8eb35-19d3-4743-8706-bc2b3d77f556 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:20.169332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 170/338] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:20.214760 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71277c1-3383-4685-81fa-11fed09221a7 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:20.220637 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:20.254300 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8eb35-19d3-4743-8706-bc2b3d77f556 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:20.303337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:20.316254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b234ec2-ea21-4aa4-92a3-f9ce840eb0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:20.317209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b234ec2-ea21-4aa4-92a3-f9ce840eb0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:20.317474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b234ec2-ea21-4aa4-92a3-f9ce840eb0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:20.317745 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b234ec2-ea21-4aa4-92a3-f9ce840eb0b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:20.332578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b234ec2-ea21-4aa4-92a3-f9ce840eb0b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-5b234ec2-ea21-4aa4-92a3-f9ce840eb0b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:20.345490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:20.346447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:20.347276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:20.347276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:20.347276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:20.347276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:20.347276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:20.347276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:20.347276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:20.347276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:20.347276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:20.347276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:20.347276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:20.347276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:20.354126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 169/339] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:21:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:20.355280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b234ec2-ea21-4aa4-92a3-f9ce840eb0b8 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:20.364234 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71277c1-3383-4685-81fa-11fed09221a7 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:20.424220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38c237-fe13-4bd8-808f-a7a1f34ccc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:20.425039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38c237-fe13-4bd8-808f-a7a1f34ccc86 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:20.425331 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38c237-fe13-4bd8-808f-a7a1f34ccc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:20.425609 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38c237-fe13-4bd8-808f-a7a1f34ccc86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:20.448580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38c237-fe13-4bd8-808f-a7a1f34ccc86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-0a38c237-fe13-4bd8-808f-a7a1f34ccc86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:20.460442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:20.461408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:20.462235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:20.462235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:20.462235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:20.462235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:20.462235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:20.462235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:20.462235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:20.462235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:20.462235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:20.462235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:20.462235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:20.462235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:20.462235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 171/340] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:20.469155 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38c237-fe13-4bd8-808f-a7a1f34ccc86 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:20.508447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b234ec2-ea21-4aa4-92a3-f9ce840eb0b8 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:20.563479 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d120-8442-4da3-952b-eac954b6b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:20.564326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d120-8442-4da3-952b-eac954b6b394 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:20.564611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d120-8442-4da3-952b-eac954b6b394 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:20.564887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d120-8442-4da3-952b-eac954b6b394 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:20.565753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040d120-8442-4da3-952b-eac954b6b394 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:20.566061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040d120-8442-4da3-952b-eac954b6b394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:20.567554 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040d120-8442-4da3-952b-eac954b6b394 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:20.577899 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 170/341] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:20.582334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d120-8442-4da3-952b-eac954b6b394 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:20.589663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:20.627406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38c237-fe13-4bd8-808f-a7a1f34ccc86 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:20.650693 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:20.688196 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a308c-991d-4d97-bf5f-2ddd06684bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:20.688889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a308c-991d-4d97-bf5f-2ddd06684bcc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:20.689175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a308c-991d-4d97-bf5f-2ddd06684bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:20.689447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a308c-991d-4d97-bf5f-2ddd06684bcc None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:20.690236 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a308c-991d-4d97-bf5f-2ddd06684bcc None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:20.690544 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a308c-991d-4d97-bf5f-2ddd06684bcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:20.691953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a308c-991d-4d97-bf5f-2ddd06684bcc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:20.707114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 172/342] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:20.712875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a308c-991d-4d97-bf5f-2ddd06684bcc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:20.748877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d120-8442-4da3-952b-eac954b6b394 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:20.810092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecf44f-2e99-4a98-9592-db51d3837ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:20.810793 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecf44f-2e99-4a98-9592-db51d3837ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:20.811072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecf44f-2e99-4a98-9592-db51d3837ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:20.811394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecf44f-2e99-4a98-9592-db51d3837ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:20.857415 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a308c-991d-4d97-bf5f-2ddd06684bcc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:20.916263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bef608-4c0f-4280-821b-a7f5fdce24a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:20.916927 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bef608-4c0f-4280-821b-a7f5fdce24a2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:20.917212 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bef608-4c0f-4280-821b-a7f5fdce24a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:20.917486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bef608-4c0f-4280-821b-a7f5fdce24a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:20.931425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecf44f-2e99-4a98-9592-db51d3837ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:20.933065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecf44f-2e99-4a98-9592-db51d3837ae0 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:20.939671 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:20.980982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:21.002041 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bef608-4c0f-4280-821b-a7f5fdce24a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:21.003429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bef608-4c0f-4280-821b-a7f5fdce24a2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:21.110745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 173/343] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:21.115813 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bef608-4c0f-4280-821b-a7f5fdce24a2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:21.153948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 171/344] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:21.159793 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecf44f-2e99-4a98-9592-db51d3837ae0 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:21.209219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:21.222360 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bef608-4c0f-4280-821b-a7f5fdce24a2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:21.259449 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dc54e-4ce4-48cc-b12d-b234d101e71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:21.260541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dc54e-4ce4-48cc-b12d-b234d101e71f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:21.260920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dc54e-4ce4-48cc-b12d-b234d101e71f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:21.261312 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dc54e-4ce4-48cc-b12d-b234d101e71f None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:21.262889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762dc54e-4ce4-48cc-b12d-b234d101e71f None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:21.265376 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762dc54e-4ce4-48cc-b12d-b234d101e71f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:21.267418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 174/345] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:21 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:21.272404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dc54e-4ce4-48cc-b12d-b234d101e71f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:21.313295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecf44f-2e99-4a98-9592-db51d3837ae0 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:21.316542 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:21.364181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598ecd1-c55b-4954-833e-770d3d34b0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:21.365438 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598ecd1-c55b-4954-833e-770d3d34b0af None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:21.365964 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598ecd1-c55b-4954-833e-770d3d34b0af None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:21.366700 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598ecd1-c55b-4954-833e-770d3d34b0af None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:21.368193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598ecd1-c55b-4954-833e-770d3d34b0af None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:21.369862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598ecd1-c55b-4954-833e-770d3d34b0af None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:21.372105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 172/346] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:21 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:21.377554 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598ecd1-c55b-4954-833e-770d3d34b0af None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:21.385155 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dc54e-4ce4-48cc-b12d-b234d101e71f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:21.423797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d526a-9c6c-4fea-ba34-f6452cdf75fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:21.424634 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d526a-9c6c-4fea-ba34-f6452cdf75fc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:21.424922 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d526a-9c6c-4fea-ba34-f6452cdf75fc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:21.425275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d526a-9c6c-4fea-ba34-f6452cdf75fc None admin] PATH_INFO: `/v3/groups/a50197a60eae4fb294cddfe0eb66cb58` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:21.432486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d526a-9c6c-4fea-ba34-f6452cdf75fc None admin] RBAC: Authorizing `identity:get_group(group_id=a50197a60eae4fb294cddfe0eb66cb58)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:21.433941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d526a-9c6c-4fea-ba34-f6452cdf75fc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:21.436686 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 175/347] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:21 2022] GET /identity/v3/groups/a50197a60eae4fb294cddfe0eb66cb58 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:21.444591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d526a-9c6c-4fea-ba34-f6452cdf75fc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:21.467008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:21.582677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d526a-9c6c-4fea-ba34-f6452cdf75fc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:21.597616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598ecd1-c55b-4954-833e-770d3d34b0af None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:21.624548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ab6d4-9318-400e-b451-273d04a22c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:21.625205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab6d4-9318-400e-b451-273d04a22c84 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:21.625475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab6d4-9318-400e-b451-273d04a22c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:21.625752 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ab6d4-9318-400e-b451-273d04a22c84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:21.627085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ab6d4-9318-400e-b451-273d04a22c84 None admin] RBAC: Adding query filter params (group.id=a50197a60eae4fb294cddfe0eb66cb58, role.id=484f610225884740911a5c3333f22221, scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:21.627395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ab6d4-9318-400e-b451-273d04a22c84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:21.629120 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ab6d4-9318-400e-b451-273d04a22c84 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:21.636205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 176/348] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Jun 15 10:21:21 2022] GET /identity/v3/role_assignments?group.id=a50197a60eae4fb294cddfe0eb66cb58&scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76&role.id=484f610225884740911a5c3333f22221 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:21.647964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4db2b8-5065-4c96-b028-7e311409b5d1 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:21.648267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4db2b8-5065-4c96-b028-7e311409b5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:21.648515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4db2b8-5065-4c96-b028-7e311409b5d1 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:21.650486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 177/349] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:21:21.661004 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9f908-d3f0-4ff5-b4f8-a25babfe2b37 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:21.661419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9f908-d3f0-4ff5-b4f8-a25babfe2b37 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:21.661795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9f908-d3f0-4ff5-b4f8-a25babfe2b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:21.683161 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-20e9f908-d3f0-4ff5-b4f8-a25babfe2b37 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:21.684796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-20e9f908-d3f0-4ff5-b4f8-a25babfe2b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:21.690270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122e68e-bed6-4b93-a113-df2b45144cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:21.691419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122e68e-bed6-4b93-a113-df2b45144cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:21.691868 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122e68e-bed6-4b93-a113-df2b45144cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:21.692286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122e68e-bed6-4b93-a113-df2b45144cd2 None admin] PATH_INFO: `/v3/groups/a50197a60eae4fb294cddfe0eb66cb58` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:21.696928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122e68e-bed6-4b93-a113-df2b45144cd2 None admin] RBAC: Authorizing `identity:get_group(group_id=a50197a60eae4fb294cddfe0eb66cb58)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:21.698416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122e68e-bed6-4b93-a113-df2b45144cd2 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:21.700620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 173/350] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:21 2022] GET /identity/v3/groups/a50197a60eae4fb294cddfe0eb66cb58 => generated 226 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:21.713229 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122e68e-bed6-4b93-a113-df2b45144cd2 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:21.804525 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:21.806530 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 178/351] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:21.808369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77b32-85b8-4de8-bb4a-54ea5097ecdb None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:21.809357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77b32-85b8-4de8-bb4a-54ea5097ecdb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:21.809357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a77b32-85b8-4de8-bb4a-54ea5097ecdb None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:21.814646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 179/352] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:21.816420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7916a0-19f3-4f4f-b972-089f4d3cf697 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:21.816923 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7916a0-19f3-4f4f-b972-089f4d3cf697 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:21.817385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7916a0-19f3-4f4f-b972-089f4d3cf697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:21.839555 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:21.850803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-af7916a0-19f3-4f4f-b972-089f4d3cf697 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:21.854043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-af7916a0-19f3-4f4f-b972-089f4d3cf697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:21.882419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122e68e-bed6-4b93-a113-df2b45144cd2 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:21.921966 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6441e7-dfd1-4421-8798-97a4dfeb7509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:21.922737 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6441e7-dfd1-4421-8798-97a4dfeb7509 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:21.923109 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6441e7-dfd1-4421-8798-97a4dfeb7509 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:21.923431 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6441e7-dfd1-4421-8798-97a4dfeb7509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:21.924294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6441e7-dfd1-4421-8798-97a4dfeb7509 None admin] RBAC: Adding query filter params (group.id=a50197a60eae4fb294cddfe0eb66cb58, role.id=9c6db94ddc204b7e860aa2a9d622e14b, scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:21.924601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6441e7-dfd1-4421-8798-97a4dfeb7509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:21.926235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6441e7-dfd1-4421-8798-97a4dfeb7509 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:21.933338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 174/353] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Jun 15 10:21:21 2022] GET /identity/v3/role_assignments?group.id=a50197a60eae4fb294cddfe0eb66cb58&scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76&role.id=9c6db94ddc204b7e860aa2a9d622e14b => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:21.934153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6441e7-dfd1-4421-8798-97a4dfeb7509 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:21.960492 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 180/354] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:22.003311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7916a0-19f3-4f4f-b972-089f4d3cf697 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:22.048048 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6441e7-dfd1-4421-8798-97a4dfeb7509 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:22.050631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:22.088222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ea390-97d5-459c-a72a-282084553930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:22.089257 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ea390-97d5-459c-a72a-282084553930 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:22.089544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ea390-97d5-459c-a72a-282084553930 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:22.089872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ea390-97d5-459c-a72a-282084553930 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:22.102923 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ea390-97d5-459c-a72a-282084553930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-0b1ea390-97d5-459c-a72a-282084553930 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:22.111223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:22.113049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:22.113942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:22.113942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:22.113942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:22.113942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:22.113942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:22.113942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:22.113942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:22.113942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:22.113942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:22.113942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:22.113942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:22.113942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:22.113942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 175/355] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:22.119968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ea390-97d5-459c-a72a-282084553930 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:22.162139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7916a0-19f3-4f4f-b972-089f4d3cf697 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:22.233336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ea390-97d5-459c-a72a-282084553930 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:22.245754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c3777-d300-45f3-a8f4-894579cf94b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:22.246928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c3777-d300-45f3-a8f4-894579cf94b4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:22.247450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c3777-d300-45f3-a8f4-894579cf94b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:22.247965 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c3777-d300-45f3-a8f4-894579cf94b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:22.256720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:22.278692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5b6c9-81f9-441a-a51f-b52a78053b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:22.279674 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5b6c9-81f9-441a-a51f-b52a78053b0c None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:22.280121 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5b6c9-81f9-441a-a51f-b52a78053b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:22.280252 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c3777-d300-45f3-a8f4-894579cf94b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:22.280657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5b6c9-81f9-441a-a51f-b52a78053b0c None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:22.281566 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5b6c9-81f9-441a-a51f-b52a78053b0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:22.282017 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5b6c9-81f9-441a-a51f-b52a78053b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:22.283590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5b6c9-81f9-441a-a51f-b52a78053b0c None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-502c3777-d300-45f3-a8f4-894579cf94b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:22.288547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:22.290317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:22.291347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:22.291347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:22.291347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:22.291347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:22.291347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:22.291347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:22.291347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:22.291347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:22.291347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:22.291347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:22.291347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 10:21:22.291347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:22.297217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 181/356] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:22.299303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 176/357] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:22.303576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c3777-d300-45f3-a8f4-894579cf94b4 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:22.305163 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5b6c9-81f9-441a-a51f-b52a78053b0c None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:22.337131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:22.415263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5b6c9-81f9-441a-a51f-b52a78053b0c None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:22.450034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4968fc-f793-4b38-8dfa-15b77c7a4924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:22.450946 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4968fc-f793-4b38-8dfa-15b77c7a4924 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:22.451378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4968fc-f793-4b38-8dfa-15b77c7a4924 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:22.451827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4968fc-f793-4b38-8dfa-15b77c7a4924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:22.527304 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4968fc-f793-4b38-8dfa-15b77c7a4924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:22.529064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4968fc-f793-4b38-8dfa-15b77c7a4924 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:22.578048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c3777-d300-45f3-a8f4-894579cf94b4 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:22.580144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:22.628639 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081caee6-00fd-49e4-903a-7483439298cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:22.629303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081caee6-00fd-49e4-903a-7483439298cd None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:22.629648 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081caee6-00fd-49e4-903a-7483439298cd None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:22.629865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081caee6-00fd-49e4-903a-7483439298cd None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:22.630615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081caee6-00fd-49e4-903a-7483439298cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:22.630924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081caee6-00fd-49e4-903a-7483439298cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:22.632559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081caee6-00fd-49e4-903a-7483439298cd None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:22.644663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 177/359] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:22.644862 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 182/359] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:22.647846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a501035-661a-4d93-b699-447f67ff7095 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:22.648149 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a501035-661a-4d93-b699-447f67ff7095 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:22.648436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a501035-661a-4d93-b699-447f67ff7095 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:22.650535 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 183/360] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:22.652856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4968fc-f793-4b38-8dfa-15b77c7a4924 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:22.653975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a501035-661a-4d93-b699-447f67ff7095 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:22.755063 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:22.772011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4968fc-f793-4b38-8dfa-15b77c7a4924 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:22.782259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a501035-661a-4d93-b699-447f67ff7095 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:22.806284 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:22.815844 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044134f-d142-4d58-8adc-6de177ed62f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:22.817062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044134f-d142-4d58-8adc-6de177ed62f2 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:22.817621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044134f-d142-4d58-8adc-6de177ed62f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:22.818099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044134f-d142-4d58-8adc-6de177ed62f2 None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:22.819594 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044134f-d142-4d58-8adc-6de177ed62f2 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:22.821813 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044134f-d142-4d58-8adc-6de177ed62f2 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:22.824519 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 178/361] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:22 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:22.825979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966e1e5-a4a0-44cf-82a0-e06ec6d7b8c0 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:22.826466 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966e1e5-a4a0-44cf-82a0-e06ec6d7b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:22.826949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966e1e5-a4a0-44cf-82a0-e06ec6d7b8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:22.838239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91d639-9dfb-47f8-bb0e-b169d9a18b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:22.839163 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91d639-9dfb-47f8-bb0e-b169d9a18b0e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:22.839443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91d639-9dfb-47f8-bb0e-b169d9a18b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:22.840121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91d639-9dfb-47f8-bb0e-b169d9a18b0e None admin] PATH_INFO: `/v3/users/dace0e27f21344aba5363d67a047643b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:22.841030 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91d639-9dfb-47f8-bb0e-b169d9a18b0e None admin] RBAC: Authorizing `identity:get_user(user_id=dace0e27f21344aba5363d67a047643b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:22.842777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91d639-9dfb-47f8-bb0e-b169d9a18b0e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:22.845465 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 184/362] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:21:22 2022] GET /identity/v3/users/dace0e27f21344aba5363d67a047643b => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:22.847054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddd7e5-d955-4e30-a4b0-2c6a172038ca None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:22.847343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddd7e5-d955-4e30-a4b0-2c6a172038ca None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:22.847646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddd7e5-d955-4e30-a4b0-2c6a172038ca None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:22.848877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 185/363] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:22.849562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddd7e5-d955-4e30-a4b0-2c6a172038ca None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:22.855436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-c966e1e5-a4a0-44cf-82a0-e06ec6d7b8c0 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:22.856935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c966e1e5-a4a0-44cf-82a0-e06ec6d7b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:22.943933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 179/364] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:22.944801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966e1e5-a4a0-44cf-82a0-e06ec6d7b8c0 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:22.994454 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddd7e5-d955-4e30-a4b0-2c6a172038ca None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:23.029954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:23.048966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32949b77-58fe-4e95-8e75-3ab66e27edbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:23.050616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32949b77-58fe-4e95-8e75-3ab66e27edbc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:23.051503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32949b77-58fe-4e95-8e75-3ab66e27edbc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:23.052283 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32949b77-58fe-4e95-8e75-3ab66e27edbc None admin] PATH_INFO: `/v3/groups/a50197a60eae4fb294cddfe0eb66cb58` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:23.053949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32949b77-58fe-4e95-8e75-3ab66e27edbc None admin] RBAC: Authorizing `identity:get_group(group_id=a50197a60eae4fb294cddfe0eb66cb58)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:23.056433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32949b77-58fe-4e95-8e75-3ab66e27edbc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:23.059266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 186/365] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:22 2022] GET /identity/v3/groups/a50197a60eae4fb294cddfe0eb66cb58 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:23.060739 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb31729-d175-4c6d-aadb-991cdca8550e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:23.061227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb31729-d175-4c6d-aadb-991cdca8550e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:23.061729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb31729-d175-4c6d-aadb-991cdca8550e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:23.085339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5bb31729-d175-4c6d-aadb-991cdca8550e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:23.086139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966e1e5-a4a0-44cf-82a0-e06ec6d7b8c0 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:23.087075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5bb31729-d175-4c6d-aadb-991cdca8550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:23.117258 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:23.132463 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9a6ef-2872-4afb-83e7-9f3aa0c53597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:23.133155 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a6ef-2872-4afb-83e7-9f3aa0c53597 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:23.133440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a6ef-2872-4afb-83e7-9f3aa0c53597 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:23.133710 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a6ef-2872-4afb-83e7-9f3aa0c53597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:23.134548 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9a6ef-2872-4afb-83e7-9f3aa0c53597 None admin] RBAC: Adding query filter params (role.id=12bc45a7126d4529b9a76b4e74a28d44, user.id=dace0e27f21344aba5363d67a047643b, scope.system=all) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:23.134855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9a6ef-2872-4afb-83e7-9f3aa0c53597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:23.136398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9a6ef-2872-4afb-83e7-9f3aa0c53597 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:23.152637 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 180/366] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Jun 15 10:21:22 2022] GET /identity/v3/role_assignments?user.id=dace0e27f21344aba5363d67a047643b&scope.system=all&role.id=12bc45a7126d4529b9a76b4e74a28d44 => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:23.154081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9a6ef-2872-4afb-83e7-9f3aa0c53597 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:23.171629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 187/367] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:23.172516 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb31729-d175-4c6d-aadb-991cdca8550e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:23.294392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9a6ef-2872-4afb-83e7-9f3aa0c53597 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:23.304609 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb31729-d175-4c6d-aadb-991cdca8550e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:23.340137 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac11e3-9b00-47a6-a991-b0ff16c71b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:23.341056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac11e3-9b00-47a6-a991-b0ff16c71b5e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:23.341339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac11e3-9b00-47a6-a991-b0ff16c71b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:23.341613 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac11e3-9b00-47a6-a991-b0ff16c71b5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:23.357127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:23.369961 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac11e3-9b00-47a6-a991-b0ff16c71b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:23.384700 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a1e80-2173-4dd6-a185-67b62fd6c3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:23.385432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a1e80-2173-4dd6-a185-67b62fd6c3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:23.385724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a1e80-2173-4dd6-a185-67b62fd6c3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:23.386003 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a1e80-2173-4dd6-a185-67b62fd6c3a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:23.386875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a1e80-2173-4dd6-a185-67b62fd6c3a9 None admin] RBAC: Adding query filter params (group.id=a50197a60eae4fb294cddfe0eb66cb58, role.id=484f610225884740911a5c3333f22221, scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:23.387280 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a1e80-2173-4dd6-a185-67b62fd6c3a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:23.388944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a1e80-2173-4dd6-a185-67b62fd6c3a9 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-3fac11e3-9b00-47a6-a991-b0ff16c71b5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:23.392381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:23.393407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:23.394250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:23.394250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:23.394250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:23.394250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:23.394250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:23.394250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:23.394250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:23.394250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:23.394250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:23.394250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:23.394250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:23.394250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:23.394250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 181/368] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:21:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:23.394974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac11e3-9b00-47a6-a991-b0ff16c71b5e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:23.407837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 188/369] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Jun 15 10:21:23 2022] GET /identity/v3/role_assignments?group.id=a50197a60eae4fb294cddfe0eb66cb58&scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb&role.id=484f610225884740911a5c3333f22221 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:23.408835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a1e80-2173-4dd6-a185-67b62fd6c3a9 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:23.484842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:23.597098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac11e3-9b00-47a6-a991-b0ff16c71b5e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:23.602190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a1e80-2173-4dd6-a185-67b62fd6c3a9 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:23.667788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610cd7a-7b45-4bb5-98ba-8ae1971c2f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:23.671134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610cd7a-7b45-4bb5-98ba-8ae1971c2f37 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:23.671134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610cd7a-7b45-4bb5-98ba-8ae1971c2f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:23.671134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610cd7a-7b45-4bb5-98ba-8ae1971c2f37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:23.678219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c489ad-43b8-4400-9945-33cda47fe5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:23.678219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c489ad-43b8-4400-9945-33cda47fe5fe None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:23.678219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c489ad-43b8-4400-9945-33cda47fe5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:23.678219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c489ad-43b8-4400-9945-33cda47fe5fe None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:23.678572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c489ad-43b8-4400-9945-33cda47fe5fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:23.678572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c489ad-43b8-4400-9945-33cda47fe5fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:23.678572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c489ad-43b8-4400-9945-33cda47fe5fe None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:23.689864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610cd7a-7b45-4bb5-98ba-8ae1971c2f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:23.693143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 189/370] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:23.699401 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c489ad-43b8-4400-9945-33cda47fe5fe None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-6610cd7a-7b45-4bb5-98ba-8ae1971c2f37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:23.699574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:23.700443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:23.701277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:23.701277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:23.701277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:23.701277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:23.701277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:23.701277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:23.701277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:23.701277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:23.701277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:23.701277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:23.701277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:21:23.701277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:23.704822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 182/371] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:21:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:23.710637 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610cd7a-7b45-4bb5-98ba-8ae1971c2f37 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:23.784587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:23.847319 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610cd7a-7b45-4bb5-98ba-8ae1971c2f37 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:23.851768 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:23.886378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d7da2-d99c-4998-9fbb-7c99edd4e29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:23.887329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d7da2-d99c-4998-9fbb-7c99edd4e29f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:23.887858 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d7da2-d99c-4998-9fbb-7c99edd4e29f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:23.888293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d7da2-d99c-4998-9fbb-7c99edd4e29f None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:23.889199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d7da2-d99c-4998-9fbb-7c99edd4e29f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:23.889660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d7da2-d99c-4998-9fbb-7c99edd4e29f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:23.891327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d7da2-d99c-4998-9fbb-7c99edd4e29f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:23.902192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 183/372] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:23.906706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c489ad-43b8-4400-9945-33cda47fe5fe None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:23.907832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d7da2-d99c-4998-9fbb-7c99edd4e29f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:23.979234 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec8137-1442-4035-b8d3-2fdd42a3410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:23.980223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec8137-1442-4035-b8d3-2fdd42a3410a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:23.980703 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec8137-1442-4035-b8d3-2fdd42a3410a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:23.981152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec8137-1442-4035-b8d3-2fdd42a3410a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:24.055127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d7da2-d99c-4998-9fbb-7c99edd4e29f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:24.088443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec8137-1442-4035-b8d3-2fdd42a3410a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:24.091178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec8137-1442-4035-b8d3-2fdd42a3410a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:24.103882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7111a-26ea-476b-ade3-5497a48d353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:24.104814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7111a-26ea-476b-ade3-5497a48d353d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:24.105282 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7111a-26ea-476b-ade3-5497a48d353d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:24.105743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7111a-26ea-476b-ade3-5497a48d353d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:24.154946 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:24.186711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7111a-26ea-476b-ade3-5497a48d353d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:24.188773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7111a-26ea-476b-ade3-5497a48d353d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:24.236681 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:24.297901 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 184/373] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:24.303658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7111a-26ea-476b-ade3-5497a48d353d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:24.342349 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 190/374] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:24.348201 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec8137-1442-4035-b8d3-2fdd42a3410a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:24.379757 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:24.437927 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7111a-26ea-476b-ade3-5497a48d353d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:24.476549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a0091-d6dc-4696-a030-9f4e7e4f4bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:24.477774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a0091-d6dc-4696-a030-9f4e7e4f4bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:24.478231 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a0091-d6dc-4696-a030-9f4e7e4f4bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:24.478680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a0091-d6dc-4696-a030-9f4e7e4f4bb9 None admin] PATH_INFO: `/v3/projects/e426bab74fde45f595bae4efed952751` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:24.480097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a0091-d6dc-4696-a030-9f4e7e4f4bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=e426bab74fde45f595bae4efed952751)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:24.481887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a0091-d6dc-4696-a030-9f4e7e4f4bb9 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:24.487863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 185/375] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:24 2022] GET /identity/v3/projects/e426bab74fde45f595bae4efed952751 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:24.492159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a0091-d6dc-4696-a030-9f4e7e4f4bb9 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:24.517062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec8137-1442-4035-b8d3-2fdd42a3410a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:24.577475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b157c-fbea-4da5-a05a-7d6cd607e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:24.578349 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b157c-fbea-4da5-a05a-7d6cd607e49e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:24.578498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b157c-fbea-4da5-a05a-7d6cd607e49e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:24.578913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b157c-fbea-4da5-a05a-7d6cd607e49e None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:24.580368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b157c-fbea-4da5-a05a-7d6cd607e49e None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:24.581832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b157c-fbea-4da5-a05a-7d6cd607e49e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:24.591635 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 191/376] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:24 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:24.592571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b157c-fbea-4da5-a05a-7d6cd607e49e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:24.608245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a0091-d6dc-4696-a030-9f4e7e4f4bb9 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:24.626987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:24.651978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:24.660384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8787299-0870-443d-8336-aa145dd9771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:24.662381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8787299-0870-443d-8336-aa145dd9771d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:24.662866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8787299-0870-443d-8336-aa145dd9771d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:24.663337 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8787299-0870-443d-8336-aa145dd9771d None admin] PATH_INFO: `/v3/groups/726ae218b1d74f258c9efcc1d3c57c08` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:24.671184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8787299-0870-443d-8336-aa145dd9771d None admin] RBAC: Authorizing `identity:get_group(group_id=726ae218b1d74f258c9efcc1d3c57c08)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:24.673627 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8787299-0870-443d-8336-aa145dd9771d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:24.676144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 186/377] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:24 2022] GET /identity/v3/groups/726ae218b1d74f258c9efcc1d3c57c08 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:24.682599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8787299-0870-443d-8336-aa145dd9771d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:24.757103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b157c-fbea-4da5-a05a-7d6cd607e49e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:24.792662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8787299-0870-443d-8336-aa145dd9771d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:24.829421 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73628dfd-2fc1-4326-8e2e-8dc141b20227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:24.830456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73628dfd-2fc1-4326-8e2e-8dc141b20227 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:24.830949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73628dfd-2fc1-4326-8e2e-8dc141b20227 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:24.831436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73628dfd-2fc1-4326-8e2e-8dc141b20227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:24.832497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73628dfd-2fc1-4326-8e2e-8dc141b20227 None admin] RBAC: Adding query filter params (group.id=726ae218b1d74f258c9efcc1d3c57c08, role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=e426bab74fde45f595bae4efed952751) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:24.833242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73628dfd-2fc1-4326-8e2e-8dc141b20227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:24.834904 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73628dfd-2fc1-4326-8e2e-8dc141b20227 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:24.841726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 187/378] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Jun 15 10:21:24 2022] GET /identity/v3/role_assignments?group.id=726ae218b1d74f258c9efcc1d3c57c08&scope.project.id=e426bab74fde45f595bae4efed952751&role.id=e1a2021d08e14daa969362b3d23face3 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:24.855515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db22f92-1a98-4998-8633-6cf133acba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:24.856503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db22f92-1a98-4998-8633-6cf133acba04 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:24.856791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db22f92-1a98-4998-8633-6cf133acba04 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:24.857070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db22f92-1a98-4998-8633-6cf133acba04 None admin] PATH_INFO: `/v3/groups/a50197a60eae4fb294cddfe0eb66cb58` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:24.864515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db22f92-1a98-4998-8633-6cf133acba04 None admin] RBAC: Authorizing `identity:get_group(group_id=a50197a60eae4fb294cddfe0eb66cb58)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:24.866015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db22f92-1a98-4998-8633-6cf133acba04 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:24.868968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 192/379] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:24 2022] GET /identity/v3/groups/a50197a60eae4fb294cddfe0eb66cb58 => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:24.874895 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73628dfd-2fc1-4326-8e2e-8dc141b20227 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:24.965779 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:24.989905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720512-0c58-45a3-85dd-69d0e42ad10c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:24.990211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720512-0c58-45a3-85dd-69d0e42ad10c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:24.990466 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5720512-0c58-45a3-85dd-69d0e42ad10c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:24.992147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 193/380] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:25.004975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347791c-6d58-4a7e-ad94-8b0f8c936c42 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:25.005676 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347791c-6d58-4a7e-ad94-8b0f8c936c42 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:25.005676 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347791c-6d58-4a7e-ad94-8b0f8c936c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:25.029727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c347791c-6d58-4a7e-ad94-8b0f8c936c42 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:25.030928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c347791c-6d58-4a7e-ad94-8b0f8c936c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:25.032243 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73628dfd-2fc1-4326-8e2e-8dc141b20227 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:25.083389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89aa40-48b2-44bc-a4d4-1fe945fe0cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:25.084207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89aa40-48b2-44bc-a4d4-1fe945fe0cdd None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:25.084454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89aa40-48b2-44bc-a4d4-1fe945fe0cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:25.084727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89aa40-48b2-44bc-a4d4-1fe945fe0cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:25.085579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89aa40-48b2-44bc-a4d4-1fe945fe0cdd None admin] RBAC: Adding query filter params (group.id=a50197a60eae4fb294cddfe0eb66cb58, role.id=9c6db94ddc204b7e860aa2a9d622e14b, scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:25.085893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89aa40-48b2-44bc-a4d4-1fe945fe0cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:25.087415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89aa40-48b2-44bc-a4d4-1fe945fe0cdd None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:25.096134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 188/381] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Jun 15 10:21:24 2022] GET /identity/v3/role_assignments?group.id=a50197a60eae4fb294cddfe0eb66cb58&scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb&role.id=9c6db94ddc204b7e860aa2a9d622e14b => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:25.103494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc71f8-cd75-4db3-8fbc-f38f4d40b124 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:25.103494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc71f8-cd75-4db3-8fbc-f38f4d40b124 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:25.103494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc71f8-cd75-4db3-8fbc-f38f4d40b124 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:25.103494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 189/382] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:25.109577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb49bf-68e7-48b9-b08a-4c01871a192b None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:25.109878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb49bf-68e7-48b9-b08a-4c01871a192b None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:25.110172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb49bf-68e7-48b9-b08a-4c01871a192b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:25.141614 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 194/383] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:25.144253 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-80cb49bf-68e7-48b9-b08a-4c01871a192b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:25.145512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-80cb49bf-68e7-48b9-b08a-4c01871a192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:25.165361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347791c-6d58-4a7e-ad94-8b0f8c936c42 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:25.214690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:25.262318 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 190/384] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:25.288384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb49bf-68e7-48b9-b08a-4c01871a192b None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:25.356874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:25.385956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347791c-6d58-4a7e-ad94-8b0f8c936c42 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:25.415333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb49bf-68e7-48b9-b08a-4c01871a192b None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:25.428098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedb563-9f7d-44ed-bd86-76236e4311ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:25.428902 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb563-9f7d-44ed-bd86-76236e4311ee None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:25.429196 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb563-9f7d-44ed-bd86-76236e4311ee None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:25.429683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb563-9f7d-44ed-bd86-76236e4311ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:25.440563 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedb563-9f7d-44ed-bd86-76236e4311ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-5aedb563-9f7d-44ed-bd86-76236e4311ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:25.454826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:25.455936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:25.456784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:25.456784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:25.456784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:25.456784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:25.456784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:25.456784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:25.456784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:25.456784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:25.456784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:25.456784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:25.456784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:25.456784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:25.456784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 195/385] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:21:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:25.462402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cadfc9-937b-48b7-8c64-a8e326f550da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:25.463494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cadfc9-937b-48b7-8c64-a8e326f550da None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:25.463978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cadfc9-937b-48b7-8c64-a8e326f550da None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:25.464464 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cadfc9-937b-48b7-8c64-a8e326f550da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:25.467860 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedb563-9f7d-44ed-bd86-76236e4311ee None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:25.493797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cadfc9-937b-48b7-8c64-a8e326f550da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-71cadfc9-937b-48b7-8c64-a8e326f550da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:25.507513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:25.508544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:25.509392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:25.509392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:25.509392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:25.509392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:25.509392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:25.509392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:25.509392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:25.509392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:25.509392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:25.509392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:25.509392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:25.509392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:25.512224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 191/386] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:25.518304 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cadfc9-937b-48b7-8c64-a8e326f550da None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:25.567619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:25.597684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedb563-9f7d-44ed-bd86-76236e4311ee None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:25.647943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edb6d1-1d1e-46e6-9403-d2ec77af4aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:25.649537 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edb6d1-1d1e-46e6-9403-d2ec77af4aab None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:25.650054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edb6d1-1d1e-46e6-9403-d2ec77af4aab None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:25.650523 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2edb6d1-1d1e-46e6-9403-d2ec77af4aab None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:25.651908 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edb6d1-1d1e-46e6-9403-d2ec77af4aab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:25.652438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edb6d1-1d1e-46e6-9403-d2ec77af4aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:25.654582 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2edb6d1-1d1e-46e6-9403-d2ec77af4aab None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:25.670327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 196/387] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:25.681857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edb6d1-1d1e-46e6-9403-d2ec77af4aab None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:25.695267 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cadfc9-937b-48b7-8c64-a8e326f550da None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:25.712584 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:25.740579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfe1c7-48f0-4290-9e36-b180abc16901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:25.742036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfe1c7-48f0-4290-9e36-b180abc16901 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:25.742463 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfe1c7-48f0-4290-9e36-b180abc16901 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:25.742836 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfe1c7-48f0-4290-9e36-b180abc16901 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:25.743734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfe1c7-48f0-4290-9e36-b180abc16901 None admin] RBAC: Adding query filter params (name=member) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:25.744142 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfe1c7-48f0-4290-9e36-b180abc16901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:25.745893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfe1c7-48f0-4290-9e36-b180abc16901 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:25.755974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 192/388] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:25.762080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfe1c7-48f0-4290-9e36-b180abc16901 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:25.823659 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2edb6d1-1d1e-46e6-9403-d2ec77af4aab None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:25.868628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfe1c7-48f0-4290-9e36-b180abc16901 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:25.879615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fdc99-40f8-4a18-8444-90759b23ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:25.880716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fdc99-40f8-4a18-8444-90759b23ccea None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:25.881162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fdc99-40f8-4a18-8444-90759b23ccea None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:25.881593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fdc99-40f8-4a18-8444-90759b23ccea None admin] PATH_INFO: `/v3/groups/a50197a60eae4fb294cddfe0eb66cb58` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:25.886404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fdc99-40f8-4a18-8444-90759b23ccea None admin] RBAC: Authorizing `identity:get_group(group_id=a50197a60eae4fb294cddfe0eb66cb58)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:25.888214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fdc99-40f8-4a18-8444-90759b23ccea None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:25.890404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 197/389] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:25 2022] GET /identity/v3/groups/a50197a60eae4fb294cddfe0eb66cb58 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:25.895416 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fdc99-40f8-4a18-8444-90759b23ccea None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:25.905832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890e168-8973-4c75-b323-b2ad7f7fb374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:25.906831 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890e168-8973-4c75-b323-b2ad7f7fb374 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:25.907210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890e168-8973-4c75-b323-b2ad7f7fb374 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:25.907603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890e168-8973-4c75-b323-b2ad7f7fb374 None admin] PATH_INFO: `/v3/groups/a50197a60eae4fb294cddfe0eb66cb58` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:25.908883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890e168-8973-4c75-b323-b2ad7f7fb374 None admin] RBAC: Authorizing `identity:get_group(group_id=a50197a60eae4fb294cddfe0eb66cb58)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:25.910419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890e168-8973-4c75-b323-b2ad7f7fb374 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:25.911797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:25.912591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 193/390] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:25 2022] GET /identity/v3/groups/a50197a60eae4fb294cddfe0eb66cb58 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:25.918804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890e168-8973-4c75-b323-b2ad7f7fb374 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:25.970410 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:26.023371 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fdc99-40f8-4a18-8444-90759b23ccea None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:26.031777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890e168-8973-4c75-b323-b2ad7f7fb374 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:26.061727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfcbae-69d1-4088-b749-6dffc48543bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:26.062902 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfcbae-69d1-4088-b749-6dffc48543bb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:26.063361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfcbae-69d1-4088-b749-6dffc48543bb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:26.063904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfcbae-69d1-4088-b749-6dffc48543bb None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:26.065341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfcbae-69d1-4088-b749-6dffc48543bb None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:26.067091 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfcbae-69d1-4088-b749-6dffc48543bb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:26.068012 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aadf8-a019-4ec5-9618-f30c7ce21a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:26.068979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aadf8-a019-4ec5-9618-f30c7ce21a59 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:26.069334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aadf8-a019-4ec5-9618-f30c7ce21a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:26.069680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aadf8-a019-4ec5-9618-f30c7ce21a59 None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:26.070362 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 198/391] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:25 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:26.071210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6aadf8-a019-4ec5-9618-f30c7ce21a59 None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:26.073601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6aadf8-a019-4ec5-9618-f30c7ce21a59 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:26.075783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfcbae-69d1-4088-b749-6dffc48543bb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:26.079667 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 194/392] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:25 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:26.081469 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aadf8-a019-4ec5-9618-f30c7ce21a59 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:26.195858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:26.209152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aadf8-a019-4ec5-9618-f30c7ce21a59 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:26.220576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfcbae-69d1-4088-b749-6dffc48543bb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:26.224339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:26.251653 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d0bc9-43e1-4f4e-8a2f-c4041d1f2522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:26.252632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d0bc9-43e1-4f4e-8a2f-c4041d1f2522 None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:26.252917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d0bc9-43e1-4f4e-8a2f-c4041d1f2522 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:26.254491 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d0bc9-43e1-4f4e-8a2f-c4041d1f2522 None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76/groups/a50197a60eae4fb294cddfe0eb66cb58/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:26.255390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d0bc9-43e1-4f4e-8a2f-c4041d1f2522 None admin] RBAC: Authorizing `identity:create_grant(project_id=16a031f7af0b46f9ae4b92c1457e0e76, group_id=a50197a60eae4fb294cddfe0eb66cb58, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:26.258159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d0bc9-43e1-4f4e-8a2f-c4041d1f2522 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:26.266206 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026a869-96b4-4b67-bb73-468412b54c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:26.267280 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026a869-96b4-4b67-bb73-468412b54c7a None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:26.267730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026a869-96b4-4b67-bb73-468412b54c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:26.268121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026a869-96b4-4b67-bb73-468412b54c7a None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76/groups/a50197a60eae4fb294cddfe0eb66cb58/roles/9c6db94ddc204b7e860aa2a9d622e14b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:26.271273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026a869-96b4-4b67-bb73-468412b54c7a None admin] RBAC: Authorizing `identity:create_grant(project_id=16a031f7af0b46f9ae4b92c1457e0e76, group_id=a50197a60eae4fb294cddfe0eb66cb58, role_id=9c6db94ddc204b7e860aa2a9d622e14b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:26.273804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026a869-96b4-4b67-bb73-468412b54c7a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:26.276959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 195/393] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Jun 15 10:21:26 2022] PUT /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76/groups/a50197a60eae4fb294cddfe0eb66cb58/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:21:26.279031 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8a0fc-32f2-45f0-a171-387b8d525113 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:26.279363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8a0fc-32f2-45f0-a171-387b8d525113 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:26.279745 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8a0fc-32f2-45f0-a171-387b8d525113 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:26.281651 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 196/394] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:26.287228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d42882-c308-4265-a914-405065e5422f None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:26.287634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d42882-c308-4265-a914-405065e5422f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:26.288034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d42882-c308-4265-a914-405065e5422f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:26.292858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 199/395] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Jun 15 10:21:26 2022] PUT /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76/groups/a50197a60eae4fb294cddfe0eb66cb58/roles/9c6db94ddc204b7e860aa2a9d622e14b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:21:26.311576 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-c4d42882-c308-4265-a914-405065e5422f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:26.313211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c4d42882-c308-4265-a914-405065e5422f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:26.402767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 197/396] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:26.442113 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026a869-96b4-4b67-bb73-468412b54c7a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:26.564738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026a869-96b4-4b67-bb73-468412b54c7a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:26.601503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8104395-0f77-4502-a456-1f292cdd89b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:26.602900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104395-0f77-4502-a456-1f292cdd89b7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:26.603661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104395-0f77-4502-a456-1f292cdd89b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:26.604283 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8104395-0f77-4502-a456-1f292cdd89b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:26.607266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:26.620404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8104395-0f77-4502-a456-1f292cdd89b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-a8104395-0f77-4502-a456-1f292cdd89b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:26.628511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:26.629604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:26.630708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:26.630708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:26.630708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:26.630708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:26.630708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:26.630708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:26.630708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:26.630708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:26.630708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:26.630708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:26.630708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:26.630708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:26.637212 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 200/397] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:26.643561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d42882-c308-4265-a914-405065e5422f None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:26.759188 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d42882-c308-4265-a914-405065e5422f None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:26.760840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:26.797136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91abef-0177-42bf-a202-ca2b89ba4a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:26.797925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91abef-0177-42bf-a202-ca2b89ba4a67 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:26.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91abef-0177-42bf-a202-ca2b89ba4a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:26.798934 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91abef-0177-42bf-a202-ca2b89ba4a67 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:26.800068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91abef-0177-42bf-a202-ca2b89ba4a67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:26.800602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91abef-0177-42bf-a202-ca2b89ba4a67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:26.802435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91abef-0177-42bf-a202-ca2b89ba4a67 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:26.812449 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 198/398] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:26.820799 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8104395-0f77-4502-a456-1f292cdd89b7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:26.944362 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8104395-0f77-4502-a456-1f292cdd89b7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:26.992194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fedd7-0a05-4683-a433-61ec5288618d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:26.993630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fedd7-0a05-4683-a433-61ec5288618d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:26.993904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fedd7-0a05-4683-a433-61ec5288618d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:26.994180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fedd7-0a05-4683-a433-61ec5288618d None admin] PATH_INFO: `/v3/groups/a50197a60eae4fb294cddfe0eb66cb58` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:27.000282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fedd7-0a05-4683-a433-61ec5288618d None admin] RBAC: Authorizing `identity:get_group(group_id=a50197a60eae4fb294cddfe0eb66cb58)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:27.001764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fedd7-0a05-4683-a433-61ec5288618d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:27.003797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 201/399] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:26 2022] GET /identity/v3/groups/a50197a60eae4fb294cddfe0eb66cb58 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:27.009437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91abef-0177-42bf-a202-ca2b89ba4a67 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:27.161145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91abef-0177-42bf-a202-ca2b89ba4a67 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:27.206145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f3257-2df3-4b97-8ea4-601003f4b1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:27.206933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3257-2df3-4b97-8ea4-601003f4b1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:27.207202 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3257-2df3-4b97-8ea4-601003f4b1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:27.207494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f3257-2df3-4b97-8ea4-601003f4b1b8 None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:27.208717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f3257-2df3-4b97-8ea4-601003f4b1b8 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:27.210165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f3257-2df3-4b97-8ea4-601003f4b1b8 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:27.212224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 199/400] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:27 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:27.217989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fedd7-0a05-4683-a433-61ec5288618d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:27.320140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:27.376740 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fedd7-0a05-4683-a433-61ec5288618d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:27.426951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2f1a8-5fd6-43d1-b4b6-33442cc99c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:27.427863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2f1a8-5fd6-43d1-b4b6-33442cc99c58 None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:27.428146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2f1a8-5fd6-43d1-b4b6-33442cc99c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:27.428417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2f1a8-5fd6-43d1-b4b6-33442cc99c58 None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb/groups/a50197a60eae4fb294cddfe0eb66cb58/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:27.430945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2f1a8-5fd6-43d1-b4b6-33442cc99c58 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2e9da0fae424c80aea374ac5ff2cefb, group_id=a50197a60eae4fb294cddfe0eb66cb58, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:27.432390 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2f1a8-5fd6-43d1-b4b6-33442cc99c58 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:27.469597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 202/401] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Jun 15 10:21:27 2022] PUT /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb/groups/a50197a60eae4fb294cddfe0eb66cb58/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:21:27.984831 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408004-1970-46ac-9c01-757f43037ed7 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:27.985164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408004-1970-46ac-9c01-757f43037ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:27.985385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56408004-1970-46ac-9c01-757f43037ed7 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:27.987006 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 200/402] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:28.001489 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f665f-fd20-43e2-9bf1-a69284eea639 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:28.001780 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f665f-fd20-43e2-9bf1-a69284eea639 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:28.002061 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f665f-fd20-43e2-9bf1-a69284eea639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:28.023495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-744f665f-fd20-43e2-9bf1-a69284eea639 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:28.024725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-744f665f-fd20-43e2-9bf1-a69284eea639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:28.115793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 203/403] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:28.151929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ea80-af2f-4b65-8adc-0ceb15e57e2c None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:28.152221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ea80-af2f-4b65-8adc-0ceb15e57e2c None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:28.152487 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ea80-af2f-4b65-8adc-0ceb15e57e2c None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:28.153870 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 201/404] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:28.157918 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f665f-fd20-43e2-9bf1-a69284eea639 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:28.159737 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f771a4-9401-45b2-9732-aaa53e5457a2 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:28.160048 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f771a4-9401-45b2-9732-aaa53e5457a2 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:28.160301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f771a4-9401-45b2-9732-aaa53e5457a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:28.191157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-d2f771a4-9401-45b2-9732-aaa53e5457a2 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:28.192402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d2f771a4-9401-45b2-9732-aaa53e5457a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:28.251359 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:28.269177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:28.330948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 202/405] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:28.346815 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f665f-fd20-43e2-9bf1-a69284eea639 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:28.369305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f771a4-9401-45b2-9732-aaa53e5457a2 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:28.394399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f66e0-4846-45c1-8063-e48d4db32e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:28.395596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f66e0-4846-45c1-8063-e48d4db32e01 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:28.396090 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f66e0-4846-45c1-8063-e48d4db32e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:28.396550 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f66e0-4846-45c1-8063-e48d4db32e01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:28.414905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f66e0-4846-45c1-8063-e48d4db32e01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-d76f66e0-4846-45c1-8063-e48d4db32e01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:28.428556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:28.429498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:28.430962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:28.430962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:28.430962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:28.430962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:28.430962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:28.430962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:28.430962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:28.430962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:28.430962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:28.430962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:28.430962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:28.430962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:28.438262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 204/406] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:21:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:28.439997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f66e0-4846-45c1-8063-e48d4db32e01 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:28.499493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f771a4-9401-45b2-9732-aaa53e5457a2 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:28.560276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cde7ad-668b-4924-b82b-307bdaae8821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:28.561023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cde7ad-668b-4924-b82b-307bdaae8821 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:28.561279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cde7ad-668b-4924-b82b-307bdaae8821 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:28.561544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cde7ad-668b-4924-b82b-307bdaae8821 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:28.592389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cde7ad-668b-4924-b82b-307bdaae8821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:28.592615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f66e0-4846-45c1-8063-e48d4db32e01 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-f2cde7ad-668b-4924-b82b-307bdaae8821 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:28.600175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:28.601101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:28.602865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:28.602865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:28.602865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:28.602865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:28.602865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:28.602865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:28.602865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:28.602865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:28.602865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:28.602865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:28.602865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:21:28.602865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:28.602865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 203/407] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:21:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:28.608002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cde7ad-668b-4924-b82b-307bdaae8821 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:28.615164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:28.646787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e250ec8-669e-4337-bccd-d4aa2fe3d0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:28.647490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e250ec8-669e-4337-bccd-d4aa2fe3d0be None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:28.647817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e250ec8-669e-4337-bccd-d4aa2fe3d0be None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:28.648093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e250ec8-669e-4337-bccd-d4aa2fe3d0be None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:28.649393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e250ec8-669e-4337-bccd-d4aa2fe3d0be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:28.650009 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e250ec8-669e-4337-bccd-d4aa2fe3d0be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:28.651478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e250ec8-669e-4337-bccd-d4aa2fe3d0be None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:28.674580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 205/408] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:28.679800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:28.680746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e250ec8-669e-4337-bccd-d4aa2fe3d0be None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:28.845483 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cde7ad-668b-4924-b82b-307bdaae8821 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:28.858664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e250ec8-669e-4337-bccd-d4aa2fe3d0be None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:28.921079 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fc413-98f0-4489-93b9-843578bc882f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:28.923184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fc413-98f0-4489-93b9-843578bc882f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:28.923483 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fc413-98f0-4489-93b9-843578bc882f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:28.923762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fc413-98f0-4489-93b9-843578bc882f None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:28.924526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fc413-98f0-4489-93b9-843578bc882f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:28.924834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fc413-98f0-4489-93b9-843578bc882f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:28.926223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fc413-98f0-4489-93b9-843578bc882f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:28.929233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f9293-6277-41e1-8e54-6628ac2c0647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:28.930123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f9293-6277-41e1-8e54-6628ac2c0647 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:28.930405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f9293-6277-41e1-8e54-6628ac2c0647 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:28.930675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f9293-6277-41e1-8e54-6628ac2c0647 None admin] PATH_INFO: `/v3/groups/a50197a60eae4fb294cddfe0eb66cb58` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:28.931970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f9293-6277-41e1-8e54-6628ac2c0647 None admin] RBAC: Authorizing `identity:get_group(group_id=a50197a60eae4fb294cddfe0eb66cb58)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:28.933740 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f9293-6277-41e1-8e54-6628ac2c0647 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:28.939243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 206/409] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:28 2022] GET /identity/v3/groups/a50197a60eae4fb294cddfe0eb66cb58 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:28.940660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b53f-d9bc-47d3-b496-f491f3395478 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:28.940952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b53f-d9bc-47d3-b496-f491f3395478 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:28.941230 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b53f-d9bc-47d3-b496-f491f3395478 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:28.944201 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 207/410] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:28.944951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b53f-d9bc-47d3-b496-f491f3395478 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:28.947208 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 204/411] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:28.955417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2f5e7-0e27-4185-b3fe-f522509643da None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:28.955729 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2f5e7-0e27-4185-b3fe-f522509643da None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:28.956007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2f5e7-0e27-4185-b3fe-f522509643da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:28.976476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8fd2f5e7-0e27-4185-b3fe-f522509643da None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:28.979280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8fd2f5e7-0e27-4185-b3fe-f522509643da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:29.004554 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:29.056416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 205/412] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:29.057297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2f5e7-0e27-4185-b3fe-f522509643da None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:29.068687 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b53f-d9bc-47d3-b496-f491f3395478 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:29.084371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:29.120144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afc901-b543-4502-9731-3de7bf09b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:29.120936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afc901-b543-4502-9731-3de7bf09b38d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:29.121216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afc901-b543-4502-9731-3de7bf09b38d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:29.121489 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afc901-b543-4502-9731-3de7bf09b38d None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:29.122728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afc901-b543-4502-9731-3de7bf09b38d None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:29.124261 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afc901-b543-4502-9731-3de7bf09b38d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:29.126365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 208/413] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:28 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:29.127012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afc901-b543-4502-9731-3de7bf09b38d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:29.198943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2f5e7-0e27-4185-b3fe-f522509643da None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:29.233821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b712f1-61ae-4100-a271-b3101443f5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:29.234673 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b712f1-61ae-4100-a271-b3101443f5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:29.234954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b712f1-61ae-4100-a271-b3101443f5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:29.235231 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b712f1-61ae-4100-a271-b3101443f5b8 None admin] PATH_INFO: `/v3/groups/726ae218b1d74f258c9efcc1d3c57c08` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:29.236434 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b712f1-61ae-4100-a271-b3101443f5b8 None admin] RBAC: Authorizing `identity:get_group(group_id=726ae218b1d74f258c9efcc1d3c57c08)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:29.237887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b712f1-61ae-4100-a271-b3101443f5b8 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:29.239603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 206/414] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:29 2022] GET /identity/v3/groups/726ae218b1d74f258c9efcc1d3c57c08 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:29.240393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b712f1-61ae-4100-a271-b3101443f5b8 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:29.241501 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afc901-b543-4502-9731-3de7bf09b38d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:29.257699 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:29.284846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661a7c5-c2b2-4381-8511-c5ce0a06f9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:29.285648 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661a7c5-c2b2-4381-8511-c5ce0a06f9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:29.285928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661a7c5-c2b2-4381-8511-c5ce0a06f9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:29.286199 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661a7c5-c2b2-4381-8511-c5ce0a06f9d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:29.298473 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661a7c5-c2b2-4381-8511-c5ce0a06f9d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-4661a7c5-c2b2-4381-8511-c5ce0a06f9d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:29.306553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:29.307518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:29.308369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:29.308369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:29.308369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:29.308369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:29.308369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:29.308369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:29.308369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:29.308369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:29.308369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:29.308369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:29.308369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:29.308369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:29.308369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 209/415] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:21:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:29.309152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc42f19-e473-450e-b6db-fc7b046a76d9 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:29.309865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc42f19-e473-450e-b6db-fc7b046a76d9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:29.309865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc42f19-e473-450e-b6db-fc7b046a76d9 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:29.310808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 210/416] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:29.316103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc42f19-e473-450e-b6db-fc7b046a76d9 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:29.342529 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:29.361796 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b712f1-61ae-4100-a271-b3101443f5b8 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:29.404283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849b58f-a288-46c2-ab7e-f8ab5a5a100c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:29.405076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849b58f-a288-46c2-ab7e-f8ab5a5a100c None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:29.405617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849b58f-a288-46c2-ab7e-f8ab5a5a100c None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:29.405725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849b58f-a288-46c2-ab7e-f8ab5a5a100c None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb/groups/a50197a60eae4fb294cddfe0eb66cb58/roles/9c6db94ddc204b7e860aa2a9d622e14b` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:29.408156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849b58f-a288-46c2-ab7e-f8ab5a5a100c None admin] RBAC: Authorizing `identity:create_grant(project_id=d2e9da0fae424c80aea374ac5ff2cefb, group_id=a50197a60eae4fb294cddfe0eb66cb58, role_id=9c6db94ddc204b7e860aa2a9d622e14b)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:29.409709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849b58f-a288-46c2-ab7e-f8ab5a5a100c None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:29.423316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 207/417] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Jun 15 10:21:29 2022] PUT /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb/groups/a50197a60eae4fb294cddfe0eb66cb58/roles/9c6db94ddc204b7e860aa2a9d622e14b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:21:29.424002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849b58f-a288-46c2-ab7e-f8ab5a5a100c None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:29.436213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc42f19-e473-450e-b6db-fc7b046a76d9 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:29.478814 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675ecb2-8e48-44b7-b299-1e83be98ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:29.479774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675ecb2-8e48-44b7-b299-1e83be98ce10 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:29.480066 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675ecb2-8e48-44b7-b299-1e83be98ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:29.480454 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675ecb2-8e48-44b7-b299-1e83be98ce10 None admin] PATH_INFO: `/v3/projects/e426bab74fde45f595bae4efed952751` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:29.482022 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675ecb2-8e48-44b7-b299-1e83be98ce10 None admin] RBAC: Authorizing `identity:get_project(project_id=e426bab74fde45f595bae4efed952751)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:29.484367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675ecb2-8e48-44b7-b299-1e83be98ce10 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:29.485803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 211/418] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:29 2022] GET /identity/v3/projects/e426bab74fde45f595bae4efed952751 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:29.492106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b21b8-fe27-4fb0-b3af-ffa625ea3af4 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:29.492959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b21b8-fe27-4fb0-b3af-ffa625ea3af4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:29.493255 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b21b8-fe27-4fb0-b3af-ffa625ea3af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:29.513750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e03b21b8-fe27-4fb0-b3af-ffa625ea3af4 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:29.515120 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e03b21b8-fe27-4fb0-b3af-ffa625ea3af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:29.557619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:29.569862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849b58f-a288-46c2-ab7e-f8ab5a5a100c None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:29.613127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b81e5-6aff-4e13-8588-8b0e91aa8473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:29.613778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b81e5-6aff-4e13-8588-8b0e91aa8473 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:29.614063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b81e5-6aff-4e13-8588-8b0e91aa8473 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:29.614339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b81e5-6aff-4e13-8588-8b0e91aa8473 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:29.619271 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 212/419] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:29.619394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b81e5-6aff-4e13-8588-8b0e91aa8473 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:29.619394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b81e5-6aff-4e13-8588-8b0e91aa8473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:29.619577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b21b8-fe27-4fb0-b3af-ffa625ea3af4 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:29.619667 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b81e5-6aff-4e13-8588-8b0e91aa8473 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:29.630782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 208/420] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:29.637087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b81e5-6aff-4e13-8588-8b0e91aa8473 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:29.641162 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:29.766399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b21b8-fe27-4fb0-b3af-ffa625ea3af4 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:29.771755 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b81e5-6aff-4e13-8588-8b0e91aa8473 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:29.816002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4702d-d041-443c-a949-4a704c278e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:29.816891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4702d-d041-443c-a949-4a704c278e36 None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:29.817169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4702d-d041-443c-a949-4a704c278e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:29.817433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4702d-d041-443c-a949-4a704c278e36 None admin] PATH_INFO: `/v3/projects/e426bab74fde45f595bae4efed952751/groups/726ae218b1d74f258c9efcc1d3c57c08/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:29.818805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47153460-afa9-40e1-b0a7-8d97482170c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:29.819440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47153460-afa9-40e1-b0a7-8d97482170c2 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:29.819735 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47153460-afa9-40e1-b0a7-8d97482170c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:29.820002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47153460-afa9-40e1-b0a7-8d97482170c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:29.822107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4702d-d041-443c-a949-4a704c278e36 None admin] RBAC: Authorizing `identity:create_grant(project_id=e426bab74fde45f595bae4efed952751, group_id=726ae218b1d74f258c9efcc1d3c57c08, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:29.823617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4702d-d041-443c-a949-4a704c278e36 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:29.847818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 213/421] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Jun 15 10:21:29 2022] PUT /identity/v3/projects/e426bab74fde45f595bae4efed952751/groups/726ae218b1d74f258c9efcc1d3c57c08/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:21:29.849541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4702d-d041-443c-a949-4a704c278e36 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:29.898999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:29.901044 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47153460-afa9-40e1-b0a7-8d97482170c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:29.902823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47153460-afa9-40e1-b0a7-8d97482170c2 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:29.907008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:30.059135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4702d-d041-443c-a949-4a704c278e36 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:30.087533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 209/422] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:30.094041 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47153460-afa9-40e1-b0a7-8d97482170c2 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:30.119762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208ee38-d10f-460f-b6c7-eefcb450ca22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:30.120913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208ee38-d10f-460f-b6c7-eefcb450ca22 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:30.121399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208ee38-d10f-460f-b6c7-eefcb450ca22 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:30.121878 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208ee38-d10f-460f-b6c7-eefcb450ca22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:30.133926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208ee38-d10f-460f-b6c7-eefcb450ca22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-e208ee38-d10f-460f-b6c7-eefcb450ca22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:30.141998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:30.143002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:30.143919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:30.143919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:30.143919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:30.143919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:30.143919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:30.143919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:30.143919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:30.143919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:30.143919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:30.143919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:30.143919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:30.143919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:30.151850 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 214/423] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:30.153771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208ee38-d10f-460f-b6c7-eefcb450ca22 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:30.243527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47153460-afa9-40e1-b0a7-8d97482170c2 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:30.247685 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:30.303894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:30.321559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9a20d-c934-4086-ae9d-3791bb1ad22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:30.322344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9a20d-c934-4086-ae9d-3791bb1ad22f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:30.322628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9a20d-c934-4086-ae9d-3791bb1ad22f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:30.322905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9a20d-c934-4086-ae9d-3791bb1ad22f None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:30.324836 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9a20d-c934-4086-ae9d-3791bb1ad22f None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:30.326300 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9a20d-c934-4086-ae9d-3791bb1ad22f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:30.330257 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208ee38-d10f-460f-b6c7-eefcb450ca22 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:30.332131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 210/424] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:30 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:30.333645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9a20d-c934-4086-ae9d-3791bb1ad22f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:30.393088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb949c3-fc27-4ee4-81cd-157413928a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:30.394233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb949c3-fc27-4ee4-81cd-157413928a5c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:30.394821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb949c3-fc27-4ee4-81cd-157413928a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:30.395302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb949c3-fc27-4ee4-81cd-157413928a5c None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:30.396290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb949c3-fc27-4ee4-81cd-157413928a5c None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:30.396845 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb949c3-fc27-4ee4-81cd-157413928a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:30.398441 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb949c3-fc27-4ee4-81cd-157413928a5c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:30.408716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 215/425] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:30.414620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ad531-96de-418c-a887-1eea6aac7401 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:30.415580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ad531-96de-418c-a887-1eea6aac7401 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:30.416110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ad531-96de-418c-a887-1eea6aac7401 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:30.417978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 216/426] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:30.418991 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ad531-96de-418c-a887-1eea6aac7401 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:30.483213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9a20d-c934-4086-ae9d-3791bb1ad22f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:30.529092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1450d-9c11-4374-9db7-fa3ae5eeb738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:30.530210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1450d-9c11-4374-9db7-fa3ae5eeb738 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:30.530489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1450d-9c11-4374-9db7-fa3ae5eeb738 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:30.530784 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1450d-9c11-4374-9db7-fa3ae5eeb738 None admin] PATH_INFO: `/v3/groups/a50197a60eae4fb294cddfe0eb66cb58` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:30.532649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1450d-9c11-4374-9db7-fa3ae5eeb738 None admin] RBAC: Authorizing `identity:get_group(group_id=a50197a60eae4fb294cddfe0eb66cb58)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:30.534087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1450d-9c11-4374-9db7-fa3ae5eeb738 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:30.535409 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ad531-96de-418c-a887-1eea6aac7401 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:30.540914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 211/427] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:30 2022] GET /identity/v3/groups/a50197a60eae4fb294cddfe0eb66cb58 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:30.540914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b387716-3047-4fae-96ca-92281b742807 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:30.540914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b387716-3047-4fae-96ca-92281b742807 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:30.540914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b387716-3047-4fae-96ca-92281b742807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:30.562396 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-9b387716-3047-4fae-96ca-92281b742807 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:30.564015 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-9b387716-3047-4fae-96ca-92281b742807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:30.579039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f2d93-9e6d-4177-9bdb-911463eb69ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:30.579644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f2d93-9e6d-4177-9bdb-911463eb69ce None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:30.579925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f2d93-9e6d-4177-9bdb-911463eb69ce None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:30.580198 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f2d93-9e6d-4177-9bdb-911463eb69ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:30.600244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:30.605535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:30.650718 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 212/428] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:30.651928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b387716-3047-4fae-96ca-92281b742807 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:30.655868 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f2d93-9e6d-4177-9bdb-911463eb69ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:30.657342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f2d93-9e6d-4177-9bdb-911463eb69ce None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:30.770213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 217/429] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:30.770213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f2d93-9e6d-4177-9bdb-911463eb69ce None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:30.786254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b387716-3047-4fae-96ca-92281b742807 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:30.822147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e73044-f8b5-473f-bb8b-437d2f026a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:30.823181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e73044-f8b5-473f-bb8b-437d2f026a1e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:30.823695 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e73044-f8b5-473f-bb8b-437d2f026a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:30.824175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e73044-f8b5-473f-bb8b-437d2f026a1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:30.825213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e73044-f8b5-473f-bb8b-437d2f026a1e None admin] RBAC: Adding query filter params (group.id=a50197a60eae4fb294cddfe0eb66cb58, role.id=9c6db94ddc204b7e860aa2a9d622e14b, scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:30.825747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e73044-f8b5-473f-bb8b-437d2f026a1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:30.827388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e73044-f8b5-473f-bb8b-437d2f026a1e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:30.827899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:30.840047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 213/430] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Jun 15 10:21:30 2022] GET /identity/v3/role_assignments?group.id=a50197a60eae4fb294cddfe0eb66cb58&scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76&role.id=9c6db94ddc204b7e860aa2a9d622e14b => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:30.841319 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e73044-f8b5-473f-bb8b-437d2f026a1e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:30.875494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f2d93-9e6d-4177-9bdb-911463eb69ce None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:30.915605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:30.920372 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9c028-5ceb-4792-b831-b1caea70f2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:30.923804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c028-5ceb-4792-b831-b1caea70f2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:30.924098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c028-5ceb-4792-b831-b1caea70f2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:30.924368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c028-5ceb-4792-b831-b1caea70f2f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:30.945799 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9c028-5ceb-4792-b831-b1caea70f2f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-0fe9c028-5ceb-4792-b831-b1caea70f2f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:30.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:30.954678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:30.955640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:30.955640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:30.955640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:30.955640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:30.955640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:30.955640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:30.955640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:30.955640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:30.955640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:30.955640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:30.955640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 10:21:30.955640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:30.955640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 218/431] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:30.963784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9c028-5ceb-4792-b831-b1caea70f2f1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:31.084433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e73044-f8b5-473f-bb8b-437d2f026a1e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:31.085104 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9c028-5ceb-4792-b831-b1caea70f2f1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:31.100905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:31.124105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb54888-3dbc-4b68-b484-3760cff111be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:31.125108 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb54888-3dbc-4b68-b484-3760cff111be None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:31.125389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb54888-3dbc-4b68-b484-3760cff111be None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:31.125659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb54888-3dbc-4b68-b484-3760cff111be None admin] PATH_INFO: `/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:31.126244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd284b-5690-4e07-880d-390c34742910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:31.126847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb54888-3dbc-4b68-b484-3760cff111be None admin] RBAC: Authorizing `identity:get_project(project_id=16a031f7af0b46f9ae4b92c1457e0e76)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:31.127365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd284b-5690-4e07-880d-390c34742910 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:31.127979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd284b-5690-4e07-880d-390c34742910 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:31.128459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd284b-5690-4e07-880d-390c34742910 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:31.128575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb54888-3dbc-4b68-b484-3760cff111be None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:31.129516 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd284b-5690-4e07-880d-390c34742910 None admin] RBAC: Adding query filter params (name=member) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:31.130024 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd284b-5690-4e07-880d-390c34742910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:31.130143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 214/432] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:30 2022] GET /identity/v3/projects/16a031f7af0b46f9ae4b92c1457e0e76 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:31.132009 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd284b-5690-4e07-880d-390c34742910 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:31.141468 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb54888-3dbc-4b68-b484-3760cff111be None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:31.149224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 219/433] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:21:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:31.156399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd284b-5690-4e07-880d-390c34742910 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:31.274866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb54888-3dbc-4b68-b484-3760cff111be None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:31.275635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:31.291113 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd284b-5690-4e07-880d-390c34742910 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:31.323449 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7ad3c-c355-4b6a-bbdb-dfdb6fcad203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:31.325214 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7ad3c-c355-4b6a-bbdb-dfdb6fcad203 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:31.325639 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7ad3c-c355-4b6a-bbdb-dfdb6fcad203 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:31.326093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7ad3c-c355-4b6a-bbdb-dfdb6fcad203 None admin] PATH_INFO: `/v3/groups/a50197a60eae4fb294cddfe0eb66cb58` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:31.327442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7ad3c-c355-4b6a-bbdb-dfdb6fcad203 None admin] RBAC: Authorizing `identity:get_group(group_id=a50197a60eae4fb294cddfe0eb66cb58)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:31.329008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e7ad4-eb66-4a82-9643-5a1a6772f7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:31.329573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7ad3c-c355-4b6a-bbdb-dfdb6fcad203 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:31.329844 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e7ad4-eb66-4a82-9643-5a1a6772f7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:31.330215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e7ad4-eb66-4a82-9643-5a1a6772f7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:31.330582 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e7ad4-eb66-4a82-9643-5a1a6772f7c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:31.336818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 215/434] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:31 2022] GET /identity/v3/groups/a50197a60eae4fb294cddfe0eb66cb58 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:31.337551 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7ad3c-c355-4b6a-bbdb-dfdb6fcad203 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:31.383881 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:31.425473 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e7ad4-eb66-4a82-9643-5a1a6772f7c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:31.427840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e7ad4-eb66-4a82-9643-5a1a6772f7c4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:31.461158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7ad3c-c355-4b6a-bbdb-dfdb6fcad203 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:31.498272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73b643-b2f2-4189-b0f5-87efe91d096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:31.499032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73b643-b2f2-4189-b0f5-87efe91d096b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:31.499264 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73b643-b2f2-4189-b0f5-87efe91d096b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:31.499573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73b643-b2f2-4189-b0f5-87efe91d096b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:31.500422 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73b643-b2f2-4189-b0f5-87efe91d096b None admin] RBAC: Adding query filter params (group.id=a50197a60eae4fb294cddfe0eb66cb58, role.id=484f610225884740911a5c3333f22221, scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:31.500846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73b643-b2f2-4189-b0f5-87efe91d096b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:31.502117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73b643-b2f2-4189-b0f5-87efe91d096b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:31.515494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 216/435] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Jun 15 10:21:31 2022] GET /identity/v3/role_assignments?group.id=a50197a60eae4fb294cddfe0eb66cb58&scope.project.id=16a031f7af0b46f9ae4b92c1457e0e76&role.id=484f610225884740911a5c3333f22221 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:31.567599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 220/436] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:31.573770 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73b643-b2f2-4189-b0f5-87efe91d096b None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:31.615802 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:31.677032 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302f552-30ad-4420-803c-4a77ef5cd376 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:31.677339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302f552-30ad-4420-803c-4a77ef5cd376 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:31.677580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302f552-30ad-4420-803c-4a77ef5cd376 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:31.679204 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 221/437] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:21:31.685437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5064e2b-3508-43b6-ad56-99c0e3a596a3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:31.686030 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5064e2b-3508-43b6-ad56-99c0e3a596a3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:31.686556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5064e2b-3508-43b6-ad56-99c0e3a596a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:31.696976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73b643-b2f2-4189-b0f5-87efe91d096b None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:31.704958 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e5064e2b-3508-43b6-ad56-99c0e3a596a3 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:31.706471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e5064e2b-3508-43b6-ad56-99c0e3a596a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:31.747449 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e5dd1-1bf8-4f60-8545-38f554c6f197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:31.748343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e5dd1-1bf8-4f60-8545-38f554c6f197 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:31.748626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e5dd1-1bf8-4f60-8545-38f554c6f197 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:31.748891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e5dd1-1bf8-4f60-8545-38f554c6f197 None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:31.750101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e5dd1-1bf8-4f60-8545-38f554c6f197 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:31.751598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e5dd1-1bf8-4f60-8545-38f554c6f197 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:31.753596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 217/438] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:31 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:31.760346 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e5dd1-1bf8-4f60-8545-38f554c6f197 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:31.801624 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 222/439] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:31.827103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5064e2b-3508-43b6-ad56-99c0e3a596a3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:31.829313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:31.894250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e5dd1-1bf8-4f60-8545-38f554c6f197 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:31.895914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:31.944821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a04796-d8e8-4a11-b244-f7a41e76e3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:31.946182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a04796-d8e8-4a11-b244-f7a41e76e3fb None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:31.946459 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a04796-d8e8-4a11-b244-f7a41e76e3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:31.946728 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a04796-d8e8-4a11-b244-f7a41e76e3fb None admin] PATH_INFO: `/v3/groups/a50197a60eae4fb294cddfe0eb66cb58` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:31.948040 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a04796-d8e8-4a11-b244-f7a41e76e3fb None admin] RBAC: Authorizing `identity:get_group(group_id=a50197a60eae4fb294cddfe0eb66cb58)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:31.949703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a04796-d8e8-4a11-b244-f7a41e76e3fb None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:31.951514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 218/440] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:31 2022] GET /identity/v3/groups/a50197a60eae4fb294cddfe0eb66cb58 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:31.957059 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a04796-d8e8-4a11-b244-f7a41e76e3fb None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:31.970390 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5064e2b-3508-43b6-ad56-99c0e3a596a3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:32.015142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b47fb8-71cb-46db-a62f-7943ae27aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:32.015797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b47fb8-71cb-46db-a62f-7943ae27aea3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:32.016078 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b47fb8-71cb-46db-a62f-7943ae27aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:32.016350 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b47fb8-71cb-46db-a62f-7943ae27aea3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:32.036598 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b47fb8-71cb-46db-a62f-7943ae27aea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-37b47fb8-71cb-46db-a62f-7943ae27aea3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:32.045724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:32.046684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:32.047566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:32.047566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:32.047566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:32.047566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:32.047566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:32.047566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:32.047566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:32.047566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:32.047566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:32.047566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:32.047566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:32.047566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:32.050119 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 223/441] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:21:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:32.056777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b47fb8-71cb-46db-a62f-7943ae27aea3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:32.091590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a04796-d8e8-4a11-b244-f7a41e76e3fb None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:32.131778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a8ce2-5cb4-4fd6-a0c6-33f09758039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:32.132826 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a8ce2-5cb4-4fd6-a0c6-33f09758039f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:32.133842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a8ce2-5cb4-4fd6-a0c6-33f09758039f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:32.134305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a8ce2-5cb4-4fd6-a0c6-33f09758039f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:32.135395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a8ce2-5cb4-4fd6-a0c6-33f09758039f None admin] RBAC: Adding query filter params (group.id=a50197a60eae4fb294cddfe0eb66cb58, role.id=484f610225884740911a5c3333f22221, scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:32.135924 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a8ce2-5cb4-4fd6-a0c6-33f09758039f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:32.137550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a8ce2-5cb4-4fd6-a0c6-33f09758039f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:32.137659 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:32.144827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 219/442] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Jun 15 10:21:31 2022] GET /identity/v3/role_assignments?group.id=a50197a60eae4fb294cddfe0eb66cb58&scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb&role.id=484f610225884740911a5c3333f22221 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:32.177019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b47fb8-71cb-46db-a62f-7943ae27aea3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:32.220689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c6738-6595-44a2-b697-441ea3032a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:32.221306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c6738-6595-44a2-b697-441ea3032a68 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:32.221588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c6738-6595-44a2-b697-441ea3032a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:32.221865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c6738-6595-44a2-b697-441ea3032a68 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:32.222628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c6738-6595-44a2-b697-441ea3032a68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:32.222940 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c6738-6595-44a2-b697-441ea3032a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:32.224391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c6738-6595-44a2-b697-441ea3032a68 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:32.234301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 224/443] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:32.240176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a8ce2-5cb4-4fd6-a0c6-33f09758039f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:32.262024 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf41f-795e-4ac9-b714-144211b805a1 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:32.262308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf41f-795e-4ac9-b714-144211b805a1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:32.262834 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf41f-795e-4ac9-b714-144211b805a1 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:32.264487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 225/444] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:32.270636 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6927-4c24-4034-a623-8e05675ff950 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:32.270932 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6927-4c24-4034-a623-8e05675ff950 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:32.271192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6927-4c24-4034-a623-8e05675ff950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:32.283203 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:32.289063 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-317b6927-4c24-4034-a623-8e05675ff950 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:32.290312 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-317b6927-4c24-4034-a623-8e05675ff950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:32.358599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a8ce2-5cb4-4fd6-a0c6-33f09758039f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:32.368407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 226/445] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:32.392534 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b6927-4c24-4034-a623-8e05675ff950 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:32.401392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd6576-6e7a-490f-a8f2-a60acc302580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:32.402041 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd6576-6e7a-490f-a8f2-a60acc302580 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:32.402321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd6576-6e7a-490f-a8f2-a60acc302580 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:32.402592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd6576-6e7a-490f-a8f2-a60acc302580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:32.458836 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:32.489609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd6576-6e7a-490f-a8f2-a60acc302580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:32.491611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd6576-6e7a-490f-a8f2-a60acc302580 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:32.515087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b6927-4c24-4034-a623-8e05675ff950 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:32.533518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:32.559771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc0d9a-7d47-45e5-b77e-761ac4716db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:32.560570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc0d9a-7d47-45e5-b77e-761ac4716db0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:32.560848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc0d9a-7d47-45e5-b77e-761ac4716db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:32.561122 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc0d9a-7d47-45e5-b77e-761ac4716db0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:32.572192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc0d9a-7d47-45e5-b77e-761ac4716db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-1ddc0d9a-7d47-45e5-b77e-761ac4716db0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:32.579827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:32.580953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:32.586497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:32.586497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:32.586497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:32.586497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:32.586497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:32.586497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:32.586497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:32.586497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:32.586497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:32.586497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:32.586497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:21:32.586497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:32.586497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 227/446] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:21:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:32.587311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc0d9a-7d47-45e5-b77e-761ac4716db0 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:32.610432 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 220/447] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:32.616061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd6576-6e7a-490f-a8f2-a60acc302580 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:32.696523 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc0d9a-7d47-45e5-b77e-761ac4716db0 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:32.712190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:32.721612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd6576-6e7a-490f-a8f2-a60acc302580 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:32.733662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e193239-67b2-48b8-9325-19bb5a95a6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:32.734320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e193239-67b2-48b8-9325-19bb5a95a6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:32.734615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e193239-67b2-48b8-9325-19bb5a95a6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:32.734876 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e193239-67b2-48b8-9325-19bb5a95a6f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:32.735644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e193239-67b2-48b8-9325-19bb5a95a6f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:32.735950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e193239-67b2-48b8-9325-19bb5a95a6f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:32.737302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e193239-67b2-48b8-9325-19bb5a95a6f5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:32.746217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 228/448] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:32.751741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e193239-67b2-48b8-9325-19bb5a95a6f5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:32.756979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef5fa8-048c-4c68-a990-e897fd38e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:32.757837 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef5fa8-048c-4c68-a990-e897fd38e804 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:32.758145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef5fa8-048c-4c68-a990-e897fd38e804 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:32.758416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef5fa8-048c-4c68-a990-e897fd38e804 None admin] PATH_INFO: `/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:32.759625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef5fa8-048c-4c68-a990-e897fd38e804 None admin] RBAC: Authorizing `identity:get_project(project_id=d2e9da0fae424c80aea374ac5ff2cefb)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:32.761082 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef5fa8-048c-4c68-a990-e897fd38e804 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:32.762805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 221/449] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:32 2022] GET /identity/v3/projects/d2e9da0fae424c80aea374ac5ff2cefb => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:32.767936 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef5fa8-048c-4c68-a990-e897fd38e804 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:32.770437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:32.849961 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e193239-67b2-48b8-9325-19bb5a95a6f5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:32.864985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef5fa8-048c-4c68-a990-e897fd38e804 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:32.883142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88cf3b-ed72-47e5-9c27-db98dcc1ef2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:32.883809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88cf3b-ed72-47e5-9c27-db98dcc1ef2b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:32.884096 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88cf3b-ed72-47e5-9c27-db98dcc1ef2b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:32.884373 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88cf3b-ed72-47e5-9c27-db98dcc1ef2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:32.899089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116ca4c-feae-4793-90aa-c7610309eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:32.899945 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ca4c-feae-4793-90aa-c7610309eddc None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:32.900226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ca4c-feae-4793-90aa-c7610309eddc None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:32.900501 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ca4c-feae-4793-90aa-c7610309eddc None admin] PATH_INFO: `/v3/groups/a50197a60eae4fb294cddfe0eb66cb58` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:32.901665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116ca4c-feae-4793-90aa-c7610309eddc None admin] RBAC: Authorizing `identity:get_group(group_id=a50197a60eae4fb294cddfe0eb66cb58)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:32.903111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116ca4c-feae-4793-90aa-c7610309eddc None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:32.904746 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 222/450] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:32 2022] GET /identity/v3/groups/a50197a60eae4fb294cddfe0eb66cb58 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:32.910458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116ca4c-feae-4793-90aa-c7610309eddc None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:32.929047 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:32.953293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88cf3b-ed72-47e5-9c27-db98dcc1ef2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:32.954732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88cf3b-ed72-47e5-9c27-db98dcc1ef2b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:32.988722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:33.020201 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116ca4c-feae-4793-90aa-c7610309eddc None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:33.052929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d9ee9-c8fe-4569-8dcf-8022ca92d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:33.053591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d9ee9-c8fe-4569-8dcf-8022ca92d1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:33.053860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d9ee9-c8fe-4569-8dcf-8022ca92d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:33.054133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d9ee9-c8fe-4569-8dcf-8022ca92d1c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:33.054617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 229/451] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 10:21:33.055898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d9ee9-c8fe-4569-8dcf-8022ca92d1c7 None admin] RBAC: Adding query filter params (group.id=a50197a60eae4fb294cddfe0eb66cb58, role.id=9c6db94ddc204b7e860aa2a9d622e14b, scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:33.056215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d9ee9-c8fe-4569-8dcf-8022ca92d1c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:33.057648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d9ee9-c8fe-4569-8dcf-8022ca92d1c7 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:33.061004 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88cf3b-ed72-47e5-9c27-db98dcc1ef2b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:33.072246 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 223/452] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Jun 15 10:21:32 2022] GET /identity/v3/role_assignments?group.id=a50197a60eae4fb294cddfe0eb66cb58&scope.project.id=d2e9da0fae424c80aea374ac5ff2cefb&role.id=9c6db94ddc204b7e860aa2a9d622e14b => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:33.152800 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:33.180900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88cf3b-ed72-47e5-9c27-db98dcc1ef2b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:33.217790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dea640-f585-4754-b885-f0561fc4df03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:33.218651 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dea640-f585-4754-b885-f0561fc4df03 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:33.218934 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dea640-f585-4754-b885-f0561fc4df03 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:33.219207 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dea640-f585-4754-b885-f0561fc4df03 None admin] PATH_INFO: `/v3/projects/e426bab74fde45f595bae4efed952751` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:33.220430 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dea640-f585-4754-b885-f0561fc4df03 None admin] RBAC: Authorizing `identity:get_project(project_id=e426bab74fde45f595bae4efed952751)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:33.221868 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dea640-f585-4754-b885-f0561fc4df03 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:33.223730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 230/453] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:21:33 2022] GET /identity/v3/projects/e426bab74fde45f595bae4efed952751 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:33.230573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d9ee9-c8fe-4569-8dcf-8022ca92d1c7 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:33.336688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d9ee9-c8fe-4569-8dcf-8022ca92d1c7 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:33.373232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a622e4-242b-42a4-8d54-4a6e3ed070f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:33.374100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a622e4-242b-42a4-8d54-4a6e3ed070f2 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:33.374456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a622e4-242b-42a4-8d54-4a6e3ed070f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:33.374636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a622e4-242b-42a4-8d54-4a6e3ed070f2 None admin] PATH_INFO: `/v3/groups/726ae218b1d74f258c9efcc1d3c57c08` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:33.375876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a622e4-242b-42a4-8d54-4a6e3ed070f2 None admin] RBAC: Authorizing `identity:get_group(group_id=726ae218b1d74f258c9efcc1d3c57c08)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:33.377317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a622e4-242b-42a4-8d54-4a6e3ed070f2 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:33.379047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 224/454] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Jun 15 10:21:33 2022] GET /identity/v3/groups/726ae218b1d74f258c9efcc1d3c57c08 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:33.385129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dea640-f585-4754-b885-f0561fc4df03 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:33.489570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dea640-f585-4754-b885-f0561fc4df03 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:33.526356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a26fb3-ed44-4090-9b0b-bc2584afe07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:33.526999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a26fb3-ed44-4090-9b0b-bc2584afe07b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:33.527279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a26fb3-ed44-4090-9b0b-bc2584afe07b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:33.527577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a26fb3-ed44-4090-9b0b-bc2584afe07b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:33.528406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a26fb3-ed44-4090-9b0b-bc2584afe07b None admin] RBAC: Adding query filter params (group.id=726ae218b1d74f258c9efcc1d3c57c08, role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=e426bab74fde45f595bae4efed952751) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:33.528711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a26fb3-ed44-4090-9b0b-bc2584afe07b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:33.530152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a26fb3-ed44-4090-9b0b-bc2584afe07b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:33.535926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 231/455] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Jun 15 10:21:33 2022] GET /identity/v3/role_assignments?group.id=726ae218b1d74f258c9efcc1d3c57c08&scope.project.id=e426bab74fde45f595bae4efed952751&role.id=e1a2021d08e14daa969362b3d23face3 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:36.005960 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9e1e8-d477-4f54-8e1d-e77350fffd99 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:36.006950 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9e1e8-d477-4f54-8e1d-e77350fffd99 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:36.007459 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9e1e8-d477-4f54-8e1d-e77350fffd99 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:36.009378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 225/456] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:36.014340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de69d37-2c0b-45a2-b5fb-c9d7a6f127aa None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:36.015149 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de69d37-2c0b-45a2-b5fb-c9d7a6f127aa None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:36.015654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de69d37-2c0b-45a2-b5fb-c9d7a6f127aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:36.035554 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5de69d37-2c0b-45a2-b5fb-c9d7a6f127aa None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:36.037066 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5de69d37-2c0b-45a2-b5fb-c9d7a6f127aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:36.042200 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:36.126939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 232/457] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:36.162956 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9e1e8-d477-4f54-8e1d-e77350fffd99 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:36.167151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:36.251444 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398391c-07af-4e4f-b3de-a1d93091a614 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:36.251650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398391c-07af-4e4f-b3de-a1d93091a614 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:36.251900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398391c-07af-4e4f-b3de-a1d93091a614 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:36.253478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 233/458] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:36.258843 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352cc5-0c2d-4ec3-a7b6-c4713625f74d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:36.259075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352cc5-0c2d-4ec3-a7b6-c4713625f74d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:36.259355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352cc5-0c2d-4ec3-a7b6-c4713625f74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:36.286490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d0352cc5-0c2d-4ec3-a7b6-c4713625f74d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:36.287999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d0352cc5-0c2d-4ec3-a7b6-c4713625f74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:36.317101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9e1e8-d477-4f54-8e1d-e77350fffd99 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:36.371258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 234/459] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:36.373463 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cfecd-8fad-4c78-b23e-32db0c440dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:36.374301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cfecd-8fad-4c78-b23e-32db0c440dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:36.374588 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cfecd-8fad-4c78-b23e-32db0c440dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:36.374821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cfecd-8fad-4c78-b23e-32db0c440dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:36.394894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352cc5-0c2d-4ec3-a7b6-c4713625f74d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:36.407979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cfecd-8fad-4c78-b23e-32db0c440dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:36.411599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cfecd-8fad-4c78-b23e-32db0c440dd6 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-889cfecd-8fad-4c78-b23e-32db0c440dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:36.448997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:36.449963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:36.450874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:36.450874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:36.450874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:36.450874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:36.458878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 226/460] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:36.469393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cfecd-8fad-4c78-b23e-32db0c440dd6 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:36.531489 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:36.569419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352cc5-0c2d-4ec3-a7b6-c4713625f74d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:36.571122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:36.608660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c285c78-b299-4557-8c1b-dbeaad9dc1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:36.609826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c285c78-b299-4557-8c1b-dbeaad9dc1eb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:36.610388 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c285c78-b299-4557-8c1b-dbeaad9dc1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:36.610874 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c285c78-b299-4557-8c1b-dbeaad9dc1eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:36.622575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c285c78-b299-4557-8c1b-dbeaad9dc1eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:36.624316 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c285c78-b299-4557-8c1b-dbeaad9dc1eb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-7c285c78-b299-4557-8c1b-dbeaad9dc1eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:36.643629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:36.644564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:36.645460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:36.645460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:36.645460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:36.645460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:36.647791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 235/461] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:36.653064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cfecd-8fad-4c78-b23e-32db0c440dd6 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:36.665332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c285c78-b299-4557-8c1b-dbeaad9dc1eb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:36.717867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570f093-78b2-497c-b9f0-a9e653c38ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:36.718690 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570f093-78b2-497c-b9f0-a9e653c38ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:36.719191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570f093-78b2-497c-b9f0-a9e653c38ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:36.719710 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570f093-78b2-497c-b9f0-a9e653c38ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:36.720729 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570f093-78b2-497c-b9f0-a9e653c38ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:36.721018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570f093-78b2-497c-b9f0-a9e653c38ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:36.722624 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570f093-78b2-497c-b9f0-a9e653c38ec0 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:36.760168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 227/462] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:36.765580 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570f093-78b2-497c-b9f0-a9e653c38ec0 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:36.789877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c285c78-b299-4557-8c1b-dbeaad9dc1eb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:36.811671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:36.829103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651a71f-b85c-4adb-bd54-621fc0c8965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:36.830082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651a71f-b85c-4adb-bd54-621fc0c8965d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:36.830593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651a71f-b85c-4adb-bd54-621fc0c8965d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:36.831082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651a71f-b85c-4adb-bd54-621fc0c8965d None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:36.832045 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651a71f-b85c-4adb-bd54-621fc0c8965d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:36.832557 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651a71f-b85c-4adb-bd54-621fc0c8965d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:36.834137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651a71f-b85c-4adb-bd54-621fc0c8965d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:36.846688 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 236/463] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:36.848364 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aee3b-cbac-4363-ae8c-d795997b431b None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:36.848892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aee3b-cbac-4363-ae8c-d795997b431b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:36.849368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aee3b-cbac-4363-ae8c-d795997b431b None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:36.851210 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 237/464] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:36.853503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aee3b-cbac-4363-ae8c-d795997b431b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:36.921975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570f093-78b2-497c-b9f0-a9e653c38ec0 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:36.940424 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:36.964404 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d5a73-46ec-43b6-ba8f-d23739c9889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:36.965173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d5a73-46ec-43b6-ba8f-d23739c9889c None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:36.965521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d5a73-46ec-43b6-ba8f-d23739c9889c None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:36.965886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d5a73-46ec-43b6-ba8f-d23739c9889c None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:36.966657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d5a73-46ec-43b6-ba8f-d23739c9889c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:36.968351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d5a73-46ec-43b6-ba8f-d23739c9889c None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:36.982512 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aee3b-cbac-4363-ae8c-d795997b431b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:36.993205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 228/465] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:21:36 2022] POST /identity/v3/users => generated 246 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:21:36.994614 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5425a3-da1e-4ef7-a258-815ad1e3dac5 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:36.994906 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5425a3-da1e-4ef7-a258-815ad1e3dac5 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:36.995179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5425a3-da1e-4ef7-a258-815ad1e3dac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:37.019441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-5c5425a3-da1e-4ef7-a258-815ad1e3dac5 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:37.020717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-5c5425a3-da1e-4ef7-a258-815ad1e3dac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:37.022989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fef3d5-59b3-4333-8ba7-fdae6efa33a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:37.024957 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fef3d5-59b3-4333-8ba7-fdae6efa33a2 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:37.025244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fef3d5-59b3-4333-8ba7-fdae6efa33a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:37.025521 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fef3d5-59b3-4333-8ba7-fdae6efa33a2 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:37.026238 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fef3d5-59b3-4333-8ba7-fdae6efa33a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:37.027773 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fef3d5-59b3-4333-8ba7-fdae6efa33a2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:37.055661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 238/466] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:21:36 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:21:37.057328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21edfe2-42aa-43e4-a043-512bb0d6f657 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:37.057620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21edfe2-42aa-43e4-a043-512bb0d6f657 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:37.058257 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21edfe2-42aa-43e4-a043-512bb0d6f657 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:37.064408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 239/467] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:37.067045 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330af35e-b38d-46c0-a978-4aac0c7b0de4 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:37.067336 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330af35e-b38d-46c0-a978-4aac0c7b0de4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:37.067645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330af35e-b38d-46c0-a978-4aac0c7b0de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:37.092649 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-330af35e-b38d-46c0-a978-4aac0c7b0de4 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:37.093910 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-330af35e-b38d-46c0-a978-4aac0c7b0de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:37.113927 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 229/468] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:37.136161 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:37.161426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5425a3-da1e-4ef7-a258-815ad1e3dac5 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:37.187443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 240/469] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:37.225530 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330af35e-b38d-46c0-a978-4aac0c7b0de4 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:37.310122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:37.314151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5425a3-da1e-4ef7-a258-815ad1e3dac5 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:37.358741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4e153-2429-429f-bdad-d2fb880be444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:37.359554 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4e153-2429-429f-bdad-d2fb880be444 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:37.359834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4e153-2429-429f-bdad-d2fb880be444 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:37.360099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4e153-2429-429f-bdad-d2fb880be444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:37.363455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330af35e-b38d-46c0-a978-4aac0c7b0de4 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:37.372471 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4e153-2429-429f-bdad-d2fb880be444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:37.374307 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4e153-2429-429f-bdad-d2fb880be444 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-d6c4e153-2429-429f-bdad-d2fb880be444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:37.402393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:37.403401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:37.404350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:37.404350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:37.404350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:37.404350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:37.404581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 230/470] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:37.410889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4e153-2429-429f-bdad-d2fb880be444 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:37.411733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b0b19-1dd7-4475-aba0-ead076c19dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:37.412547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0b19-1dd7-4475-aba0-ead076c19dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:37.412837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0b19-1dd7-4475-aba0-ead076c19dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:37.413103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0b19-1dd7-4475-aba0-ead076c19dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:37.426665 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b0b19-1dd7-4475-aba0-ead076c19dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:37.428459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b0b19-1dd7-4475-aba0-ead076c19dd7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-939b0b19-1dd7-4475-aba0-ead076c19dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:37.448358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:37.449300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:37.450190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:37.450190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:37.450190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:37.450190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:37.450190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 241/471] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:37.455306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b0b19-1dd7-4475-aba0-ead076c19dd7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:37.492794 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:37.572914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4e153-2429-429f-bdad-d2fb880be444 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:37.622165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8de69-8403-4dd3-91e6-3b790b371e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:37.622832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8de69-8403-4dd3-91e6-3b790b371e94 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:37.623354 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8de69-8403-4dd3-91e6-3b790b371e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:37.623662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8de69-8403-4dd3-91e6-3b790b371e94 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:37.624834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8de69-8403-4dd3-91e6-3b790b371e94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:37.625414 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8de69-8403-4dd3-91e6-3b790b371e94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:37.627055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8de69-8403-4dd3-91e6-3b790b371e94 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:37.633831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b0b19-1dd7-4475-aba0-ead076c19dd7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:37.643032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 231/472] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:37.644929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c768e-6e41-4c11-a675-bf8c2e3aadce None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:37.645218 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c768e-6e41-4c11-a675-bf8c2e3aadce None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:37.645498 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c768e-6e41-4c11-a675-bf8c2e3aadce None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:37.647742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 232/473] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:37.648464 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c768e-6e41-4c11-a675-bf8c2e3aadce None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:37.666041 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:37.687364 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb03c3f-db6f-4318-91fe-6900bd72f62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:37.688272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb03c3f-db6f-4318-91fe-6900bd72f62a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:37.688727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb03c3f-db6f-4318-91fe-6900bd72f62a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:37.689144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb03c3f-db6f-4318-91fe-6900bd72f62a None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:37.690014 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb03c3f-db6f-4318-91fe-6900bd72f62a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:37.690462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb03c3f-db6f-4318-91fe-6900bd72f62a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:37.692062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb03c3f-db6f-4318-91fe-6900bd72f62a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:37.705109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 242/474] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:37.706537 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84769e5e-ba57-4ad4-8b79-26f3a649d123 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:37.707015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84769e5e-ba57-4ad4-8b79-26f3a649d123 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:37.707434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84769e5e-ba57-4ad4-8b79-26f3a649d123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:37.725457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-84769e5e-ba57-4ad4-8b79-26f3a649d123 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:37.727538 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-84769e5e-ba57-4ad4-8b79-26f3a649d123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:37.781783 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c768e-6e41-4c11-a675-bf8c2e3aadce None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:37.815783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 243/475] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:37.823771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84769e5e-ba57-4ad4-8b79-26f3a649d123 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:37.826806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bb302-2f35-4d6b-882e-b75ed1c96e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:37.827109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:37.827963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bb302-2f35-4d6b-882e-b75ed1c96e7b None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:37.828497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bb302-2f35-4d6b-882e-b75ed1c96e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:37.828972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bb302-2f35-4d6b-882e-b75ed1c96e7b None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:37.829878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bb302-2f35-4d6b-882e-b75ed1c96e7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:37.835625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bb302-2f35-4d6b-882e-b75ed1c96e7b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:37.872394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 233/476] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:21:37 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:21:37.873473 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bb302-2f35-4d6b-882e-b75ed1c96e7b None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:37.928686 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84769e5e-ba57-4ad4-8b79-26f3a649d123 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:37.965545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd76f0-f19a-4ad1-9a1b-36b37940adf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:37.966275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd76f0-f19a-4ad1-9a1b-36b37940adf5 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:37.966558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd76f0-f19a-4ad1-9a1b-36b37940adf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:37.966832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd76f0-f19a-4ad1-9a1b-36b37940adf5 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:37.967630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd76f0-f19a-4ad1-9a1b-36b37940adf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:37.969101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd76f0-f19a-4ad1-9a1b-36b37940adf5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:37.989228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bb302-2f35-4d6b-882e-b75ed1c96e7b None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:37.994497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 244/477] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:21:37 2022] POST /identity/v3/users => generated 249 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:21:37.999949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:38.041039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b506a7d-8233-4d1c-8f6e-6385a82a84ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:38.048110 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b506a7d-8233-4d1c-8f6e-6385a82a84ba None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:38.048744 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b506a7d-8233-4d1c-8f6e-6385a82a84ba None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:38.049336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b506a7d-8233-4d1c-8f6e-6385a82a84ba None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:38.050391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b506a7d-8233-4d1c-8f6e-6385a82a84ba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:38.052129 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b506a7d-8233-4d1c-8f6e-6385a82a84ba None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:38.066528 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.sql.core [None req-5b506a7d-8233-4d1c-8f6e-6385a82a84ba None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 10:21:38.066528 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 15 10:21:38.066528 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [parameters: {'id': '515af5d182a74f5fa228b59c00883ec9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 15 10:21:38.066528 dv-cinder-843493-2-smb devstack@keystone.service[80118]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80118) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-5b506a7d-8233-4d1c-8f6e-6385a82a84ba None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application conn.query(q) Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application result.read() Jun 15 10:21:38.092496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return ref.to_dict() Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 10:21:38.093517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application next(self.gen) Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application yield resource Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application next(self.gen) Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise self.value Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application session.commit() Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 10:21:38.094489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self.session.flush() Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application compat.raise_( Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 10:21:38.095406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 10:21:38.096382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application conn.query(q) Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application result.read() Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 10:21:38.097277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [parameters: {'id': '515af5d182a74f5fa228b59c00883ec9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:38.098104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 15 10:21:38.105339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:38.109344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 234/478] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Jun 15 10:21:37 2022] POST /identity/v3/roles => generated 144 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:38.115813 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd76f0-f19a-4ad1-9a1b-36b37940adf5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:38.200713 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:38.243070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd76f0-f19a-4ad1-9a1b-36b37940adf5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:38.279786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c5d04-5f0a-4972-8806-4c7ca1c861a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:38.280586 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c5d04-5f0a-4972-8806-4c7ca1c861a8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:38.280863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c5d04-5f0a-4972-8806-4c7ca1c861a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:38.281133 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c5d04-5f0a-4972-8806-4c7ca1c861a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:38.291707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c5d04-5f0a-4972-8806-4c7ca1c861a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-9d0c5d04-5f0a-4972-8806-4c7ca1c861a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:38.299821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:38.300789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:38.301629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:38.301629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:38.301629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:38.301629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:38.301629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:38.301629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:38.301629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:38.301629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:38.301629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:38.301629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:38.301629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 10:21:38.301629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:38.301629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 245/479] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:21:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:38.308450 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b506a7d-8233-4d1c-8f6e-6385a82a84ba None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:38.420887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b506a7d-8233-4d1c-8f6e-6385a82a84ba None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:38.453300 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:38.459187 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1887bc-ecf2-4096-b9e4-bd654995262a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:38.460232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1887bc-ecf2-4096-b9e4-bd654995262a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:38.460742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1887bc-ecf2-4096-b9e4-bd654995262a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:38.461313 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1887bc-ecf2-4096-b9e4-bd654995262a None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:38.462275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1887bc-ecf2-4096-b9e4-bd654995262a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:38.462789 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1887bc-ecf2-4096-b9e4-bd654995262a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:38.464470 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1887bc-ecf2-4096-b9e4-bd654995262a None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:38.474279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 235/480] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:39.517726 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4fc9e-647d-4412-aaca-690162f8b9b1 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:39.518268 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4fc9e-647d-4412-aaca-690162f8b9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:39.518268 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4fc9e-647d-4412-aaca-690162f8b9b1 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:39.519786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 246/481] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:39.525772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb8c00-15c6-4a82-9386-3049b44fbc72 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:39.526182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb8c00-15c6-4a82-9386-3049b44fbc72 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:39.526357 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb8c00-15c6-4a82-9386-3049b44fbc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:39.552469 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-d1eb8c00-15c6-4a82-9386-3049b44fbc72 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:39.553670 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d1eb8c00-15c6-4a82-9386-3049b44fbc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:39.644889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 236/482] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:39.705306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4fc9e-647d-4412-aaca-690162f8b9b1 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:39.817588 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a72e3f-3f26-44d2-94bb-342b546837b8 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:39.818200 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a72e3f-3f26-44d2-94bb-342b546837b8 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:39.818707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a72e3f-3f26-44d2-94bb-342b546837b8 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:39.821219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 237/483] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:39.826318 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc280369-89e2-4c22-a397-efbd7a23a882 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:39.826605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc280369-89e2-4c22-a397-efbd7a23a882 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:39.826888 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc280369-89e2-4c22-a397-efbd7a23a882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:39.850888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4fc9e-647d-4412-aaca-690162f8b9b1 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:39.855305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-dc280369-89e2-4c22-a397-efbd7a23a882 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:39.856748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-dc280369-89e2-4c22-a397-efbd7a23a882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:39.877552 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:39.894523 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68324b56-1721-47f3-9130-386e2df9571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:39.899299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68324b56-1721-47f3-9130-386e2df9571b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:39.899773 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68324b56-1721-47f3-9130-386e2df9571b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:39.900192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68324b56-1721-47f3-9130-386e2df9571b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:39.920974 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68324b56-1721-47f3-9130-386e2df9571b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-68324b56-1721-47f3-9130-386e2df9571b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:39.930378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:39.931526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:39.932385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:39.932385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:39.932385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:39.932385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:39.932385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:39.932385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:39.932385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:39.932385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:39.932385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:39.932385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:39.932385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:39.932385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:39.934633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 247/484] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:39.941206 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68324b56-1721-47f3-9130-386e2df9571b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:40.002511 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 238/485] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:40.040999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc280369-89e2-4c22-a397-efbd7a23a882 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:40.055215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68324b56-1721-47f3-9130-386e2df9571b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:40.098405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2142d-ed57-49e4-bafe-f2eab5ed9c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:40.099077 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2142d-ed57-49e4-bafe-f2eab5ed9c85 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:40.099366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2142d-ed57-49e4-bafe-f2eab5ed9c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:40.099641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2142d-ed57-49e4-bafe-f2eab5ed9c85 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:40.100399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2142d-ed57-49e4-bafe-f2eab5ed9c85 None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:40.100701 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2142d-ed57-49e4-bafe-f2eab5ed9c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:40.102107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d2142d-ed57-49e4-bafe-f2eab5ed9c85 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:40.123001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 248/486] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:40.133429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2142d-ed57-49e4-bafe-f2eab5ed9c85 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:40.142627 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:40.228843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc280369-89e2-4c22-a397-efbd7a23a882 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:40.235799 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:40.297123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a547c-ee37-4c39-bbec-61eec6806884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:40.297683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2142d-ed57-49e4-bafe-f2eab5ed9c85 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:40.297925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a547c-ee37-4c39-bbec-61eec6806884 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:40.298206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a547c-ee37-4c39-bbec-61eec6806884 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:40.298476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a547c-ee37-4c39-bbec-61eec6806884 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:40.318696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a547c-ee37-4c39-bbec-61eec6806884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-a18a547c-ee37-4c39-bbec-61eec6806884 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:40.336321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:40.337326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:40.338161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:40.338161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:40.338161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:40.338161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:40.338161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:40.338161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:40.338161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:40.338161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:40.338161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:40.338161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:40.338161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:40.338161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:40.339011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 239/487] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:40.345592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a547c-ee37-4c39-bbec-61eec6806884 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:40.346315 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22b9a6-1ab1-459c-b634-0c5c0d904ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:40.347359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22b9a6-1ab1-459c-b634-0c5c0d904ceb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:40.347861 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22b9a6-1ab1-459c-b634-0c5c0d904ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:40.348325 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22b9a6-1ab1-459c-b634-0c5c0d904ceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:40.372525 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22b9a6-1ab1-459c-b634-0c5c0d904ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:40.375993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22b9a6-1ab1-459c-b634-0c5c0d904ceb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-2c22b9a6-1ab1-459c-b634-0c5c0d904ceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:40.406418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:40.407358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:40.408298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:40.408298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:40.408298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:40.408298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:40.416190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 249/488] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:40.426080 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22b9a6-1ab1-459c-b634-0c5c0d904ceb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:40.489007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a547c-ee37-4c39-bbec-61eec6806884 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:40.507869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:40.537608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82c0ad-0abe-45a8-88e4-3e22f0905e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:40.538354 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82c0ad-0abe-45a8-88e4-3e22f0905e5a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:40.538551 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82c0ad-0abe-45a8-88e4-3e22f0905e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:40.538825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82c0ad-0abe-45a8-88e4-3e22f0905e5a None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:40.540151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82c0ad-0abe-45a8-88e4-3e22f0905e5a None admin] RBAC: Adding query filter params (name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:40.540491 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82c0ad-0abe-45a8-88e4-3e22f0905e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:40.543083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82c0ad-0abe-45a8-88e4-3e22f0905e5a None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:40.553148 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 240/489] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:40.564689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82c0ad-0abe-45a8-88e4-3e22f0905e5a None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:40.622137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:40.627826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22b9a6-1ab1-459c-b634-0c5c0d904ceb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:40.684984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82c0ad-0abe-45a8-88e4-3e22f0905e5a None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:40.685530 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bea60-e928-4ca4-9169-6ea07cd4adb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:40.686193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bea60-e928-4ca4-9169-6ea07cd4adb6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:40.686478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bea60-e928-4ca4-9169-6ea07cd4adb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:40.686751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bea60-e928-4ca4-9169-6ea07cd4adb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:40.687488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bea60-e928-4ca4-9169-6ea07cd4adb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:40.687943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bea60-e928-4ca4-9169-6ea07cd4adb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:40.690150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bea60-e928-4ca4-9169-6ea07cd4adb6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:40.710036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 250/490] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:40.712281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d799e-d57c-4893-abf3-d728ec645ce8 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:40.712572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d799e-d57c-4893-abf3-d728ec645ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:40.712847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d799e-d57c-4893-abf3-d728ec645ce8 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:40.714522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 251/491] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:40.715577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d799e-d57c-4893-abf3-d728ec645ce8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:40.730925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85ecf4-6e22-4629-97d7-b31ea638f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:40.731748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85ecf4-6e22-4629-97d7-b31ea638f814 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:40.732031 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85ecf4-6e22-4629-97d7-b31ea638f814 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:40.732307 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85ecf4-6e22-4629-97d7-b31ea638f814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:40.743686 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85ecf4-6e22-4629-97d7-b31ea638f814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:40.745128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85ecf4-6e22-4629-97d7-b31ea638f814 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-de85ecf4-6e22-4629-97d7-b31ea638f814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:40.762882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:40.763910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:40.764786 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:40.764786 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:40.764786 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:40.764786 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:40.773156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 241/492] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:40.773156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d22627-41c1-4b03-84d9-fd2b1413010e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:40.773156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d22627-41c1-4b03-84d9-fd2b1413010e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:40.773156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d22627-41c1-4b03-84d9-fd2b1413010e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:40.803505 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-17d22627-41c1-4b03-84d9-fd2b1413010e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:40.805270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-17d22627-41c1-4b03-84d9-fd2b1413010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:40.838046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:40.851420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d799e-d57c-4893-abf3-d728ec645ce8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:40.887373 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ed91a-6a8a-4d42-9ded-83e5da3a4c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:40.888115 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ed91a-6a8a-4d42-9ded-83e5da3a4c68 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:40.888648 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ed91a-6a8a-4d42-9ded-83e5da3a4c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:40.888751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 242/493] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:40.888840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ed91a-6a8a-4d42-9ded-83e5da3a4c68 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:40.889368 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d22627-41c1-4b03-84d9-fd2b1413010e None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:40.907513 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ed91a-6a8a-4d42-9ded-83e5da3a4c68 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:40.907513 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ed91a-6a8a-4d42-9ded-83e5da3a4c68 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-826ed91a-6a8a-4d42-9ded-83e5da3a4c68 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:40.927880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:40.928894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:40.930615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:40.930615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:40.930615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:40.930615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:40.930615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:40.930615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:40.930615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:40.930615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:40.930615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 10:21:40.930615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:40.930615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 252/494] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:40.930615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33438dc-932b-4664-9505-3ee3d7f3d6d4 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:40.931359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33438dc-932b-4664-9505-3ee3d7f3d6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:40.931359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33438dc-932b-4664-9505-3ee3d7f3d6d4 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:40.932405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 253/495] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:40.932908 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33438dc-932b-4664-9505-3ee3d7f3d6d4 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:40.953617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:41.004328 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d22627-41c1-4b03-84d9-fd2b1413010e None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:41.039514 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33438dc-932b-4664-9505-3ee3d7f3d6d4 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:41.043398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61245297-479c-4675-9c82-7a9fb334ce42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:41.044082 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61245297-479c-4675-9c82-7a9fb334ce42 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:41.044363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61245297-479c-4675-9c82-7a9fb334ce42 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:41.044634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61245297-479c-4675-9c82-7a9fb334ce42 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:41.045355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61245297-479c-4675-9c82-7a9fb334ce42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:41.045661 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61245297-479c-4675-9c82-7a9fb334ce42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:41.047024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61245297-479c-4675-9c82-7a9fb334ce42 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:41.059221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 243/496] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:41.059895 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61245297-479c-4675-9c82-7a9fb334ce42 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:41.078120 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659f648-9a28-4ebc-ab47-0bf145be45e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:41.078904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659f648-9a28-4ebc-ab47-0bf145be45e9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:41.079189 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659f648-9a28-4ebc-ab47-0bf145be45e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:41.079478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659f648-9a28-4ebc-ab47-0bf145be45e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:41.083723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:41.093710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659f648-9a28-4ebc-ab47-0bf145be45e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-b659f648-9a28-4ebc-ab47-0bf145be45e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:41.101616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:41.102573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:41.103433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:41.103433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:41.103433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:41.103433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:41.103433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:41.103433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:41.103433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:41.103433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:41.103433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:41.103433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:41.103433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:41.103433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:41.103433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 254/497] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:41.104700 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517f04a-79c8-467d-a15b-704fdcaebf24 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:41.104700 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517f04a-79c8-467d-a15b-704fdcaebf24 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:41.104700 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517f04a-79c8-467d-a15b-704fdcaebf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:41.121321 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1517f04a-79c8-467d-a15b-704fdcaebf24 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:41.122515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1517f04a-79c8-467d-a15b-704fdcaebf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:41.177384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61245297-479c-4675-9c82-7a9fb334ce42 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:41.199653 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 255/498] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:41.199653 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517f04a-79c8-467d-a15b-704fdcaebf24 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:41.207782 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:41.224353 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa66d0a-83dc-4b4c-9219-97e2160d9c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:41.225024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66d0a-83dc-4b4c-9219-97e2160d9c05 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:41.225306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66d0a-83dc-4b4c-9219-97e2160d9c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:41.225578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa66d0a-83dc-4b4c-9219-97e2160d9c05 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:41.226418 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa66d0a-83dc-4b4c-9219-97e2160d9c05 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:41.226754 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa66d0a-83dc-4b4c-9219-97e2160d9c05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:41.228226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa66d0a-83dc-4b4c-9219-97e2160d9c05 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:41.269785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 244/499] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Jun 15 10:21:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:41.269785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa66d0a-83dc-4b4c-9219-97e2160d9c05 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:41.306791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517f04a-79c8-467d-a15b-704fdcaebf24 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:41.344993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:41.345184 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3ebaa-6e48-4b1a-854b-0fbb3b6c7d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:41.345862 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ebaa-6e48-4b1a-854b-0fbb3b6c7d6e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:41.346140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ebaa-6e48-4b1a-854b-0fbb3b6c7d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:41.346439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ebaa-6e48-4b1a-854b-0fbb3b6c7d6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:41.354290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3ebaa-6e48-4b1a-854b-0fbb3b6c7d6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:41.355758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3ebaa-6e48-4b1a-854b-0fbb3b6c7d6e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-f8b3ebaa-6e48-4b1a-854b-0fbb3b6c7d6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:41.370955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:41.371944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:41.372867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:41.372867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:41.372867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:41.372867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:41.372867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:41.372867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:41.372867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:41.372867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:41.372867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:21:41.372867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:41.373397 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa66d0a-83dc-4b4c-9219-97e2160d9c05 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:41.373472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 256/500] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Jun 15 10:21:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:41.373472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3ebaa-6e48-4b1a-854b-0fbb3b6c7d6e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:41.417239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d80b-ec68-422f-a551-eca7c2aed936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:41.417927 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d80b-ec68-422f-a551-eca7c2aed936 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:41.418428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d80b-ec68-422f-a551-eca7c2aed936 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:41.418711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d80b-ec68-422f-a551-eca7c2aed936 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:41.419494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86d80b-ec68-422f-a551-eca7c2aed936 None admin] RBAC: Adding query filter params (name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:41.419804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86d80b-ec68-422f-a551-eca7c2aed936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:41.421338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86d80b-ec68-422f-a551-eca7c2aed936 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:41.435579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 245/501] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:41.436339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d80b-ec68-422f-a551-eca7c2aed936 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:41.447727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:41.482242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3ebaa-6e48-4b1a-854b-0fbb3b6c7d6e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:41.516421 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436590b-08bf-408c-92f3-acdd9f05c5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:41.517199 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436590b-08bf-408c-92f3-acdd9f05c5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:41.517484 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436590b-08bf-408c-92f3-acdd9f05c5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:41.517757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436590b-08bf-408c-92f3-acdd9f05c5f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:41.527689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436590b-08bf-408c-92f3-acdd9f05c5f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-4436590b-08bf-408c-92f3-acdd9f05c5f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:41.535323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:41.536284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:41.537213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:41.537213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:41.537213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:41.537213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:41.537213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:41.537213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:41.537213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:41.537213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:41.537213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:41.537213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:41.537213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:41.537213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:41.538068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d80b-ec68-422f-a551-eca7c2aed936 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:41.538475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 257/502] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:41.538475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436590b-08bf-408c-92f3-acdd9f05c5f6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:41.573236 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547172c-d140-4152-a90e-8717949b0ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:41.573872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547172c-d140-4152-a90e-8717949b0ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:41.574143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547172c-d140-4152-a90e-8717949b0ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:41.574419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547172c-d140-4152-a90e-8717949b0ea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:41.582562 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:41.634102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436590b-08bf-408c-92f3-acdd9f05c5f6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:41.641290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547172c-d140-4152-a90e-8717949b0ea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:41.642792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547172c-d140-4152-a90e-8717949b0ea5 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:41.659364 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:41.667404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0370314-bc1d-48a7-9edd-71cb53575caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:41.668107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370314-bc1d-48a7-9edd-71cb53575caa None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:41.668393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370314-bc1d-48a7-9edd-71cb53575caa None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:41.668669 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370314-bc1d-48a7-9edd-71cb53575caa None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:41.669509 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0370314-bc1d-48a7-9edd-71cb53575caa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:41.669889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0370314-bc1d-48a7-9edd-71cb53575caa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:41.671230 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0370314-bc1d-48a7-9edd-71cb53575caa None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:41.707429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 258/503] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Jun 15 10:21:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:41.708204 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0370314-bc1d-48a7-9edd-71cb53575caa None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:41.743228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 246/504] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:41.744574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d71f3-ced8-4740-b4a6-2fad3ae9f480 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:41.744854 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d71f3-ced8-4740-b4a6-2fad3ae9f480 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:41.745125 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d71f3-ced8-4740-b4a6-2fad3ae9f480 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:41.746370 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 247/505] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:41.747053 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d71f3-ced8-4740-b4a6-2fad3ae9f480 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:41.786698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:41.812325 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0370314-bc1d-48a7-9edd-71cb53575caa None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:41.846233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47aebc9-0352-4396-a7d1-d3f7539b8608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:41.847017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aebc9-0352-4396-a7d1-d3f7539b8608 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:41.847302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aebc9-0352-4396-a7d1-d3f7539b8608 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:41.847597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d71f3-ced8-4740-b4a6-2fad3ae9f480 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:41.847707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47aebc9-0352-4396-a7d1-d3f7539b8608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:41.857646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47aebc9-0352-4396-a7d1-d3f7539b8608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:41.859100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47aebc9-0352-4396-a7d1-d3f7539b8608 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-e47aebc9-0352-4396-a7d1-d3f7539b8608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:41.876734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:41.877607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:41.878493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:41.878493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:41.878493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:41.878493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:41.878493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 259/506] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:41.878770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47aebc9-0352-4396-a7d1-d3f7539b8608 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:41.885453 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b051e-0d79-4b4d-b0d9-dd14d97d4f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:41.886122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b051e-0d79-4b4d-b0d9-dd14d97d4f1f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:41.886428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b051e-0d79-4b4d-b0d9-dd14d97d4f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:41.886703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b051e-0d79-4b4d-b0d9-dd14d97d4f1f None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:41.887603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b051e-0d79-4b4d-b0d9-dd14d97d4f1f None admin] RBAC: Adding query filter params (name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:41.887914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b051e-0d79-4b4d-b0d9-dd14d97d4f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:41.889282 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b051e-0d79-4b4d-b0d9-dd14d97d4f1f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:41.897435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 248/507] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:41.899223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5516f-089d-4bbd-8294-44174f63ea84 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:41.899544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5516f-089d-4bbd-8294-44174f63ea84 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:41.899828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5516f-089d-4bbd-8294-44174f63ea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:41.915343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-adc5516f-089d-4bbd-8294-44174f63ea84 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:41.916574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-adc5516f-089d-4bbd-8294-44174f63ea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:41.922462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:41.981063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 249/508] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:41.981812 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5516f-089d-4bbd-8294-44174f63ea84 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:41.982589 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47aebc9-0352-4396-a7d1-d3f7539b8608 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:42.016087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:42.028093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8f1cf-810a-466a-b8a3-2fa807c57e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:42.028736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8f1cf-810a-466a-b8a3-2fa807c57e96 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:42.029015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8f1cf-810a-466a-b8a3-2fa807c57e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:42.029287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8f1cf-810a-466a-b8a3-2fa807c57e96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:42.083433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5516f-089d-4bbd-8294-44174f63ea84 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:42.095087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8f1cf-810a-466a-b8a3-2fa807c57e96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:42.096606 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8f1cf-810a-466a-b8a3-2fa807c57e96 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:42.116091 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2f0a3-cd57-49d4-be65-52bcce75ab4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:42.117606 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2f0a3-cd57-49d4-be65-52bcce75ab4b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:42.117885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2f0a3-cd57-49d4-be65-52bcce75ab4b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:42.118147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2f0a3-cd57-49d4-be65-52bcce75ab4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:42.127787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2f0a3-cd57-49d4-be65-52bcce75ab4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:42.129254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2f0a3-cd57-49d4-be65-52bcce75ab4b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:42.134508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-bce2f0a3-cd57-49d4-be65-52bcce75ab4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:42.146986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:42.147907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:42.148853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:42.148853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:42.148853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:42.148853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:42.148853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 250/509] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:42.149136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2f0a3-cd57-49d4-be65-52bcce75ab4b None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:42.200341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 260/510] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:42.201175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8f1cf-810a-466a-b8a3-2fa807c57e96 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:42.228728 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:42.247452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2f0a3-cd57-49d4-be65-52bcce75ab4b None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:42.281646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf552f-d4d9-4d12-8948-59513e978daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:42.282298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf552f-d4d9-4d12-8948-59513e978daf None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:42.282576 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf552f-d4d9-4d12-8948-59513e978daf None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:42.282844 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf552f-d4d9-4d12-8948-59513e978daf None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:42.283582 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf552f-d4d9-4d12-8948-59513e978daf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:42.283883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf552f-d4d9-4d12-8948-59513e978daf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:42.285255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf552f-d4d9-4d12-8948-59513e978daf None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:42.296634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 251/511] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:42.297529 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf552f-d4d9-4d12-8948-59513e978daf None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:42.305608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8f1cf-810a-466a-b8a3-2fa807c57e96 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:42.339164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccd2f0-3464-4cf2-91e5-db12eabd3a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:42.339985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd2f0-3464-4cf2-91e5-db12eabd3a7a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:42.340379 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd2f0-3464-4cf2-91e5-db12eabd3a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:42.340660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd2f0-3464-4cf2-91e5-db12eabd3a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:42.347193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:42.351913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccd2f0-3464-4cf2-91e5-db12eabd3a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:42.353379 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccd2f0-3464-4cf2-91e5-db12eabd3a7a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-c1ccd2f0-3464-4cf2-91e5-db12eabd3a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:42.370877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:42.371793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:42.372714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:42.372714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:42.372714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:42.372714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:42.372714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 261/512] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:42.373263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccd2f0-3464-4cf2-91e5-db12eabd3a7a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:42.400773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf552f-d4d9-4d12-8948-59513e978daf None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:42.433728 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a37d6-0884-4e80-9a4e-0907b04da09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:42.434506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a37d6-0884-4e80-9a4e-0907b04da09a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:42.434787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a37d6-0884-4e80-9a4e-0907b04da09a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:42.435061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a37d6-0884-4e80-9a4e-0907b04da09a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:42.444704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a37d6-0884-4e80-9a4e-0907b04da09a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:42.450425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a37d6-0884-4e80-9a4e-0907b04da09a None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:42.452442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-821a37d6-0884-4e80-9a4e-0907b04da09a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:42.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:42.470911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:42.471842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:42.471842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:42.471842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:42.471842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:42.471842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 252/513] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:42.472118 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a37d6-0884-4e80-9a4e-0907b04da09a None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:42.476171 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccd2f0-3464-4cf2-91e5-db12eabd3a7a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:42.510345 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd287a1-1fc2-4fcc-b5b7-9ab261836477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:42.510922 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd287a1-1fc2-4fcc-b5b7-9ab261836477 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:42.511204 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd287a1-1fc2-4fcc-b5b7-9ab261836477 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:42.511500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd287a1-1fc2-4fcc-b5b7-9ab261836477 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:42.512216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd287a1-1fc2-4fcc-b5b7-9ab261836477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:42.512525 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd287a1-1fc2-4fcc-b5b7-9ab261836477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:42.513889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd287a1-1fc2-4fcc-b5b7-9ab261836477 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:42.525298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 262/514] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:42.526072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd287a1-1fc2-4fcc-b5b7-9ab261836477 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:42.569569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a37d6-0884-4e80-9a4e-0907b04da09a None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:42.576998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:42.602643 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b6db9-3e1c-45f1-b3f1-ba80ecb09c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:42.603419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b6db9-3e1c-45f1-b3f1-ba80ecb09c40 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:42.603725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b6db9-3e1c-45f1-b3f1-ba80ecb09c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:42.603995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b6db9-3e1c-45f1-b3f1-ba80ecb09c40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:42.613657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b6db9-3e1c-45f1-b3f1-ba80ecb09c40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:42.615105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b6db9-3e1c-45f1-b3f1-ba80ecb09c40 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:42.627487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd287a1-1fc2-4fcc-b5b7-9ab261836477 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-d06b6db9-3e1c-45f1-b3f1-ba80ecb09c40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:42.633097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:42.633987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:42.635167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:42.635167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:42.635167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:42.635167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:42.635167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 253/515] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:42.635447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b6db9-3e1c-45f1-b3f1-ba80ecb09c40 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:42.665919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaddb76-a2d3-40ac-a7ad-6e92824cc6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:42.666701 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaddb76-a2d3-40ac-a7ad-6e92824cc6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:42.666979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaddb76-a2d3-40ac-a7ad-6e92824cc6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:42.667245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaddb76-a2d3-40ac-a7ad-6e92824cc6a2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:42.674869 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaddb76-a2d3-40ac-a7ad-6e92824cc6a2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:42.676344 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaddb76-a2d3-40ac-a7ad-6e92824cc6a2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:42.681870 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-5aaddb76-a2d3-40ac-a7ad-6e92824cc6a2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:42.691142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:42.692099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:42.693177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:42.693177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:42.693177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:42.693177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:42.693177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:42.693177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:42.693177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:42.693177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:42.693177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 10:21:42.693177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:42.693177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 263/516] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:42.693177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaddb76-a2d3-40ac-a7ad-6e92824cc6a2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:42.736867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b6db9-3e1c-45f1-b3f1-ba80ecb09c40 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:42.770381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd6f0f-a863-47f7-8676-039d7e6ba699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:42.770975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd6f0f-a863-47f7-8676-039d7e6ba699 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:42.771262 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd6f0f-a863-47f7-8676-039d7e6ba699 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:42.771581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd6f0f-a863-47f7-8676-039d7e6ba699 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:42.772305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd6f0f-a863-47f7-8676-039d7e6ba699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:42.772614 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd6f0f-a863-47f7-8676-039d7e6ba699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:42.774285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd6f0f-a863-47f7-8676-039d7e6ba699 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:42.785402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 254/517] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:42.786183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd6f0f-a863-47f7-8676-039d7e6ba699 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:42.790744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaddb76-a2d3-40ac-a7ad-6e92824cc6a2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:42.801376 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:42.831212 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7371c5-6c00-41db-944b-ad741ffd3a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:42.831899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7371c5-6c00-41db-944b-ad741ffd3a4f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:42.832186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7371c5-6c00-41db-944b-ad741ffd3a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:42.832463 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7371c5-6c00-41db-944b-ad741ffd3a4f None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:42.833183 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7371c5-6c00-41db-944b-ad741ffd3a4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:42.833490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7371c5-6c00-41db-944b-ad741ffd3a4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:42.834864 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7371c5-6c00-41db-944b-ad741ffd3a4f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:42.846694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 264/518] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:42.847933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7371c5-6c00-41db-944b-ad741ffd3a4f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:42.894866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd6f0f-a863-47f7-8676-039d7e6ba699 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:42.902341 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:42.928363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e07788-5b24-4cc3-8ff2-ccc55efaea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:42.929144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e07788-5b24-4cc3-8ff2-ccc55efaea7a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:42.929420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e07788-5b24-4cc3-8ff2-ccc55efaea7a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:42.929716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e07788-5b24-4cc3-8ff2-ccc55efaea7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:42.936184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e07788-5b24-4cc3-8ff2-ccc55efaea7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:42.937627 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e07788-5b24-4cc3-8ff2-ccc55efaea7a None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:42.948322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7371c5-6c00-41db-944b-ad741ffd3a4f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-42e07788-5b24-4cc3-8ff2-ccc55efaea7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:21:42.952306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:42.953191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:42.954077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:21:42.954077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:21:42.954077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:21:42.954077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:21:42.954077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:21:42.954077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:21:42.954077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:42.954077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:42.954077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 255/519] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:42.954573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e07788-5b24-4cc3-8ff2-ccc55efaea7a None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:42.991872 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c1893-79b3-4a10-8d16-d68666745f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:42.992518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c1893-79b3-4a10-8d16-d68666745f1e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:42.992795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c1893-79b3-4a10-8d16-d68666745f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:42.993066 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c1893-79b3-4a10-8d16-d68666745f1e None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:42.993774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c1893-79b3-4a10-8d16-d68666745f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:42.994075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c1893-79b3-4a10-8d16-d68666745f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:42.995432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c1893-79b3-4a10-8d16-d68666745f1e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:43.006517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 265/520] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:43.007488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c1893-79b3-4a10-8d16-d68666745f1e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:43.038114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:43.057675 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e07788-5b24-4cc3-8ff2-ccc55efaea7a None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:43.090458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0b601-b519-4aaf-9a22-e846af8a6263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:43.091114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b601-b519-4aaf-9a22-e846af8a6263 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:43.091395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b601-b519-4aaf-9a22-e846af8a6263 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:43.091696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b601-b519-4aaf-9a22-e846af8a6263 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:43.092520 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0b601-b519-4aaf-9a22-e846af8a6263 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:43.092822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0b601-b519-4aaf-9a22-e846af8a6263 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:43.094238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0b601-b519-4aaf-9a22-e846af8a6263 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:43.106978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c1893-79b3-4a10-8d16-d68666745f1e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:43.111056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 256/521] 10.222.0.50 () {56 vars in 1139 bytes} [Wed Jun 15 10:21:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:43.111869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0b601-b519-4aaf-9a22-e846af8a6263 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:43.135063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:43.143421 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b13928-fe09-48be-8e3a-3eac6feb21f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:43.144224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b13928-fe09-48be-8e3a-3eac6feb21f2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:43.144504 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b13928-fe09-48be-8e3a-3eac6feb21f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:43.144784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b13928-fe09-48be-8e3a-3eac6feb21f2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:43.152658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b13928-fe09-48be-8e3a-3eac6feb21f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:43.154096 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b13928-fe09-48be-8e3a-3eac6feb21f2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-52b13928-fe09-48be-8e3a-3eac6feb21f2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:43.168522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:43.169469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:43.170407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:43.170407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:43.170407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:43.170407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:43.170407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:43.170407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:43.170407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:43.170407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:43.170407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 10:21:43.170407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:43.170407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 266/522] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:43.171000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b13928-fe09-48be-8e3a-3eac6feb21f2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:43.213734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0b601-b519-4aaf-9a22-e846af8a6263 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:43.248535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73065ea-ec79-492e-853d-70e9f9c81129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:43.249200 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73065ea-ec79-492e-853d-70e9f9c81129 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:43.249487 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73065ea-ec79-492e-853d-70e9f9c81129 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:43.249764 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73065ea-ec79-492e-853d-70e9f9c81129 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:43.250486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73065ea-ec79-492e-853d-70e9f9c81129 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:43.251954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73065ea-ec79-492e-853d-70e9f9c81129 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:43.259534 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:43.270878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 257/523] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:21:43 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:21:43.271016 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b13928-fe09-48be-8e3a-3eac6feb21f2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:43.271713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73065ea-ec79-492e-853d-70e9f9c81129 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:43.313886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f29de-571d-46d7-aedb-16dfd75522ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:43.314558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f29de-571d-46d7-aedb-16dfd75522ec None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:43.314927 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f29de-571d-46d7-aedb-16dfd75522ec None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:43.315344 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f29de-571d-46d7-aedb-16dfd75522ec None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:43.316186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f29de-571d-46d7-aedb-16dfd75522ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:43.316559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f29de-571d-46d7-aedb-16dfd75522ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:43.318115 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f29de-571d-46d7-aedb-16dfd75522ec None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:43.345076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 267/524] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:21:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:43.345076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f29de-571d-46d7-aedb-16dfd75522ec None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:43.376863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:43.405596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73065ea-ec79-492e-853d-70e9f9c81129 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:43.446866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef756a-609d-4cdf-bf52-5492a816f908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:43.447734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef756a-609d-4cdf-bf52-5492a816f908 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:43.448272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef756a-609d-4cdf-bf52-5492a816f908 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:43.449159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef756a-609d-4cdf-bf52-5492a816f908 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:43.455015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f29de-571d-46d7-aedb-16dfd75522ec None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:43.457277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef756a-609d-4cdf-bf52-5492a816f908 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:43.459517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef756a-609d-4cdf-bf52-5492a816f908 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-acef756a-609d-4cdf-bf52-5492a816f908 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:21:43.475342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:43.476527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:43.477632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:21:43.477632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:21:43.477632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:21:43.477632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:21:43.477632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:21:43.477632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:21:43.477632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:43.477632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:43.478214 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 258/525] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:43.478851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef756a-609d-4cdf-bf52-5492a816f908 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:43.496995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cab1e-92ac-464f-aabf-e40af5a50263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:43.497805 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cab1e-92ac-464f-aabf-e40af5a50263 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:43.498287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cab1e-92ac-464f-aabf-e40af5a50263 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:43.498519 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cab1e-92ac-464f-aabf-e40af5a50263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:43.519083 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:43.571630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cab1e-92ac-464f-aabf-e40af5a50263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:43.573289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cab1e-92ac-464f-aabf-e40af5a50263 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:43.590075 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef756a-609d-4cdf-bf52-5492a816f908 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:43.626405 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215c4c4-0bf2-4e4d-8bca-d6cc0fc1a680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:43.627186 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215c4c4-0bf2-4e4d-8bca-d6cc0fc1a680 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:43.627499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215c4c4-0bf2-4e4d-8bca-d6cc0fc1a680 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:43.627883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215c4c4-0bf2-4e4d-8bca-d6cc0fc1a680 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:43.628725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215c4c4-0bf2-4e4d-8bca-d6cc0fc1a680 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:43.629036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215c4c4-0bf2-4e4d-8bca-d6cc0fc1a680 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:43.630719 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215c4c4-0bf2-4e4d-8bca-d6cc0fc1a680 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:43.640697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:43.654725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 259/526] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Jun 15 10:21:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:43.654725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215c4c4-0bf2-4e4d-8bca-d6cc0fc1a680 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:43.685564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 268/527] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:43.686504 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cab1e-92ac-464f-aabf-e40af5a50263 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:43.740224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:43.763279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215c4c4-0bf2-4e4d-8bca-d6cc0fc1a680 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:43.797404 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18883f-1a7b-49df-8b9e-6185f9199cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:43.797720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cab1e-92ac-464f-aabf-e40af5a50263 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:43.798052 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18883f-1a7b-49df-8b9e-6185f9199cad None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:43.798335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18883f-1a7b-49df-8b9e-6185f9199cad None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:43.798605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18883f-1a7b-49df-8b9e-6185f9199cad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:43.799424 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18883f-1a7b-49df-8b9e-6185f9199cad None admin] RBAC: Adding query filter params (role.id=f6ffe6f612824e50a23f0b06a16a1f91, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=68f1b06364a24554bba9936621127752) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:43.799763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18883f-1a7b-49df-8b9e-6185f9199cad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:43.801226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18883f-1a7b-49df-8b9e-6185f9199cad None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:43.815496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 260/528] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:43 2022] GET /identity/v3/role_assignments?user.id=68f1b06364a24554bba9936621127752&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=f6ffe6f612824e50a23f0b06a16a1f91 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:43.815496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18883f-1a7b-49df-8b9e-6185f9199cad None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:43.846728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64d5aa-b0d5-4c45-bb98-1d60368217c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:43.847546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d5aa-b0d5-4c45-bb98-1d60368217c5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:43.847948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d5aa-b0d5-4c45-bb98-1d60368217c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:43.848301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d5aa-b0d5-4c45-bb98-1d60368217c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:43.849214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64d5aa-b0d5-4c45-bb98-1d60368217c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:43.849601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64d5aa-b0d5-4c45-bb98-1d60368217c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:43.851378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64d5aa-b0d5-4c45-bb98-1d60368217c5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:43.870388 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 269/529] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:21:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:43.871446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64d5aa-b0d5-4c45-bb98-1d60368217c5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:43.881608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:43.929041 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18883f-1a7b-49df-8b9e-6185f9199cad None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:43.970089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41c2ba-e906-4500-b472-4868049c6e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:43.970896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c2ba-e906-4500-b472-4868049c6e01 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:43.971310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c2ba-e906-4500-b472-4868049c6e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:43.971682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41c2ba-e906-4500-b472-4868049c6e01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:44.013938 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64d5aa-b0d5-4c45-bb98-1d60368217c5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:44.026244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:44.055329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3aa221-319e-46b6-90bf-1faee892ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:44.056136 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3aa221-319e-46b6-90bf-1faee892ec19 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:44.056417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3aa221-319e-46b6-90bf-1faee892ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:44.056684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3aa221-319e-46b6-90bf-1faee892ec19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:44.069640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3aa221-319e-46b6-90bf-1faee892ec19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:44.071344 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3aa221-319e-46b6-90bf-1faee892ec19 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:44.072245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41c2ba-e906-4500-b472-4868049c6e01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:44.074172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41c2ba-e906-4500-b472-4868049c6e01 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-3d3aa221-319e-46b6-90bf-1faee892ec19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:44.090300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:44.091329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:44.092851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:44.092851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:44.092851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:44.092851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:44.092851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 270/530] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:44.092851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3aa221-319e-46b6-90bf-1faee892ec19 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:44.146494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:44.197872 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3aa221-319e-46b6-90bf-1faee892ec19 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:44.198271 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 261/531] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:44.199565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41c2ba-e906-4500-b472-4868049c6e01 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:44.231915 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d81cfc-7aad-4c24-bec8-39002e1926a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:44.232782 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d81cfc-7aad-4c24-bec8-39002e1926a5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:44.232916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d81cfc-7aad-4c24-bec8-39002e1926a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:44.233115 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d81cfc-7aad-4c24-bec8-39002e1926a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:44.233993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d81cfc-7aad-4c24-bec8-39002e1926a5 None admin] RBAC: Adding query filter params (role.id=f6ffe6f612824e50a23f0b06a16a1f91, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=81e9805ec4c44cedb658b7becf768369) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:44.234245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d81cfc-7aad-4c24-bec8-39002e1926a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:44.235707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d81cfc-7aad-4c24-bec8-39002e1926a5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:44.247783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 271/532] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:44 2022] GET /identity/v3/role_assignments?user.id=81e9805ec4c44cedb658b7becf768369&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=f6ffe6f612824e50a23f0b06a16a1f91 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:44.248879 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d81cfc-7aad-4c24-bec8-39002e1926a5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:44.298089 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:44.336662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41c2ba-e906-4500-b472-4868049c6e01 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:44.418884 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23f4e8-8df8-4768-959a-963c5b72c5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:44.419495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23f4e8-8df8-4768-959a-963c5b72c5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:44.419775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23f4e8-8df8-4768-959a-963c5b72c5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:44.420047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23f4e8-8df8-4768-959a-963c5b72c5a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:44.420777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23f4e8-8df8-4768-959a-963c5b72c5a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:44.421079 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23f4e8-8df8-4768-959a-963c5b72c5a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:44.422466 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23f4e8-8df8-4768-959a-963c5b72c5a4 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:44.442067 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 262/533] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:44.456115 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23f4e8-8df8-4768-959a-963c5b72c5a4 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:44.465179 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d81cfc-7aad-4c24-bec8-39002e1926a5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:44.488571 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:44.513303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72232611-1414-49c8-998a-48366f60d6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:44.514100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72232611-1414-49c8-998a-48366f60d6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:44.514412 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72232611-1414-49c8-998a-48366f60d6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:44.514814 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72232611-1414-49c8-998a-48366f60d6c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:44.536864 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72232611-1414-49c8-998a-48366f60d6c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:44.538408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72232611-1414-49c8-998a-48366f60d6c8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-72232611-1414-49c8-998a-48366f60d6c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:44.571455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:44.572515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:44.574041 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:44.574041 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:44.574041 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:44.574041 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:44.574041 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 272/534] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:44.578162 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23f4e8-8df8-4768-959a-963c5b72c5a4 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:44.580379 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72232611-1414-49c8-998a-48366f60d6c8 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:44.617317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79f947-f6af-4f5f-92cb-de414c1403d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:44.618816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79f947-f6af-4f5f-92cb-de414c1403d7 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:44.619369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79f947-f6af-4f5f-92cb-de414c1403d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:44.619973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79f947-f6af-4f5f-92cb-de414c1403d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:44.627602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79f947-f6af-4f5f-92cb-de414c1403d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:44.629424 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79f947-f6af-4f5f-92cb-de414c1403d7 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-4c79f947-f6af-4f5f-92cb-de414c1403d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:21:44.646775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:44.647772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:44.649204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:21:44.649204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:21:44.649204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:21:44.649204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:21:44.649204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:21:44.649204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:21:44.649204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:44.649204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:44.652151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 263/535] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:44.659709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79f947-f6af-4f5f-92cb-de414c1403d7 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:44.747082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:44.778680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:44.790915 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72232611-1414-49c8-998a-48366f60d6c8 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:44.807601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79f947-f6af-4f5f-92cb-de414c1403d7 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:44.864401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce2593-a79e-4fec-9bbe-bbaf4678adb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:44.865476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce2593-a79e-4fec-9bbe-bbaf4678adb1 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:44.865960 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce2593-a79e-4fec-9bbe-bbaf4678adb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:44.866703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce2593-a79e-4fec-9bbe-bbaf4678adb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:44.868426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce2593-a79e-4fec-9bbe-bbaf4678adb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:44.868957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce2593-a79e-4fec-9bbe-bbaf4678adb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:44.870700 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce2593-a79e-4fec-9bbe-bbaf4678adb1 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:44.889945 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 264/536] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:21:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:44.896306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953348f-e05a-483d-9b58-d8f2c5d20dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:44.896306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953348f-e05a-483d-9b58-d8f2c5d20dff None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:44.896306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953348f-e05a-483d-9b58-d8f2c5d20dff None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:44.896306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953348f-e05a-483d-9b58-d8f2c5d20dff None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:44.896655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953348f-e05a-483d-9b58-d8f2c5d20dff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:44.896655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953348f-e05a-483d-9b58-d8f2c5d20dff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:44.896780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce2593-a79e-4fec-9bbe-bbaf4678adb1 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:44.896850 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953348f-e05a-483d-9b58-d8f2c5d20dff None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:44.920228 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 273/537] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:44.924269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953348f-e05a-483d-9b58-d8f2c5d20dff None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:45.071310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce2593-a79e-4fec-9bbe-bbaf4678adb1 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:45.102640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953348f-e05a-483d-9b58-d8f2c5d20dff None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:45.134477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be1de8-1908-4876-8ada-2ae85e635c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:45.135139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1de8-1908-4876-8ada-2ae85e635c45 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:45.135415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1de8-1908-4876-8ada-2ae85e635c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:45.135711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1de8-1908-4876-8ada-2ae85e635c45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:45.136546 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be1de8-1908-4876-8ada-2ae85e635c45 None admin] RBAC: Adding query filter params (role.id=f6ffe6f612824e50a23f0b06a16a1f91, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=5f2e2038f69f49019a1e528107296223) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:45.136851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be1de8-1908-4876-8ada-2ae85e635c45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:45.138292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be1de8-1908-4876-8ada-2ae85e635c45 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:45.147089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 265/538] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:44 2022] GET /identity/v3/role_assignments?user.id=5f2e2038f69f49019a1e528107296223&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=f6ffe6f612824e50a23f0b06a16a1f91 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:45.174411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f500b62-f7e5-40b0-a0d3-bb94eb3e0f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:45.175223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f500b62-f7e5-40b0-a0d3-bb94eb3e0f65 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:45.175520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f500b62-f7e5-40b0-a0d3-bb94eb3e0f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:45.175796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f500b62-f7e5-40b0-a0d3-bb94eb3e0f65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:45.185796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f500b62-f7e5-40b0-a0d3-bb94eb3e0f65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:45.187292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f500b62-f7e5-40b0-a0d3-bb94eb3e0f65 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:45.194556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-2f500b62-f7e5-40b0-a0d3-bb94eb3e0f65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:21:45.214623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:45.215984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:45.217450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:21:45.217450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:21:45.217450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:21:45.217450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:21:45.217450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:21:45.217450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:21:45.217450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:45.217450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:45.217450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 274/539] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:45.222129 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be1de8-1908-4876-8ada-2ae85e635c45 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:45.238097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:45.423012 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be1de8-1908-4876-8ada-2ae85e635c45 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:45.458083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142a6c5-cb84-44d8-8705-e9df49ae5542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:45.458744 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a6c5-cb84-44d8-8705-e9df49ae5542 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:45.459022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a6c5-cb84-44d8-8705-e9df49ae5542 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:45.459293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a6c5-cb84-44d8-8705-e9df49ae5542 None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:45.460110 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142a6c5-cb84-44d8-8705-e9df49ae5542 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:45.460415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142a6c5-cb84-44d8-8705-e9df49ae5542 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:45.462369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142a6c5-cb84-44d8-8705-e9df49ae5542 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:45.475580 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 266/540] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:21:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:45.481861 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f500b62-f7e5-40b0-a0d3-bb94eb3e0f65 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:45.646287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f500b62-f7e5-40b0-a0d3-bb94eb3e0f65 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:45.703571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d63e2b-e836-499d-a4a5-a4c377f9fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:45.704121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d63e2b-e836-499d-a4a5-a4c377f9fcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:45.704404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d63e2b-e836-499d-a4a5-a4c377f9fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:45.704683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d63e2b-e836-499d-a4a5-a4c377f9fcf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:45.705514 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d63e2b-e836-499d-a4a5-a4c377f9fcf8 None admin] RBAC: Adding query filter params (role.id=f6ffe6f612824e50a23f0b06a16a1f91, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=383ef65dd6b14810a7a2a8e06143eca2) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:45.705823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d63e2b-e836-499d-a4a5-a4c377f9fcf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:45.707255 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d63e2b-e836-499d-a4a5-a4c377f9fcf8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:45.715902 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 275/541] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:45 2022] GET /identity/v3/role_assignments?user.id=383ef65dd6b14810a7a2a8e06143eca2&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=f6ffe6f612824e50a23f0b06a16a1f91 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:45.720023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005fbff-806d-45b2-833a-279aacc8d68c None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:45.720505 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005fbff-806d-45b2-833a-279aacc8d68c None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:45.720582 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005fbff-806d-45b2-833a-279aacc8d68c None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:45.721963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 267/542] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:45.727921 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1790-4be5-47fb-936f-e80b8c5ee514 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:45.728230 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1790-4be5-47fb-936f-e80b8c5ee514 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:45.728478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1790-4be5-47fb-936f-e80b8c5ee514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:45.769108 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-11be1790-4be5-47fb-936f-e80b8c5ee514 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:45.770334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-11be1790-4be5-47fb-936f-e80b8c5ee514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:45.861287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:45.876269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 276/543] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:45.902556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005fbff-806d-45b2-833a-279aacc8d68c None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:46.013672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:46.060738 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005fbff-806d-45b2-833a-279aacc8d68c None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:46.110100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9c1b3-d07e-46eb-92e0-fc991a0e3c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:46.110899 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9c1b3-d07e-46eb-92e0-fc991a0e3c7d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:46.111173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9c1b3-d07e-46eb-92e0-fc991a0e3c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:46.111442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9c1b3-d07e-46eb-92e0-fc991a0e3c7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:46.127751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9c1b3-d07e-46eb-92e0-fc991a0e3c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-36c9c1b3-d07e-46eb-92e0-fc991a0e3c7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:46.136234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:46.137242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:46.138080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:46.138080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:46.138080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:46.138080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:46.138080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:46.138080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:46.138080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:46.138080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:46.138080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:46.138080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:46.138080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:46.138080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:46.138080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 268/544] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:46.143967 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be1790-4be5-47fb-936f-e80b8c5ee514 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:46.259989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494429f-738f-4c24-971a-b26450cb75ec None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:46.260351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494429f-738f-4c24-971a-b26450cb75ec None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:46.260554 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494429f-738f-4c24-971a-b26450cb75ec None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:46.261896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 269/545] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:21:46.267314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fe15f-06af-4831-87af-a0ee4947e377 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:46.267578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fe15f-06af-4831-87af-a0ee4947e377 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:46.267839 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fe15f-06af-4831-87af-a0ee4947e377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:46.293654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be1790-4be5-47fb-936f-e80b8c5ee514 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:46.308509 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-e74fe15f-06af-4831-87af-a0ee4947e377 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:46.309726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-e74fe15f-06af-4831-87af-a0ee4947e377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:46.350835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5e5de-f7a8-4c7b-98cd-f1af525ec866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:46.352071 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5e5de-f7a8-4c7b-98cd-f1af525ec866 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:46.352351 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5e5de-f7a8-4c7b-98cd-f1af525ec866 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:46.352624 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5e5de-f7a8-4c7b-98cd-f1af525ec866 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:46.353376 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5e5de-f7a8-4c7b-98cd-f1af525ec866 None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:46.353677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5e5de-f7a8-4c7b-98cd-f1af525ec866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:46.355063 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5e5de-f7a8-4c7b-98cd-f1af525ec866 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:46.376184 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 277/546] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:46.382698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5e5de-f7a8-4c7b-98cd-f1af525ec866 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:46.419255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 270/547] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:46.445838 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:46.452134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fe15f-06af-4831-87af-a0ee4947e377 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:46.491873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5e5de-f7a8-4c7b-98cd-f1af525ec866 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:46.526821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fac36b-574e-47eb-8a47-2546820ef683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:46.528198 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fac36b-574e-47eb-8a47-2546820ef683 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:46.528638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fac36b-574e-47eb-8a47-2546820ef683 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:46.529049 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fac36b-574e-47eb-8a47-2546820ef683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:46.540685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fac36b-574e-47eb-8a47-2546820ef683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:46.542873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fac36b-574e-47eb-8a47-2546820ef683 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-12fac36b-574e-47eb-8a47-2546820ef683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:46.561197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:46.562134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:46.563042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:46.563042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:46.563042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:46.563042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:46.565162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 278/548] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:46.570783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fac36b-574e-47eb-8a47-2546820ef683 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:46.608438 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:46.689194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fac36b-574e-47eb-8a47-2546820ef683 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:46.703927 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:46.722918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fe15f-06af-4831-87af-a0ee4947e377 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:46.736215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9c7f9-4703-4c73-a71d-780d7f582fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:46.737281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9c7f9-4703-4c73-a71d-780d7f582fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:46.737737 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9c7f9-4703-4c73-a71d-780d7f582fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:46.738214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9c7f9-4703-4c73-a71d-780d7f582fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:46.739113 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9c7f9-4703-4c73-a71d-780d7f582fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:46.739717 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9c7f9-4703-4c73-a71d-780d7f582fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:46.746203 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9c7f9-4703-4c73-a71d-780d7f582fc2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:46.763679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 279/549] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:46.765223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330c992-8865-4de7-8cbf-829e6dce37d5 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:46.765680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330c992-8865-4de7-8cbf-829e6dce37d5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:46.766150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330c992-8865-4de7-8cbf-829e6dce37d5 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:46.767777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 280/550] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:46.768751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330c992-8865-4de7-8cbf-829e6dce37d5 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:46.772858 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349a50f-c52d-4d38-8f2f-6028cff18dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:46.774206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a50f-c52d-4d38-8f2f-6028cff18dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:46.774487 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a50f-c52d-4d38-8f2f-6028cff18dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:46.774762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a50f-c52d-4d38-8f2f-6028cff18dd9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:46.789944 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349a50f-c52d-4d38-8f2f-6028cff18dd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-e349a50f-c52d-4d38-8f2f-6028cff18dd9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:46.798574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:46.800061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:46.801446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:46.801446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:46.801446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:46.801446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:46.801446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:46.801446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:46.801446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:46.801446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:46.801446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:46.801446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:46.801446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:46.801446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:46.801446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 271/551] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:46.802172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8830b-720e-4887-96a2-90a75037f464 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:46.802172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8830b-720e-4887-96a2-90a75037f464 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:46.802575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8830b-720e-4887-96a2-90a75037f464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:46.826333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ece8830b-720e-4887-96a2-90a75037f464 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:46.827874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ece8830b-720e-4887-96a2-90a75037f464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:46.878571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330c992-8865-4de7-8cbf-829e6dce37d5 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:46.916157 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282adf4-b46d-40d0-8e1a-718127d4df19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:46.916853 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282adf4-b46d-40d0-8e1a-718127d4df19 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:46.917131 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282adf4-b46d-40d0-8e1a-718127d4df19 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:46.917403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282adf4-b46d-40d0-8e1a-718127d4df19 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:46.923712 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 272/552] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:46.924590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8830b-720e-4887-96a2-90a75037f464 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:46.925051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282adf4-b46d-40d0-8e1a-718127d4df19 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:46.926466 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282adf4-b46d-40d0-8e1a-718127d4df19 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-2282adf4-b46d-40d0-8e1a-718127d4df19 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:46.942437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:46.944400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:46.946313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:46.946313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:46.946313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:46.946313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:46.946313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:46.946313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:46.946313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:46.946313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:46.946313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 10:21:46.946313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:46.946313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 281/553] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:21:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:46.956626 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282adf4-b46d-40d0-8e1a-718127d4df19 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:46.985493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:46.988306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:47.046022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8830b-720e-4887-96a2-90a75037f464 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:47.068328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282adf4-b46d-40d0-8e1a-718127d4df19 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:47.082964 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d1f70-3633-46b1-aeb6-3b72c9a0b296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:47.083766 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d1f70-3633-46b1-aeb6-3b72c9a0b296 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:47.084059 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d1f70-3633-46b1-aeb6-3b72c9a0b296 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:47.084340 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d1f70-3633-46b1-aeb6-3b72c9a0b296 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:47.085092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d1f70-3633-46b1-aeb6-3b72c9a0b296 None admin] RBAC: Adding query filter params (name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:47.085402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d1f70-3633-46b1-aeb6-3b72c9a0b296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:47.087553 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d1f70-3633-46b1-aeb6-3b72c9a0b296 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:47.096547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 273/554] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:47.097567 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d1f70-3633-46b1-aeb6-3b72c9a0b296 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:47.105340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82cbaa-6859-4595-a632-568a602ee690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:47.106005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82cbaa-6859-4595-a632-568a602ee690 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:47.106284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82cbaa-6859-4595-a632-568a602ee690 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:47.106557 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82cbaa-6859-4595-a632-568a602ee690 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:47.107544 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82cbaa-6859-4595-a632-568a602ee690 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:47.107859 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82cbaa-6859-4595-a632-568a602ee690 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:47.109405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82cbaa-6859-4595-a632-568a602ee690 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:47.128870 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 282/555] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Jun 15 10:21:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:47.129798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82cbaa-6859-4595-a632-568a602ee690 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:47.224543 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d1f70-3633-46b1-aeb6-3b72c9a0b296 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:47.234187 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:47.250261 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:47.264061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644f2d-6290-4ce0-b959-ab6bf7f8685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:47.265105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644f2d-6290-4ce0-b959-ab6bf7f8685f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:47.265492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644f2d-6290-4ce0-b959-ab6bf7f8685f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:47.265872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87644f2d-6290-4ce0-b959-ab6bf7f8685f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:47.274076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82cbaa-6859-4595-a632-568a602ee690 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:47.278380 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87644f2d-6290-4ce0-b959-ab6bf7f8685f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-87644f2d-6290-4ce0-b959-ab6bf7f8685f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:47.286743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:47.287943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:47.289074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:47.289074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:47.289074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:47.289074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:47.289074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:47.289074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:47.289074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:47.289074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:47.289074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:47.289074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:47.289074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:47.289074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:47.295692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 274/556] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:47.296787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644f2d-6290-4ce0-b959-ab6bf7f8685f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:47.318495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d139b85-42b2-4dce-ab50-210684e9a6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:47.319555 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d139b85-42b2-4dce-ab50-210684e9a6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:47.319997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d139b85-42b2-4dce-ab50-210684e9a6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:47.321488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d139b85-42b2-4dce-ab50-210684e9a6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:47.335712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d139b85-42b2-4dce-ab50-210684e9a6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:47.339020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d139b85-42b2-4dce-ab50-210684e9a6d1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-4d139b85-42b2-4dce-ab50-210684e9a6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:47.364008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:47.365619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:47.367672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:47.367672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:47.367672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:47.367672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:47.370528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 283/557] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:47.371650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d139b85-42b2-4dce-ab50-210684e9a6d1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:47.412583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87644f2d-6290-4ce0-b959-ab6bf7f8685f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:47.458266 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798b47f-7bec-4731-9fb8-cd738f444e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:47.459175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798b47f-7bec-4731-9fb8-cd738f444e5b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:47.459920 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798b47f-7bec-4731-9fb8-cd738f444e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:47.460379 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798b47f-7bec-4731-9fb8-cd738f444e5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:47.497651 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d139b85-42b2-4dce-ab50-210684e9a6d1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:47.509848 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:47.536768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09caaaa3-25a9-4490-a3d4-7563da4cc786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:47.537737 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caaaa3-25a9-4490-a3d4-7563da4cc786 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:47.538075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caaaa3-25a9-4490-a3d4-7563da4cc786 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:47.538456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caaaa3-25a9-4490-a3d4-7563da4cc786 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:47.539505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09caaaa3-25a9-4490-a3d4-7563da4cc786 None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:47.539972 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09caaaa3-25a9-4490-a3d4-7563da4cc786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:47.541568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09caaaa3-25a9-4490-a3d4-7563da4cc786 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:47.544746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:47.555558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798b47f-7bec-4731-9fb8-cd738f444e5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:47.557214 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798b47f-7bec-4731-9fb8-cd738f444e5b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:47.558728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 284/558] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:47.560005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09caaaa3-25a9-4490-a3d4-7563da4cc786 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:47.694144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 275/559] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:47.696316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798b47f-7bec-4731-9fb8-cd738f444e5b None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:47.720119 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09caaaa3-25a9-4490-a3d4-7563da4cc786 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:47.759386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c480231-4f64-47c6-8153-101e339813df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:47.760082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c480231-4f64-47c6-8153-101e339813df None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:47.760361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c480231-4f64-47c6-8153-101e339813df None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:47.760679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c480231-4f64-47c6-8153-101e339813df None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:47.761377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c480231-4f64-47c6-8153-101e339813df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:47.761690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c480231-4f64-47c6-8153-101e339813df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:47.763252 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c480231-4f64-47c6-8153-101e339813df None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:47.779117 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 285/560] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:47.780099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c480231-4f64-47c6-8153-101e339813df None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:47.793231 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:47.841480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798b47f-7bec-4731-9fb8-cd738f444e5b None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:47.861206 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:47.888147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bb1c4-815a-4271-81a7-27f977622976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:47.889601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bb1c4-815a-4271-81a7-27f977622976 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:47.890032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bb1c4-815a-4271-81a7-27f977622976 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:47.890389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bb1c4-815a-4271-81a7-27f977622976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:47.906072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bb1c4-815a-4271-81a7-27f977622976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:47.908306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bb1c4-815a-4271-81a7-27f977622976 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:47.916726 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c480231-4f64-47c6-8153-101e339813df None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-003bb1c4-815a-4271-81a7-27f977622976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:47.931814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:47.932785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:47.934234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:47.934234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:47.934234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:47.934234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:47.934234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 276/561] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:47.934696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bb1c4-815a-4271-81a7-27f977622976 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:47.958595 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca5deb-c19e-474c-a425-9b9031b91fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:47.959776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca5deb-c19e-474c-a425-9b9031b91fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:47.960274 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca5deb-c19e-474c-a425-9b9031b91fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:47.960766 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca5deb-c19e-474c-a425-9b9031b91fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:47.973356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca5deb-c19e-474c-a425-9b9031b91fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:47.975087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca5deb-c19e-474c-a425-9b9031b91fd1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-89ca5deb-c19e-474c-a425-9b9031b91fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:47.996107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:47.997348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:47.998308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:47.998308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:47.998308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:47.998308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:47.998308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 286/562] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:47.999062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa77b-123c-4037-9826-66a3b30ed707 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:47.999350 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa77b-123c-4037-9826-66a3b30ed707 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:47.999649 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa77b-123c-4037-9826-66a3b30ed707 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.000899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 287/563] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:48.001962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8aa77b-123c-4037-9826-66a3b30ed707 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:48.051603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bb1c4-815a-4271-81a7-27f977622976 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:48.078562 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:48.103637 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b51bb8-009e-4b53-a436-f2c64026c4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:48.104399 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b51bb8-009e-4b53-a436-f2c64026c4aa None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:48.104683 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b51bb8-009e-4b53-a436-f2c64026c4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:48.104962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b51bb8-009e-4b53-a436-f2c64026c4aa None admin] PATH_INFO: `/v3/users/glance` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.113374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b51bb8-009e-4b53-a436-f2c64026c4aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:48.115128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b51bb8-009e-4b53-a436-f2c64026c4aa None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:48.128877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8aa77b-123c-4037-9826-66a3b30ed707 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-d7b51bb8-009e-4b53-a436-f2c64026c4aa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:48.134760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:48.135827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:48.136818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:48.136818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:48.136818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:48.136818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:48.136818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:48.136818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:48.136818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:48.136818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:48.136818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 10:21:48.136818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:48.137386 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 277/564] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:48.141953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b51bb8-009e-4b53-a436-f2c64026c4aa None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:48.143068 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:48.170854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5075f-d7cb-467d-95d2-700c468f9de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:48.171537 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5075f-d7cb-467d-95d2-700c468f9de1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:48.171822 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5075f-d7cb-467d-95d2-700c468f9de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:48.172093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5075f-d7cb-467d-95d2-700c468f9de1 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.172816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5075f-d7cb-467d-95d2-700c468f9de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:48.173126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5075f-d7cb-467d-95d2-700c468f9de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:48.174487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5075f-d7cb-467d-95d2-700c468f9de1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:48.186892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 288/565] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:48.188353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c72e-4015-4f1a-8e79-35bf04dc47aa None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:48.188849 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c72e-4015-4f1a-8e79-35bf04dc47aa None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:48.188978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c72e-4015-4f1a-8e79-35bf04dc47aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.204983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-44a3c72e-4015-4f1a-8e79-35bf04dc47aa None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:48.206169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-44a3c72e-4015-4f1a-8e79-35bf04dc47aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:48.248084 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b51bb8-009e-4b53-a436-f2c64026c4aa None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:48.272266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 289/566] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:48.274150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8be2-481d-471e-b868-3605340ebe59 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:48.274450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8be2-481d-471e-b868-3605340ebe59 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:48.274752 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa8be2-481d-471e-b868-3605340ebe59 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.276181 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 290/567] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:48.276732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa8be2-481d-471e-b868-3605340ebe59 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:48.292768 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b0257-cd64-46b1-81a0-58fb2d6f4f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:48.293584 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b0257-cd64-46b1-81a0-58fb2d6f4f2c None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:48.293873 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b0257-cd64-46b1-81a0-58fb2d6f4f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:48.294149 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b0257-cd64-46b1-81a0-58fb2d6f4f2c None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.294869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b0257-cd64-46b1-81a0-58fb2d6f4f2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:48.295175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b0257-cd64-46b1-81a0-58fb2d6f4f2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:48.296580 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b0257-cd64-46b1-81a0-58fb2d6f4f2c None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:48.307757 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 278/568] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:48.308536 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b0257-cd64-46b1-81a0-58fb2d6f4f2c None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:48.350719 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:48.374706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:48.379402 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa8be2-481d-471e-b868-3605340ebe59 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:48.409898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b0257-cd64-46b1-81a0-58fb2d6f4f2c None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:48.413361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb53c1-daf5-4750-924d-15ce2394c197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:48.414552 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb53c1-daf5-4750-924d-15ce2394c197 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:48.414828 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb53c1-daf5-4750-924d-15ce2394c197 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:48.415094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb53c1-daf5-4750-924d-15ce2394c197 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.415960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb53c1-daf5-4750-924d-15ce2394c197 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:48.416262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb53c1-daf5-4750-924d-15ce2394c197 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:48.417670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb53c1-daf5-4750-924d-15ce2394c197 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:48.434128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 291/569] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Jun 15 10:21:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:48.435298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0342b30-95c3-45e0-871e-3fc8e8c60e39 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:48.435612 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0342b30-95c3-45e0-871e-3fc8e8c60e39 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:48.435889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0342b30-95c3-45e0-871e-3fc8e8c60e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.444907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec473f-28aa-4769-8131-a3a0850c962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:48.445732 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec473f-28aa-4769-8131-a3a0850c962a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:48.446020 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec473f-28aa-4769-8131-a3a0850c962a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:48.446298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec473f-28aa-4769-8131-a3a0850c962a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.451198 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f0342b30-95c3-45e0-871e-3fc8e8c60e39 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:48.452423 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f0342b30-95c3-45e0-871e-3fc8e8c60e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:48.454537 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec473f-28aa-4769-8131-a3a0850c962a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:48.456037 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec473f-28aa-4769-8131-a3a0850c962a None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-c1ec473f-28aa-4769-8131-a3a0850c962a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:48.470281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:48.471251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:48.472314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:48.472314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:48.472314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:48.472314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:48.472314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:48.472314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:48.472314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:48.472314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:48.472314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:21:48.472314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:48.472314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 279/570] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Jun 15 10:21:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:48.472314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec473f-28aa-4769-8131-a3a0850c962a None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:48.522728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 292/571] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:48.524457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0342b30-95c3-45e0-871e-3fc8e8c60e39 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:48.569021 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:48.572530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec473f-28aa-4769-8131-a3a0850c962a None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:48.605973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c6bb1-ff0b-4fe3-9872-97f283195d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:48.606764 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c6bb1-ff0b-4fe3-9872-97f283195d62 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:48.607047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c6bb1-ff0b-4fe3-9872-97f283195d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:48.607321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c6bb1-ff0b-4fe3-9872-97f283195d62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.612179 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:48.617801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c6bb1-ff0b-4fe3-9872-97f283195d62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:48.624847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0342b30-95c3-45e0-871e-3fc8e8c60e39 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-9f7c6bb1-ff0b-4fe3-9872-97f283195d62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:48.625596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:48.626583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:48.627579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:48.627579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:48.627579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:48.627579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:48.627579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:48.627579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:48.627579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:48.627579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:48.627579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:48.627579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:48.627579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:48.627579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:48.627579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 280/572] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:48.627579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c6bb1-ff0b-4fe3-9872-97f283195d62 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:48.664443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61559d-7054-482f-95d0-fc1d41002cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:48.665515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61559d-7054-482f-95d0-fc1d41002cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:48.665859 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61559d-7054-482f-95d0-fc1d41002cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:48.666130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61559d-7054-482f-95d0-fc1d41002cf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.673077 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61559d-7054-482f-95d0-fc1d41002cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:48.674525 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61559d-7054-482f-95d0-fc1d41002cf9 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-7a61559d-7054-482f-95d0-fc1d41002cf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:21:48.687999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:48.689035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:48.689994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:21:48.689994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:21:48.689994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:21:48.689994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:21:48.689994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:21:48.689994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:21:48.689994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:48.689994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:48.689994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 293/573] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:48.690500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61559d-7054-482f-95d0-fc1d41002cf9 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:48.733593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c6bb1-ff0b-4fe3-9872-97f283195d62 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:48.766210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32451477-900e-49ef-af2d-044ae8323d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:48.766996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32451477-900e-49ef-af2d-044ae8323d4e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:48.767288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32451477-900e-49ef-af2d-044ae8323d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:48.767595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32451477-900e-49ef-af2d-044ae8323d4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.779895 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32451477-900e-49ef-af2d-044ae8323d4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:48.781336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32451477-900e-49ef-af2d-044ae8323d4e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:48.789040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61559d-7054-482f-95d0-fc1d41002cf9 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-32451477-900e-49ef-af2d-044ae8323d4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:48.798298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:48.799555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:48.801165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:48.801165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:48.801165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:48.801165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:48.801165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 281/574] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:48.801165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32451477-900e-49ef-af2d-044ae8323d4e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:48.814480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:48.827086 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaa9e2-de38-46b6-88bf-56bcaef80de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:48.827772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaa9e2-de38-46b6-88bf-56bcaef80de7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:48.828055 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaa9e2-de38-46b6-88bf-56bcaef80de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:48.828327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaa9e2-de38-46b6-88bf-56bcaef80de7 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.829160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaa9e2-de38-46b6-88bf-56bcaef80de7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:48.829464 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaa9e2-de38-46b6-88bf-56bcaef80de7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:48.830878 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaa9e2-de38-46b6-88bf-56bcaef80de7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:48.848178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 294/575] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Jun 15 10:21:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:48.849287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaa9e2-de38-46b6-88bf-56bcaef80de7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:48.857962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:48.906414 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32451477-900e-49ef-af2d-044ae8323d4e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:48.939046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a7cef-eb17-42df-901d-84f25e0e2277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:48.939872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a7cef-eb17-42df-901d-84f25e0e2277 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:48.940155 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a7cef-eb17-42df-901d-84f25e0e2277 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:48.940430 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a7cef-eb17-42df-901d-84f25e0e2277 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.950987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a7cef-eb17-42df-901d-84f25e0e2277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:48.951741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaa9e2-de38-46b6-88bf-56bcaef80de7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-0d7a7cef-eb17-42df-901d-84f25e0e2277 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:48.958684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:48.959773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:48.960659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:48.960659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:48.960659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:48.960659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:48.960659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:48.960659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:48.960659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:48.960659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:48.960659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:48.960659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:48.960659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:48.960659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:48.960659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 282/576] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:48.960659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a7cef-eb17-42df-901d-84f25e0e2277 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:48.984961 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d7949-6e7a-423c-877e-a21a5cf96656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:48.985624 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d7949-6e7a-423c-877e-a21a5cf96656 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:48.985905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d7949-6e7a-423c-877e-a21a5cf96656 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:48.986177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d7949-6e7a-423c-877e-a21a5cf96656 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:48.986916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d7949-6e7a-423c-877e-a21a5cf96656 None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:48.987222 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d7949-6e7a-423c-877e-a21a5cf96656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:48.988608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d7949-6e7a-423c-877e-a21a5cf96656 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:48.997273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 295/577] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:48.998044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d7949-6e7a-423c-877e-a21a5cf96656 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:49.030793 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:49.061251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a7cef-eb17-42df-901d-84f25e0e2277 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:49.064372 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:49.094343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa32a8-e364-4378-84b1-d8538b2b7b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:49.094988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa32a8-e364-4378-84b1-d8538b2b7b42 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:49.095266 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa32a8-e364-4378-84b1-d8538b2b7b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:49.095565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa32a8-e364-4378-84b1-d8538b2b7b42 None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:49.096344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa32a8-e364-4378-84b1-d8538b2b7b42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:49.096648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa32a8-e364-4378-84b1-d8538b2b7b42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:49.098068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa32a8-e364-4378-84b1-d8538b2b7b42 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:49.099239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d7949-6e7a-423c-877e-a21a5cf96656 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:49.109797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 283/578] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:21:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:49.110575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa32a8-e364-4378-84b1-d8538b2b7b42 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:49.133434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece5616-1b91-4867-8418-7e751dc8b988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:49.134150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece5616-1b91-4867-8418-7e751dc8b988 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:49.134429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece5616-1b91-4867-8418-7e751dc8b988 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:49.134702 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece5616-1b91-4867-8418-7e751dc8b988 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:49.135448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece5616-1b91-4867-8418-7e751dc8b988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:49.135980 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece5616-1b91-4867-8418-7e751dc8b988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:49.137117 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece5616-1b91-4867-8418-7e751dc8b988 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:49.148445 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 296/579] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:49.149227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece5616-1b91-4867-8418-7e751dc8b988 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:49.218932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa32a8-e364-4378-84b1-d8538b2b7b42 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:49.249404 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:49.254795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604450f2-48f0-491b-801d-1dce51fee583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:49.255612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604450f2-48f0-491b-801d-1dce51fee583 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:49.255894 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604450f2-48f0-491b-801d-1dce51fee583 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:49.255995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece5616-1b91-4867-8418-7e751dc8b988 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:49.256169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604450f2-48f0-491b-801d-1dce51fee583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:49.266431 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604450f2-48f0-491b-801d-1dce51fee583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:49.267925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604450f2-48f0-491b-801d-1dce51fee583 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-604450f2-48f0-491b-801d-1dce51fee583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:49.284965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:49.285879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:49.286877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:49.286877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:49.286877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:49.286877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:49.287104 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:49.287185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 284/580] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:49.287185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604450f2-48f0-491b-801d-1dce51fee583 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:49.296789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251d257-572e-480c-8d7e-2d74f4fc32bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:49.297446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d257-572e-480c-8d7e-2d74f4fc32bc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:49.297733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d257-572e-480c-8d7e-2d74f4fc32bc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:49.298004 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d257-572e-480c-8d7e-2d74f4fc32bc None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:49.298740 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251d257-572e-480c-8d7e-2d74f4fc32bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:49.299045 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251d257-572e-480c-8d7e-2d74f4fc32bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:49.300427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251d257-572e-480c-8d7e-2d74f4fc32bc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:49.309193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 297/581] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:49.309966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251d257-572e-480c-8d7e-2d74f4fc32bc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:49.387601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604450f2-48f0-491b-801d-1dce51fee583 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:49.406422 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251d257-572e-480c-8d7e-2d74f4fc32bc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:49.423019 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a283df-865a-4d9a-8830-8868642d44e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:49.423831 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a283df-865a-4d9a-8830-8868642d44e5 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:49.424112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a283df-865a-4d9a-8830-8868642d44e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:49.424386 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a283df-865a-4d9a-8830-8868642d44e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:49.435309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a283df-865a-4d9a-8830-8868642d44e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:49.436790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a283df-865a-4d9a-8830-8868642d44e5 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:49.439828 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f50261-66d9-4abf-b787-791c2631b481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:49.440477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f50261-66d9-4abf-b787-791c2631b481 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:49.440757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f50261-66d9-4abf-b787-791c2631b481 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:49.441029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f50261-66d9-4abf-b787-791c2631b481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:49.441880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f50261-66d9-4abf-b787-791c2631b481 None admin] RBAC: Adding query filter params (role.id=f6ffe6f612824e50a23f0b06a16a1f91, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=7673b1c4f6184570b0039f9285bf1286) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:49.442188 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f50261-66d9-4abf-b787-791c2631b481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:49.443615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f50261-66d9-4abf-b787-791c2631b481 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:49.448976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 298/582] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:49 2022] GET /identity/v3/role_assignments?user.id=7673b1c4f6184570b0039f9285bf1286&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=f6ffe6f612824e50a23f0b06a16a1f91 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:49.449742 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f50261-66d9-4abf-b787-791c2631b481 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-71a283df-865a-4d9a-8830-8868642d44e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:49.454910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:49.456145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:49.457150 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:49.457150 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:49.457150 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:49.457150 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:49.457825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 285/583] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:49.458740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a283df-865a-4d9a-8830-8868642d44e5 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:49.500168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:49.534802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:49.585918 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f50261-66d9-4abf-b787-791c2631b481 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:49.586173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a283df-865a-4d9a-8830-8868642d44e5 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:49.624339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c12775-707d-47f7-9b3a-74d6a727907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:49.625128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c12775-707d-47f7-9b3a-74d6a727907b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:49.625402 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c12775-707d-47f7-9b3a-74d6a727907b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:49.625666 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c12775-707d-47f7-9b3a-74d6a727907b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:49.629097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4b54-843e-4f0b-ade2-58b80899fed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:49.629757 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4b54-843e-4f0b-ade2-58b80899fed7 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:49.630047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4b54-843e-4f0b-ade2-58b80899fed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:49.630323 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4b54-843e-4f0b-ade2-58b80899fed7 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:49.631049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d4b54-843e-4f0b-ade2-58b80899fed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:49.631352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d4b54-843e-4f0b-ade2-58b80899fed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:49.632823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d4b54-843e-4f0b-ade2-58b80899fed7 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:49.636807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c12775-707d-47f7-9b3a-74d6a727907b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:49.638227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c12775-707d-47f7-9b3a-74d6a727907b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:49.649568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 286/584] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:49.650454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4b54-843e-4f0b-ade2-58b80899fed7 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-b4c12775-707d-47f7-9b3a-74d6a727907b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:21:49.658804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:49.659807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:49.660750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:21:49.660750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:21:49.660750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:21:49.660750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:21:49.660750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:21:49.660750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:21:49.660750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:49.660750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:49.660750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 299/585] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:49.660750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c12775-707d-47f7-9b3a-74d6a727907b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:49.754978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:49.761143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4b54-843e-4f0b-ade2-58b80899fed7 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:49.772392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c12775-707d-47f7-9b3a-74d6a727907b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:49.789770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:49.798486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a01c9-2905-4e75-9e69-3597f4e90cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:49.799291 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a01c9-2905-4e75-9e69-3597f4e90cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:49.799606 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a01c9-2905-4e75-9e69-3597f4e90cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:49.799897 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a01c9-2905-4e75-9e69-3597f4e90cc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:49.810966 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a01c9-2905-4e75-9e69-3597f4e90cc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:49.811199 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daf15e-9a19-40a6-98f3-014917d5dd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:49.811884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daf15e-9a19-40a6-98f3-014917d5dd9b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:49.812164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daf15e-9a19-40a6-98f3-014917d5dd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:49.812435 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daf15e-9a19-40a6-98f3-014917d5dd9b None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:49.812533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a01c9-2905-4e75-9e69-3597f4e90cc4 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:49.813152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46daf15e-9a19-40a6-98f3-014917d5dd9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:49.813454 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46daf15e-9a19-40a6-98f3-014917d5dd9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:49.814800 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46daf15e-9a19-40a6-98f3-014917d5dd9b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:49.833386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 300/586] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:49.833386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daf15e-9a19-40a6-98f3-014917d5dd9b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-bd6a01c9-2905-4e75-9e69-3597f4e90cc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:49.833657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:49.834656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:49.835626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:49.835626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:49.835626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:49.835626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:49.835626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 287/587] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:49.835626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a01c9-2905-4e75-9e69-3597f4e90cc4 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:49.938817 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a01c9-2905-4e75-9e69-3597f4e90cc4 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:49.953863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daf15e-9a19-40a6-98f3-014917d5dd9b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:49.975633 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00f7fa-2684-4415-bf72-c227b04685bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:49.976295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00f7fa-2684-4415-bf72-c227b04685bd None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:49.977126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00f7fa-2684-4415-bf72-c227b04685bd None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:49.977402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00f7fa-2684-4415-bf72-c227b04685bd None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:49.978198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00f7fa-2684-4415-bf72-c227b04685bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:49.978492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00f7fa-2684-4415-bf72-c227b04685bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:49.979966 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00f7fa-2684-4415-bf72-c227b04685bd None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:49.990278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761f812-9dcb-4e3f-b964-7731a0efc246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:49.991060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761f812-9dcb-4e3f-b964-7731a0efc246 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:49.991339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761f812-9dcb-4e3f-b964-7731a0efc246 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:49.991908 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761f812-9dcb-4e3f-b964-7731a0efc246 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:49.993917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 288/588] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:21:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:49.994854 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00f7fa-2684-4415-bf72-c227b04685bd None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:50.003796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761f812-9dcb-4e3f-b964-7731a0efc246 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:50.005309 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761f812-9dcb-4e3f-b964-7731a0efc246 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:50.007245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-7761f812-9dcb-4e3f-b964-7731a0efc246 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:21:50.021036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:50.021984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:50.022998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:21:50.022998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:21:50.022998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:21:50.022998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:21:50.022998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:21:50.022998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:21:50.022998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:50.022998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:50.022998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 301/589] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:50.022998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761f812-9dcb-4e3f-b964-7731a0efc246 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:50.063160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:50.105692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00f7fa-2684-4415-bf72-c227b04685bd None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:50.135585 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761f812-9dcb-4e3f-b964-7731a0efc246 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:50.143813 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaf6c9-ae86-4d6a-99b6-b56af3b9f10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:50.144787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaf6c9-ae86-4d6a-99b6-b56af3b9f10f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:50.144900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaf6c9-ae86-4d6a-99b6-b56af3b9f10f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:50.145182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaf6c9-ae86-4d6a-99b6-b56af3b9f10f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:50.153360 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aaf6c9-ae86-4d6a-99b6-b56af3b9f10f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:50.154811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aaf6c9-ae86-4d6a-99b6-b56af3b9f10f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-f1aaf6c9-ae86-4d6a-99b6-b56af3b9f10f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:50.169586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:50.170560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:50.171591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:50.171591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:50.171591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:50.171591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:50.171591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:50.171591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:50.171591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:50.171591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:50.171591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 10:21:50.171591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:50.171591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 289/590] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:50.172207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaf6c9-ae86-4d6a-99b6-b56af3b9f10f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:50.178644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054f941-b28a-460e-9329-18747490b0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:50.179333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054f941-b28a-460e-9329-18747490b0cc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:50.179651 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054f941-b28a-460e-9329-18747490b0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:50.179928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054f941-b28a-460e-9329-18747490b0cc None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:50.180664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054f941-b28a-460e-9329-18747490b0cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:50.180971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054f941-b28a-460e-9329-18747490b0cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:50.182354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054f941-b28a-460e-9329-18747490b0cc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:50.200591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 302/591] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:50.200591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054f941-b28a-460e-9329-18747490b0cc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:50.251639 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:50.288116 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaf6c9-ae86-4d6a-99b6-b56af3b9f10f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:50.298340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:50.305818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054f941-b28a-460e-9329-18747490b0cc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:50.325456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9802c-c30f-4c05-8670-b7305992b9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:50.326393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9802c-c30f-4c05-8670-b7305992b9f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:50.326674 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9802c-c30f-4c05-8670-b7305992b9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:50.326949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9802c-c30f-4c05-8670-b7305992b9f0 None admin] PATH_INFO: `/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/68f1b06364a24554bba9936621127752/roles/f6ffe6f612824e50a23f0b06a16a1f91` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:50.342248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9802c-c30f-4c05-8670-b7305992b9f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2eb230241340229293ca1aa5585cdc, user_id=68f1b06364a24554bba9936621127752, role_id=f6ffe6f612824e50a23f0b06a16a1f91)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:50.343355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a77c5c-8a02-4e01-b157-096a2b7b7e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:50.343718 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9802c-c30f-4c05-8670-b7305992b9f0 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:50.344162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a77c5c-8a02-4e01-b157-096a2b7b7e96 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:50.344523 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a77c5c-8a02-4e01-b157-096a2b7b7e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:50.344857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a77c5c-8a02-4e01-b157-096a2b7b7e96 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:50.345772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a77c5c-8a02-4e01-b157-096a2b7b7e96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:50.346018 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a77c5c-8a02-4e01-b157-096a2b7b7e96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:50.347437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a77c5c-8a02-4e01-b157-096a2b7b7e96 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:50.357284 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 290/592] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:21:50 2022] PUT /identity/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/68f1b06364a24554bba9936621127752/roles/f6ffe6f612824e50a23f0b06a16a1f91 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:21:50.358105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9802c-c30f-4c05-8670-b7305992b9f0 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:50.375949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 303/593] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:21:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:50.377125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a77c5c-8a02-4e01-b157-096a2b7b7e96 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:50.486034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9802c-c30f-4c05-8670-b7305992b9f0 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:50.495036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a77c5c-8a02-4e01-b157-096a2b7b7e96 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:50.508926 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:50.534374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9801dba-37b5-4233-9762-47567f0774f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:50.535583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9801dba-37b5-4233-9762-47567f0774f7 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:50.536444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9801dba-37b5-4233-9762-47567f0774f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:50.536917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9801dba-37b5-4233-9762-47567f0774f7 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:50.537735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44529a1-0eaa-428e-89dd-fa75e79d2656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:50.538367 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9801dba-37b5-4233-9762-47567f0774f7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:50.538768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44529a1-0eaa-428e-89dd-fa75e79d2656 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:50.538909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9801dba-37b5-4233-9762-47567f0774f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:50.539247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44529a1-0eaa-428e-89dd-fa75e79d2656 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:50.539658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44529a1-0eaa-428e-89dd-fa75e79d2656 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:50.540324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9801dba-37b5-4233-9762-47567f0774f7 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:50.549326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44529a1-0eaa-428e-89dd-fa75e79d2656 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:50.551000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44529a1-0eaa-428e-89dd-fa75e79d2656 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:50.562790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 291/594] 10.222.0.50 () {56 vars in 1139 bytes} [Wed Jun 15 10:21:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:50.563662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9801dba-37b5-4233-9762-47567f0774f7 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-c44529a1-0eaa-428e-89dd-fa75e79d2656 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:50.567763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:50.568747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:50.569738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:50.569738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:50.569738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:50.569738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:50.569738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:50.569738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:50.569738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:50.569738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:50.569738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 10:21:50.569738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:50.569738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 304/595] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:50.574332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44529a1-0eaa-428e-89dd-fa75e79d2656 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:50.592791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:50.682952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9801dba-37b5-4233-9762-47567f0774f7 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:50.696107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44529a1-0eaa-428e-89dd-fa75e79d2656 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:50.718588 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35413bd8-a4ee-4605-85a8-58969b297bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:50.719556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35413bd8-a4ee-4605-85a8-58969b297bc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:50.719776 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35413bd8-a4ee-4605-85a8-58969b297bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:50.720033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35413bd8-a4ee-4605-85a8-58969b297bc9 None admin] PATH_INFO: `/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/81e9805ec4c44cedb658b7becf768369/roles/f6ffe6f612824e50a23f0b06a16a1f91` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:50.734075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a13d39-a39c-49f2-ab74-8f1dcff466d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:50.735370 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a13d39-a39c-49f2-ab74-8f1dcff466d0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:50.735889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a13d39-a39c-49f2-ab74-8f1dcff466d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:50.736158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35413bd8-a4ee-4605-85a8-58969b297bc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2eb230241340229293ca1aa5585cdc, user_id=81e9805ec4c44cedb658b7becf768369, role_id=f6ffe6f612824e50a23f0b06a16a1f91)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:50.736611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a13d39-a39c-49f2-ab74-8f1dcff466d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:50.737582 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35413bd8-a4ee-4605-85a8-58969b297bc9 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:50.749743 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a13d39-a39c-49f2-ab74-8f1dcff466d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:50.751631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a13d39-a39c-49f2-ab74-8f1dcff466d0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:50.753733 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 292/596] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:21:50 2022] PUT /identity/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/81e9805ec4c44cedb658b7becf768369/roles/f6ffe6f612824e50a23f0b06a16a1f91 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:21:50.754660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35413bd8-a4ee-4605-85a8-58969b297bc9 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-92a13d39-a39c-49f2-ab74-8f1dcff466d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:50.771339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:50.772378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:50.773393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:50.773393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:50.773393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:50.773393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:50.780157 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 305/597] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:50.781272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a13d39-a39c-49f2-ab74-8f1dcff466d0 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:50.784719 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:50.856992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:50.872068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35413bd8-a4ee-4605-85a8-58969b297bc9 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:50.899164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a13d39-a39c-49f2-ab74-8f1dcff466d0 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:50.909453 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28096f2c-422e-4185-9aed-8d1ee8380b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:50.910125 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28096f2c-422e-4185-9aed-8d1ee8380b1e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:50.910406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28096f2c-422e-4185-9aed-8d1ee8380b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:50.910677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28096f2c-422e-4185-9aed-8d1ee8380b1e None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:50.911534 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28096f2c-422e-4185-9aed-8d1ee8380b1e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:50.911845 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28096f2c-422e-4185-9aed-8d1ee8380b1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:50.913280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28096f2c-422e-4185-9aed-8d1ee8380b1e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:50.939750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 293/598] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Jun 15 10:21:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:50.948620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28096f2c-422e-4185-9aed-8d1ee8380b1e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:50.951541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15595e1f-6dd7-4d28-a1a0-573db40465fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:50.952833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15595e1f-6dd7-4d28-a1a0-573db40465fc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:50.955243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15595e1f-6dd7-4d28-a1a0-573db40465fc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:50.956290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15595e1f-6dd7-4d28-a1a0-573db40465fc None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:50.957253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15595e1f-6dd7-4d28-a1a0-573db40465fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:50.958638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15595e1f-6dd7-4d28-a1a0-573db40465fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:50.960297 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15595e1f-6dd7-4d28-a1a0-573db40465fc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:50.989513 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 306/599] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:51.000811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15595e1f-6dd7-4d28-a1a0-573db40465fc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:51.079763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:51.097589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28096f2c-422e-4185-9aed-8d1ee8380b1e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:51.120382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15595e1f-6dd7-4d28-a1a0-573db40465fc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:51.134401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7878d-2e24-4194-b1ff-34b95caba4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:51.135192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7878d-2e24-4194-b1ff-34b95caba4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:51.135486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7878d-2e24-4194-b1ff-34b95caba4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:51.135762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7878d-2e24-4194-b1ff-34b95caba4d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:51.146369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7878d-2e24-4194-b1ff-34b95caba4d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:51.147841 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7878d-2e24-4194-b1ff-34b95caba4d8 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:51.151291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:51.160823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4586760-a870-421f-af6c-3b10d6d34c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:51.161931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4586760-a870-421f-af6c-3b10d6d34c5d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:51.162509 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4586760-a870-421f-af6c-3b10d6d34c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:51.162990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4586760-a870-421f-af6c-3b10d6d34c5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-03c7878d-2e24-4194-b1ff-34b95caba4d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:51.168157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:51.169111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:51.170088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:51.170088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:51.170088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:51.170088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:51.170088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 294/600] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:51.174139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7878d-2e24-4194-b1ff-34b95caba4d8 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:51.176406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4586760-a870-421f-af6c-3b10d6d34c5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:51.178070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4586760-a870-421f-af6c-3b10d6d34c5d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-c4586760-a870-421f-af6c-3b10d6d34c5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:21:51.193143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:51.194125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:51.195127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:21:51.195127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:21:51.195127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:21:51.195127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:21:51.195127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:21:51.195127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:21:51.195127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:51.195127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:51.197676 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 307/601] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:51.202833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4586760-a870-421f-af6c-3b10d6d34c5d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:51.326513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7878d-2e24-4194-b1ff-34b95caba4d8 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:51.357895 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4586760-a870-421f-af6c-3b10d6d34c5d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:51.372041 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45a437-a0d8-4e5a-aa47-ebbe29cca2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:51.372636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45a437-a0d8-4e5a-aa47-ebbe29cca2ce None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:51.372914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45a437-a0d8-4e5a-aa47-ebbe29cca2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:51.373184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45a437-a0d8-4e5a-aa47-ebbe29cca2ce None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:51.373908 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45a437-a0d8-4e5a-aa47-ebbe29cca2ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:51.374207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45a437-a0d8-4e5a-aa47-ebbe29cca2ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:51.375893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45a437-a0d8-4e5a-aa47-ebbe29cca2ce None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:51.378301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:51.393928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 295/602] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:51.395180 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45a437-a0d8-4e5a-aa47-ebbe29cca2ce None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:51.398920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4d012-3fec-4eb3-a08c-dc233647a9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:51.399917 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4d012-3fec-4eb3-a08c-dc233647a9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:51.400427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4d012-3fec-4eb3-a08c-dc233647a9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:51.400920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4d012-3fec-4eb3-a08c-dc233647a9e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:51.401986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4d012-3fec-4eb3-a08c-dc233647a9e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:51.402518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4d012-3fec-4eb3-a08c-dc233647a9e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:51.404220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4d012-3fec-4eb3-a08c-dc233647a9e3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:51.418798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 308/603] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:21:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:51.424821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4d012-3fec-4eb3-a08c-dc233647a9e3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:51.474552 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:51.534284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4d012-3fec-4eb3-a08c-dc233647a9e3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:51.563841 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45a437-a0d8-4e5a-aa47-ebbe29cca2ce None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:51.573028 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dca9b5-510b-4b2c-b270-a254bfa0d33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:51.574169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca9b5-510b-4b2c-b270-a254bfa0d33c None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:51.574660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca9b5-510b-4b2c-b270-a254bfa0d33c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:51.575165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca9b5-510b-4b2c-b270-a254bfa0d33c None admin] PATH_INFO: `/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/5f2e2038f69f49019a1e528107296223/roles/f6ffe6f612824e50a23f0b06a16a1f91` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:51.591883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dca9b5-510b-4b2c-b270-a254bfa0d33c None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2eb230241340229293ca1aa5585cdc, user_id=5f2e2038f69f49019a1e528107296223, role_id=f6ffe6f612824e50a23f0b06a16a1f91)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:51.593705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dca9b5-510b-4b2c-b270-a254bfa0d33c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:51.618211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fdd8a-a60d-4a93-9bcd-a07c9b7a7d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:51.619019 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fdd8a-a60d-4a93-9bcd-a07c9b7a7d7a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:51.619429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fdd8a-a60d-4a93-9bcd-a07c9b7a7d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:51.619835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fdd8a-a60d-4a93-9bcd-a07c9b7a7d7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:51.628760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5fdd8a-a60d-4a93-9bcd-a07c9b7a7d7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:51.630263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5fdd8a-a60d-4a93-9bcd-a07c9b7a7d7a None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:51.634413 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 309/604] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:21:51 2022] PUT /identity/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/5f2e2038f69f49019a1e528107296223/roles/f6ffe6f612824e50a23f0b06a16a1f91 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-3c5fdd8a-a60d-4a93-9bcd-a07c9b7a7d7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:21:51.647018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:51.648047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:51.649556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:21:51.649556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:21:51.649556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:21:51.649556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:21:51.649556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:21:51.649556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:21:51.649556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:51.649556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:51.653702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 296/605] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:51.660692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dca9b5-510b-4b2c-b270-a254bfa0d33c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:51.814446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:51.822023 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dca9b5-510b-4b2c-b270-a254bfa0d33c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:51.865919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd2b71-3ab9-418a-80d1-90ca1287f0e7 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:51.866240 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd2b71-3ab9-418a-80d1-90ca1287f0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:51.866734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd2b71-3ab9-418a-80d1-90ca1287f0e7 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:51.868884 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 297/606] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:21:51.874716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c4223-d576-4ad6-8d9f-885d37263483 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:51.875292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c4223-d576-4ad6-8d9f-885d37263483 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:51.875292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c4223-d576-4ad6-8d9f-885d37263483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:51.881758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db0451-d02b-4d86-93bc-5aa25d1e94ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:51.882358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db0451-d02b-4d86-93bc-5aa25d1e94ef None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:51.882682 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db0451-d02b-4d86-93bc-5aa25d1e94ef None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:51.883538 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db0451-d02b-4d86-93bc-5aa25d1e94ef None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:51.884332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db0451-d02b-4d86-93bc-5aa25d1e94ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:51.884641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db0451-d02b-4d86-93bc-5aa25d1e94ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:51.886404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db0451-d02b-4d86-93bc-5aa25d1e94ef None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:51.900749 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-6d5c4223-d576-4ad6-8d9f-885d37263483 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:51.901942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6d5c4223-d576-4ad6-8d9f-885d37263483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:51.903579 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 310/607] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:21:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:51.909064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db0451-d02b-4d86-93bc-5aa25d1e94ef None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:51.965403 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:52.000029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 298/608] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:52.029724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db0451-d02b-4d86-93bc-5aa25d1e94ef None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:52.046584 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c4223-d576-4ad6-8d9f-885d37263483 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:52.066878 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a5398-aa4f-4915-b3bc-ea5b15c8967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:52.068209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a5398-aa4f-4915-b3bc-ea5b15c8967f None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:52.068639 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a5398-aa4f-4915-b3bc-ea5b15c8967f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:52.068920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a5398-aa4f-4915-b3bc-ea5b15c8967f None admin] PATH_INFO: `/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/383ef65dd6b14810a7a2a8e06143eca2/roles/f6ffe6f612824e50a23f0b06a16a1f91` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:52.086319 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a5398-aa4f-4915-b3bc-ea5b15c8967f None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2eb230241340229293ca1aa5585cdc, user_id=383ef65dd6b14810a7a2a8e06143eca2, role_id=f6ffe6f612824e50a23f0b06a16a1f91)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:52.088234 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a5398-aa4f-4915-b3bc-ea5b15c8967f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:52.104707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 311/609] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:21:51 2022] PUT /identity/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/383ef65dd6b14810a7a2a8e06143eca2/roles/f6ffe6f612824e50a23f0b06a16a1f91 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:21:52.230749 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c4223-d576-4ad6-8d9f-885d37263483 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:52.283048 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9429f1-7ab4-4b54-a73f-e06697ff6cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:52.283886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9429f1-7ab4-4b54-a73f-e06697ff6cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:52.284162 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9429f1-7ab4-4b54-a73f-e06697ff6cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:52.284435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9429f1-7ab4-4b54-a73f-e06697ff6cf9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:52.296480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9429f1-7ab4-4b54-a73f-e06697ff6cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-fc9429f1-7ab4-4b54-a73f-e06697ff6cf9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:52.304184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:52.305693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:52.306589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:52.306589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:52.306589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:52.306589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:52.306589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:52.306589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:52.306589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:52.306589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:52.306589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:52.306589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:52.306589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:52.306589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:52.306589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 299/610] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:52.313814 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a5398-aa4f-4915-b3bc-ea5b15c8967f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:52.338881 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:52.430290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a5398-aa4f-4915-b3bc-ea5b15c8967f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:52.478467 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83792072-c43d-463b-b59e-07a532ad71b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:52.479216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83792072-c43d-463b-b59e-07a532ad71b7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:52.479518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83792072-c43d-463b-b59e-07a532ad71b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:52.479840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83792072-c43d-463b-b59e-07a532ad71b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:52.480706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83792072-c43d-463b-b59e-07a532ad71b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:52.481188 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83792072-c43d-463b-b59e-07a532ad71b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:52.482548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83792072-c43d-463b-b59e-07a532ad71b7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:52.496957 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 312/611] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:52.501948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9429f1-7ab4-4b54-a73f-e06697ff6cf9 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:52.559893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:52.614372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9429f1-7ab4-4b54-a73f-e06697ff6cf9 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:52.649680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd744f9-b9b6-48e2-802b-50d9d4e9a844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:52.650468 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd744f9-b9b6-48e2-802b-50d9d4e9a844 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:52.650746 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd744f9-b9b6-48e2-802b-50d9d4e9a844 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:52.651013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd744f9-b9b6-48e2-802b-50d9d4e9a844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:52.661932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd744f9-b9b6-48e2-802b-50d9d4e9a844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:52.663387 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd744f9-b9b6-48e2-802b-50d9d4e9a844 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-2dd744f9-b9b6-48e2-802b-50d9d4e9a844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:52.681911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:52.682880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:52.683947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:52.683947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:52.683947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:52.683947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:52.683947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 300/612] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:52.688525 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83792072-c43d-463b-b59e-07a532ad71b7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:52.785028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f6ffe-d4bf-48ba-b91c-13decb870259 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:52.785212 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f6ffe-d4bf-48ba-b91c-13decb870259 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:52.785530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f6ffe-d4bf-48ba-b91c-13decb870259 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:52.787143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 301/613] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:52.792536 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec9f8f-2a6c-400f-86ca-3f754eb80c5b None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:52.792821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec9f8f-2a6c-400f-86ca-3f754eb80c5b None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:52.793100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec9f8f-2a6c-400f-86ca-3f754eb80c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:52.793631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:52.819349 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-c9ec9f8f-2a6c-400f-86ca-3f754eb80c5b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:52.820461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c9ec9f8f-2a6c-400f-86ca-3f754eb80c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:52.857147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83792072-c43d-463b-b59e-07a532ad71b7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:52.925576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d667c-3804-43af-a137-2593c40a1bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:52.926243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d667c-3804-43af-a137-2593c40a1bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:52.926527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d667c-3804-43af-a137-2593c40a1bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:52.926816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d667c-3804-43af-a137-2593c40a1bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:52.927554 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d667c-3804-43af-a137-2593c40a1bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:52.927864 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d667c-3804-43af-a137-2593c40a1bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:52.929226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d667c-3804-43af-a137-2593c40a1bc4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:52.941472 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 302/614] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:21:52.947425 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 313/615] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:21:52.952545 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec9f8f-2a6c-400f-86ca-3f754eb80c5b None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:52.986116 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:53.006221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d667c-3804-43af-a137-2593c40a1bc4 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:53.121711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec9f8f-2a6c-400f-86ca-3f754eb80c5b None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:53.186680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d667c-3804-43af-a137-2593c40a1bc4 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:53.191082 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a6cdf-0f94-46bc-96e7-2aaec31c522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:53.191911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a6cdf-0f94-46bc-96e7-2aaec31c522e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:53.192194 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a6cdf-0f94-46bc-96e7-2aaec31c522e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:53.192471 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a6cdf-0f94-46bc-96e7-2aaec31c522e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:53.224362 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a6cdf-0f94-46bc-96e7-2aaec31c522e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:53.225923 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a6cdf-0f94-46bc-96e7-2aaec31c522e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:53.229670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ce672-3f7c-48cb-a048-65130ae9bdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:53.230957 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ce672-3f7c-48cb-a048-65130ae9bdcc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:53.231989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ce672-3f7c-48cb-a048-65130ae9bdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:53.232481 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ce672-3f7c-48cb-a048-65130ae9bdcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:53.235653 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:53.248383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ce672-3f7c-48cb-a048-65130ae9bdcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-198ce672-3f7c-48cb-a048-65130ae9bdcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:53.256267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:53.257410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:53.259738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:53.259738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:53.259738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:53.259738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:53.259738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:53.259738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:53.259738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:53.259738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:53.259738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:53.259738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:53.259738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:53.259738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:53.259738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 314/616] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-cc5a6cdf-0f94-46bc-96e7-2aaec31c522e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:53.262709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:53.264461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:53.266748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:53.266748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:53.266748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:53.266748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:53.266748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:53.266748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:53.266748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:53.266748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:53.266748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 10:21:53.266748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:53.266748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 303/617] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:21:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:53.272529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ce672-3f7c-48cb-a048-65130ae9bdcc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:53.272698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a6cdf-0f94-46bc-96e7-2aaec31c522e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:53.455173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ce672-3f7c-48cb-a048-65130ae9bdcc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:53.459798 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:53.493214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bea5a6-195c-4a81-8b49-860426d78e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:53.494036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bea5a6-195c-4a81-8b49-860426d78e83 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:53.494627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bea5a6-195c-4a81-8b49-860426d78e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:53.494896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bea5a6-195c-4a81-8b49-860426d78e83 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:53.495812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bea5a6-195c-4a81-8b49-860426d78e83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:53.496116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bea5a6-195c-4a81-8b49-860426d78e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:53.497529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bea5a6-195c-4a81-8b49-860426d78e83 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:53.502231 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a6cdf-0f94-46bc-96e7-2aaec31c522e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:53.506539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 315/618] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:53.512249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bea5a6-195c-4a81-8b49-860426d78e83 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:53.571369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:53.593088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8755b39-af58-47b7-b5e4-cfdb9279510c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:53.593776 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8755b39-af58-47b7-b5e4-cfdb9279510c None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:53.594059 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8755b39-af58-47b7-b5e4-cfdb9279510c None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:53.594334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8755b39-af58-47b7-b5e4-cfdb9279510c None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:53.595190 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8755b39-af58-47b7-b5e4-cfdb9279510c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:53.595521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8755b39-af58-47b7-b5e4-cfdb9279510c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:53.597033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8755b39-af58-47b7-b5e4-cfdb9279510c None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:53.627672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bea5a6-195c-4a81-8b49-860426d78e83 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:53.654801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 304/619] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Jun 15 10:21:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:53.664635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8755b39-af58-47b7-b5e4-cfdb9279510c None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:53.671103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db67481-9231-4791-8ce3-f0a50576d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:53.671103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db67481-9231-4791-8ce3-f0a50576d71f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:53.671103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db67481-9231-4791-8ce3-f0a50576d71f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:53.671103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db67481-9231-4791-8ce3-f0a50576d71f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:53.684743 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db67481-9231-4791-8ce3-f0a50576d71f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:53.686328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db67481-9231-4791-8ce3-f0a50576d71f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-9db67481-9231-4791-8ce3-f0a50576d71f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:53.705645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:53.706817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:53.707959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:53.707959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:53.707959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:53.707959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:53.708462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 316/620] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:53.709598 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b21ce-770c-48ee-981e-e14a114dc1aa None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:53.710116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b21ce-770c-48ee-981e-e14a114dc1aa None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:53.710396 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b21ce-770c-48ee-981e-e14a114dc1aa None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:53.711990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 317/621] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:53.714770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b21ce-770c-48ee-981e-e14a114dc1aa None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:53.807570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8755b39-af58-47b7-b5e4-cfdb9279510c None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:53.825315 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b21ce-770c-48ee-981e-e14a114dc1aa None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:53.827029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:53.847390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62343239-af29-4373-9c91-ae144b446521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:53.848309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62343239-af29-4373-9c91-ae144b446521 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:53.848596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62343239-af29-4373-9c91-ae144b446521 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:53.848922 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62343239-af29-4373-9c91-ae144b446521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:53.860578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62343239-af29-4373-9c91-ae144b446521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:53.862068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62343239-af29-4373-9c91-ae144b446521 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:53.862981 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9d410-463b-4eb2-93f3-6e8a2f8d9a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:53.863791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9d410-463b-4eb2-93f3-6e8a2f8d9a1a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:53.864077 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9d410-463b-4eb2-93f3-6e8a2f8d9a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:53.864347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9d410-463b-4eb2-93f3-6e8a2f8d9a1a None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:53.865169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9d410-463b-4eb2-93f3-6e8a2f8d9a1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:53.865476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9d410-463b-4eb2-93f3-6e8a2f8d9a1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:53.867697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9d410-463b-4eb2-93f3-6e8a2f8d9a1a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:53.870156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:53.881081 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 318/622] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-62343239-af29-4373-9c91-ae144b446521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:53.882762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:53.883811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:53.884751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:53.884751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:53.884751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:53.884751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:53.884986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a33ce6-de2a-4813-8bd0-140e627ba8ea None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:53.884986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a33ce6-de2a-4813-8bd0-140e627ba8ea None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:53.884986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a33ce6-de2a-4813-8bd0-140e627ba8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:53.887580 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 305/623] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:53.892240 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62343239-af29-4373-9c91-ae144b446521 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:53.915226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-37a33ce6-de2a-4813-8bd0-140e627ba8ea None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:53.916927 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-37a33ce6-de2a-4813-8bd0-140e627ba8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:54.003629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 319/624] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:54.004825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a33ce6-de2a-4813-8bd0-140e627ba8ea None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:54.017854 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62343239-af29-4373-9c91-ae144b446521 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:54.066047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bc68c-f165-4632-b451-1319dda885ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:54.067356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bc68c-f165-4632-b451-1319dda885ad None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:54.067808 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bc68c-f165-4632-b451-1319dda885ad None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:54.068500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bc68c-f165-4632-b451-1319dda885ad None admin] PATH_INFO: `/v3/users/glance` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:54.077562 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bc68c-f165-4632-b451-1319dda885ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:54.079493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bc68c-f165-4632-b451-1319dda885ad None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-9f6bc68c-f165-4632-b451-1319dda885ad None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:54.098853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:54.100107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:54.101867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:54.101867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:54.101867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:54.101867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:54.101867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:54.101867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:54.101867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:54.101867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:54.101867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 10:21:54.101867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:54.104519 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 306/625] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:54.105563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bc68c-f165-4632-b451-1319dda885ad None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:54.130317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:54.140953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a33ce6-de2a-4813-8bd0-140e627ba8ea None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:54.174587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:54.184379 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecc5c0-3e0d-4f31-a553-e708dcc5da25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:54.185069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecc5c0-3e0d-4f31-a553-e708dcc5da25 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:54.185838 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecc5c0-3e0d-4f31-a553-e708dcc5da25 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:54.186119 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecc5c0-3e0d-4f31-a553-e708dcc5da25 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:54.186989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecc5c0-3e0d-4f31-a553-e708dcc5da25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:54.187553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecc5c0-3e0d-4f31-a553-e708dcc5da25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:54.188837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecc5c0-3e0d-4f31-a553-e708dcc5da25 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:54.203222 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 320/626] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:54.205599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecc5c0-3e0d-4f31-a553-e708dcc5da25 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:54.228376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bc68c-f165-4632-b451-1319dda885ad None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:54.270676 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bdc78-785c-43d0-92f8-b499979dc0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:54.271738 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bdc78-785c-43d0-92f8-b499979dc0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:54.272067 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bdc78-785c-43d0-92f8-b499979dc0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:54.272351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bdc78-785c-43d0-92f8-b499979dc0b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:54.285040 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bdc78-785c-43d0-92f8-b499979dc0b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-d58bdc78-785c-43d0-92f8-b499979dc0b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:54.293891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:54.294850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:54.296181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:54.296181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:54.296181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:54.296181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:54.296181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:54.296181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:54.296181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:54.296181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:54.296181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:54.296181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:54.296181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:54.296181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:54.300010 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 307/627] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:54.300857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bdc78-785c-43d0-92f8-b499979dc0b5 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:54.338437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecc5c0-3e0d-4f31-a553-e708dcc5da25 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:54.374333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfbdee-a8e9-448e-8def-61a7bdbc8ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:54.375013 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfbdee-a8e9-448e-8def-61a7bdbc8ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:54.375293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfbdee-a8e9-448e-8def-61a7bdbc8ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:54.375601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfbdee-a8e9-448e-8def-61a7bdbc8ca1 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:54.376446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfbdee-a8e9-448e-8def-61a7bdbc8ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:54.376759 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfbdee-a8e9-448e-8def-61a7bdbc8ca1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:54.378195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfbdee-a8e9-448e-8def-61a7bdbc8ca1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:54.403146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 321/628] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Jun 15 10:21:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:54.403146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfbdee-a8e9-448e-8def-61a7bdbc8ca1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:54.411048 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bdc78-785c-43d0-92f8-b499979dc0b5 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:54.414790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:54.429752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:54.448064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f967a-01ac-4071-ad86-9cdce7286798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:54.448868 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f967a-01ac-4071-ad86-9cdce7286798 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:54.449150 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f967a-01ac-4071-ad86-9cdce7286798 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:54.449421 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f967a-01ac-4071-ad86-9cdce7286798 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:54.456490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f967a-01ac-4071-ad86-9cdce7286798 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:54.457933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f967a-01ac-4071-ad86-9cdce7286798 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-1b3f967a-01ac-4071-ad86-9cdce7286798 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:21:54.472909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:54.473869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:54.474807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:21:54.474807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:21:54.474807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:21:54.474807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:21:54.474807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:21:54.474807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:21:54.474807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:54.474807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:54.474807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 308/629] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:54.475341 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7a851-0527-4b1d-9a8f-4788448d2e3d None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:54.475757 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7a851-0527-4b1d-9a8f-4788448d2e3d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:54.475865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7a851-0527-4b1d-9a8f-4788448d2e3d None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:54.479534 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 309/630] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:54.479534 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7a851-0527-4b1d-9a8f-4788448d2e3d None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:54.519135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfbdee-a8e9-448e-8def-61a7bdbc8ca1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:54.554743 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc5d3f-bae4-45ea-83b1-42e6d06954f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:54.555335 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc5d3f-bae4-45ea-83b1-42e6d06954f2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:54.555698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc5d3f-bae4-45ea-83b1-42e6d06954f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:54.555977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc5d3f-bae4-45ea-83b1-42e6d06954f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:54.556741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc5d3f-bae4-45ea-83b1-42e6d06954f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:54.557048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc5d3f-bae4-45ea-83b1-42e6d06954f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:54.558478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc5d3f-bae4-45ea-83b1-42e6d06954f2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:54.574419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 322/631] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:54.574419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc5d3f-bae4-45ea-83b1-42e6d06954f2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:54.604452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7a851-0527-4b1d-9a8f-4788448d2e3d None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:54.640418 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b0848-324d-48b9-9e8e-fc15548a903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:54.641072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b0848-324d-48b9-9e8e-fc15548a903e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:54.641360 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b0848-324d-48b9-9e8e-fc15548a903e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:54.641640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b0848-324d-48b9-9e8e-fc15548a903e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:54.650706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:54.681503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc5d3f-bae4-45ea-83b1-42e6d06954f2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:54.689544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:54.712788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b0848-324d-48b9-9e8e-fc15548a903e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:54.714246 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b0848-324d-48b9-9e8e-fc15548a903e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:54.717643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7e9f9-e93a-4075-86b0-22c48ea80191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:54.718291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7e9f9-e93a-4075-86b0-22c48ea80191 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:54.718572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7e9f9-e93a-4075-86b0-22c48ea80191 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:54.718842 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7e9f9-e93a-4075-86b0-22c48ea80191 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:54.719653 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7e9f9-e93a-4075-86b0-22c48ea80191 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:54.719963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7e9f9-e93a-4075-86b0-22c48ea80191 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:54.721365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7e9f9-e93a-4075-86b0-22c48ea80191 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:54.733541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 323/632] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:21:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:54.734737 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee6eec-7691-44d3-9fca-9fffe2a5139c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:54.735026 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee6eec-7691-44d3-9fca-9fffe2a5139c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:54.735303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee6eec-7691-44d3-9fca-9fffe2a5139c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:54.751712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-cdee6eec-7691-44d3-9fca-9fffe2a5139c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:54.752912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cdee6eec-7691-44d3-9fca-9fffe2a5139c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:54.816086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 310/633] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:54.816991 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b0848-324d-48b9-9e8e-fc15548a903e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:54.827985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 324/634] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:54.827985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6292923-47ec-486d-9e62-a3c689aa1d35 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:54.827985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6292923-47ec-486d-9e62-a3c689aa1d35 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:54.827985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6292923-47ec-486d-9e62-a3c689aa1d35 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:54.827985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 325/635] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:54.827985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6292923-47ec-486d-9e62-a3c689aa1d35 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:54.891742 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:54.906277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:54.927502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b0848-324d-48b9-9e8e-fc15548a903e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:54.932304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6292923-47ec-486d-9e62-a3c689aa1d35 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:54.960932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aee72-09af-4e7a-8936-1a79172ac909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:54.961803 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aee72-09af-4e7a-8936-1a79172ac909 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:54.962084 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aee72-09af-4e7a-8936-1a79172ac909 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:54.962355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aee72-09af-4e7a-8936-1a79172ac909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:54.965382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24def9-e074-4b67-b27b-f051e5f80bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:54.966254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24def9-e074-4b67-b27b-f051e5f80bfa None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:54.966536 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24def9-e074-4b67-b27b-f051e5f80bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:54.966810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24def9-e074-4b67-b27b-f051e5f80bfa None admin] PATH_INFO: `/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/7673b1c4f6184570b0039f9285bf1286/roles/f6ffe6f612824e50a23f0b06a16a1f91` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:54.972044 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633aee72-09af-4e7a-8936-1a79172ac909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:54.973481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633aee72-09af-4e7a-8936-1a79172ac909 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:54.982912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24def9-e074-4b67-b27b-f051e5f80bfa None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2eb230241340229293ca1aa5585cdc, user_id=7673b1c4f6184570b0039f9285bf1286, role_id=f6ffe6f612824e50a23f0b06a16a1f91)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:54.985049 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24def9-e074-4b67-b27b-f051e5f80bfa None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:54.999437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 326/636] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:21:54 2022] PUT /identity/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/7673b1c4f6184570b0039f9285bf1286/roles/f6ffe6f612824e50a23f0b06a16a1f91 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-633aee72-09af-4e7a-8936-1a79172ac909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:54.999721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:55.000629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:55.001562 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:55.001562 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:55.001562 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:55.001562 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:55.001790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24def9-e074-4b67-b27b-f051e5f80bfa None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:55.001870 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 311/637] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:55.002442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce454d-15a8-40d5-9a3a-f576e164e716 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:55.002709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce454d-15a8-40d5-9a3a-f576e164e716 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:55.002982 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce454d-15a8-40d5-9a3a-f576e164e716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:55.021349 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-35ce454d-15a8-40d5-9a3a-f576e164e716 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:55.022567 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-35ce454d-15a8-40d5-9a3a-f576e164e716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:55.103491 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 312/638] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:55.103491 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce454d-15a8-40d5-9a3a-f576e164e716 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:55.144603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24def9-e074-4b67-b27b-f051e5f80bfa None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:55.163157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:55.165914 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:55.188330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff07f01-2fae-463e-950e-3f3a0aa244b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:55.189123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff07f01-2fae-463e-950e-3f3a0aa244b3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:55.189397 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff07f01-2fae-463e-950e-3f3a0aa244b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:55.189671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff07f01-2fae-463e-950e-3f3a0aa244b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:55.201229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff07f01-2fae-463e-950e-3f3a0aa244b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:55.202700 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff07f01-2fae-463e-950e-3f3a0aa244b3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:55.208490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce454d-15a8-40d5-9a3a-f576e164e716 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-aff07f01-2fae-463e-950e-3f3a0aa244b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:55.223812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:55.224784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:55.225816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:55.225816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:55.225816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:55.225816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:55.225816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 327/639] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:55.226098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff07f01-2fae-463e-950e-3f3a0aa244b3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:55.255550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4a203-7253-48ec-b512-2e77f58db9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:55.256355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4a203-7253-48ec-b512-2e77f58db9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:55.256637 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4a203-7253-48ec-b512-2e77f58db9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:55.256912 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4a203-7253-48ec-b512-2e77f58db9e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:55.267531 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4a203-7253-48ec-b512-2e77f58db9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-76e4a203-7253-48ec-b512-2e77f58db9e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:55.275249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:55.276448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:55.277348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:55.277348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:55.277348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:55.277348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:55.277348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:55.277348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:55.277348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:55.277348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:55.277348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:55.277348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:55.277348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:55.277348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:55.277348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 313/640] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:55.277348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4a203-7253-48ec-b512-2e77f58db9e0 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:55.344877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff07f01-2fae-463e-950e-3f3a0aa244b3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:55.381699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4a203-7253-48ec-b512-2e77f58db9e0 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:55.384276 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39106176-9fec-40fd-be43-b8cf6774abfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:55.384941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39106176-9fec-40fd-be43-b8cf6774abfb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:55.385218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39106176-9fec-40fd-be43-b8cf6774abfb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:55.385489 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39106176-9fec-40fd-be43-b8cf6774abfb None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:55.386212 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39106176-9fec-40fd-be43-b8cf6774abfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:55.386515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39106176-9fec-40fd-be43-b8cf6774abfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:55.387905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39106176-9fec-40fd-be43-b8cf6774abfb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:55.404564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 328/641] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:55.404564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39106176-9fec-40fd-be43-b8cf6774abfb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:55.404826 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:55.420723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bd38c-fc63-485e-b763-1311c46c9192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:55.421526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bd38c-fc63-485e-b763-1311c46c9192 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:55.421804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bd38c-fc63-485e-b763-1311c46c9192 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:55.422356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bd38c-fc63-485e-b763-1311c46c9192 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:55.432014 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:55.434652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bd38c-fc63-485e-b763-1311c46c9192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-e91bd38c-fc63-485e-b763-1311c46c9192 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:55.442928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:55.444183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:55.450050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:55.450050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:55.450050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:55.450050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:55.450050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:55.450050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:55.450050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:55.450050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:55.450050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:55.450050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:55.450050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:55.450050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:55.450050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 314/642] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:55.450050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bd38c-fc63-485e-b763-1311c46c9192 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:55.528776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39106176-9fec-40fd-be43-b8cf6774abfb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:55.556156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bd38c-fc63-485e-b763-1311c46c9192 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:55.569481 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6507aae-ba97-4a6a-bdce-e1bd0a07f5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:55.570499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6507aae-ba97-4a6a-bdce-e1bd0a07f5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:55.571002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6507aae-ba97-4a6a-bdce-e1bd0a07f5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:55.571543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6507aae-ba97-4a6a-bdce-e1bd0a07f5b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:55.572362 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6507aae-ba97-4a6a-bdce-e1bd0a07f5b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:55.572646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6507aae-ba97-4a6a-bdce-e1bd0a07f5b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:55.574156 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6507aae-ba97-4a6a-bdce-e1bd0a07f5b7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:55.594897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 329/643] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:55.594897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6507aae-ba97-4a6a-bdce-e1bd0a07f5b7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:55.602378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24639f1-c8a2-47b5-bdb2-bc98d6f43b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:55.602935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24639f1-c8a2-47b5-bdb2-bc98d6f43b87 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:55.603215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24639f1-c8a2-47b5-bdb2-bc98d6f43b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:55.603507 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24639f1-c8a2-47b5-bdb2-bc98d6f43b87 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:55.604551 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24639f1-c8a2-47b5-bdb2-bc98d6f43b87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:55.604659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24639f1-c8a2-47b5-bdb2-bc98d6f43b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:55.605987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24639f1-c8a2-47b5-bdb2-bc98d6f43b87 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:55.615120 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 315/644] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:55.615782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24639f1-c8a2-47b5-bdb2-bc98d6f43b87 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:55.661767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:55.700815 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:55.720419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6507aae-ba97-4a6a-bdce-e1bd0a07f5b7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:55.725435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24639f1-c8a2-47b5-bdb2-bc98d6f43b87 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:55.756613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07b951-1cf6-4ffc-a2f0-609ed5e8ea4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:55.757402 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07b951-1cf6-4ffc-a2f0-609ed5e8ea4e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:55.757715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07b951-1cf6-4ffc-a2f0-609ed5e8ea4e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:55.757990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07b951-1cf6-4ffc-a2f0-609ed5e8ea4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:55.765154 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c3fef-26a8-4149-9dcb-714977ad12c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:55.765320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07b951-1cf6-4ffc-a2f0-609ed5e8ea4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:55.765821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c3fef-26a8-4149-9dcb-714977ad12c3 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:55.766105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c3fef-26a8-4149-9dcb-714977ad12c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:55.766382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c3fef-26a8-4149-9dcb-714977ad12c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:55.766756 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07b951-1cf6-4ffc-a2f0-609ed5e8ea4e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:55.767158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c3fef-26a8-4149-9dcb-714977ad12c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:55.767428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c3fef-26a8-4149-9dcb-714977ad12c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:55.768807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c3fef-26a8-4149-9dcb-714977ad12c3 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:55.782035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 316/645] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:55.782035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c3fef-26a8-4149-9dcb-714977ad12c3 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-2a07b951-1cf6-4ffc-a2f0-609ed5e8ea4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:55.782301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:55.783226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:55.785140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:55.785140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:55.785140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:55.785140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:55.785140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:55.785140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:55.785140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:55.785140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:55.785140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:21:55.785140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:55.787634 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 330/646] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Jun 15 10:21:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:55.788493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07b951-1cf6-4ffc-a2f0-609ed5e8ea4e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:55.895680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c3fef-26a8-4149-9dcb-714977ad12c3 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:55.895911 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07b951-1cf6-4ffc-a2f0-609ed5e8ea4e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:55.898810 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:55.931935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb865b-cee1-4422-a610-d4d74e55a3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:55.932647 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb865b-cee1-4422-a610-d4d74e55a3ac None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:55.932899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f53f82-fdfb-42f1-a294-0b1ea58b9c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:55.933017 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb865b-cee1-4422-a610-d4d74e55a3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:55.933196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb865b-cee1-4422-a610-d4d74e55a3ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:55.933672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f53f82-fdfb-42f1-a294-0b1ea58b9c29 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:55.933956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f53f82-fdfb-42f1-a294-0b1ea58b9c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:55.934232 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f53f82-fdfb-42f1-a294-0b1ea58b9c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:55.940261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb865b-cee1-4422-a610-d4d74e55a3ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:55.941702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb865b-cee1-4422-a610-d4d74e55a3ac None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:55.944893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f53f82-fdfb-42f1-a294-0b1ea58b9c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:55.947613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f53f82-fdfb-42f1-a294-0b1ea58b9c29 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:55.950534 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-adbb865b-cee1-4422-a610-d4d74e55a3ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:21:55.956619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:55.957558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:55.958516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:21:55.958516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:21:55.958516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:21:55.958516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:21:55.958516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:21:55.958516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:21:55.958516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:55.958516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:55.958516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 317/647] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:55.960005 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb865b-cee1-4422-a610-d4d74e55a3ac None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-15f53f82-fdfb-42f1-a294-0b1ea58b9c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:55.971533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:55.972477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:55.973437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:55.973437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:55.973437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:55.973437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:55.977874 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 331/648] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:55.978436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f53f82-fdfb-42f1-a294-0b1ea58b9c29 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:56.068495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb865b-cee1-4422-a610-d4d74e55a3ac None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:56.091195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f53f82-fdfb-42f1-a294-0b1ea58b9c29 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:56.106869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3486cbb-188e-475c-8521-374c6d31da92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:56.107702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3486cbb-188e-475c-8521-374c6d31da92 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:56.107986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3486cbb-188e-475c-8521-374c6d31da92 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:56.108261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3486cbb-188e-475c-8521-374c6d31da92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:56.119835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3486cbb-188e-475c-8521-374c6d31da92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:56.121291 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3486cbb-188e-475c-8521-374c6d31da92 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:56.130493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c295-6783-408c-84a0-e8a69134c5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:56.131309 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c295-6783-408c-84a0-e8a69134c5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:56.131631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c295-6783-408c-84a0-e8a69134c5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:56.131909 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c295-6783-408c-84a0-e8a69134c5b5 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:56.132789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748c295-6783-408c-84a0-e8a69134c5b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:56.133098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748c295-6783-408c-84a0-e8a69134c5b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:56.134519 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748c295-6783-408c-84a0-e8a69134c5b5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-f3486cbb-188e-475c-8521-374c6d31da92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:56.138630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:56.139778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:56.140702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:56.140702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:56.140702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:56.140702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:56.140702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 318/649] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:56.140995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3486cbb-188e-475c-8521-374c6d31da92 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:56.161499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 332/650] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Jun 15 10:21:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:56.161499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c295-6783-408c-84a0-e8a69134c5b5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:56.164577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:56.217297 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:56.261584 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3486cbb-188e-475c-8521-374c6d31da92 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:56.265086 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c295-6783-408c-84a0-e8a69134c5b5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:56.297819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2cab3-e417-49ab-91c7-b73a5bc9622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:56.298572 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2cab3-e417-49ab-91c7-b73a5bc9622e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:56.298856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2cab3-e417-49ab-91c7-b73a5bc9622e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:56.299052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1779658-69c8-4e18-9288-e41e1c97d993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:56.299164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2cab3-e417-49ab-91c7-b73a5bc9622e None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:56.299728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1779658-69c8-4e18-9288-e41e1c97d993 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:56.299943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2cab3-e417-49ab-91c7-b73a5bc9622e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:56.300053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1779658-69c8-4e18-9288-e41e1c97d993 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:56.300253 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2cab3-e417-49ab-91c7-b73a5bc9622e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:56.300349 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1779658-69c8-4e18-9288-e41e1c97d993 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:56.300973 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1779658-69c8-4e18-9288-e41e1c97d993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:56.301278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1779658-69c8-4e18-9288-e41e1c97d993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:56.301676 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2cab3-e417-49ab-91c7-b73a5bc9622e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:56.302619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1779658-69c8-4e18-9288-e41e1c97d993 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:56.318755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 333/651] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:56.318755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1779658-69c8-4e18-9288-e41e1c97d993 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:56.319722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 319/652] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:21:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:56.320919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2cab3-e417-49ab-91c7-b73a5bc9622e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:56.397707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:56.424378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2cab3-e417-49ab-91c7-b73a5bc9622e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:56.425548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1779658-69c8-4e18-9288-e41e1c97d993 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:56.440620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:56.458840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c6cd5-2d8f-4694-b06f-5047e9ff850b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:56.459497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c6cd5-2d8f-4694-b06f-5047e9ff850b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:56.459787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c6cd5-2d8f-4694-b06f-5047e9ff850b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:56.460063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c6cd5-2d8f-4694-b06f-5047e9ff850b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:56.463126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c627b5-4c70-4a85-be5b-82f624acbdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:56.463810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c627b5-4c70-4a85-be5b-82f624acbdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:56.464745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c627b5-4c70-4a85-be5b-82f624acbdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:56.464745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c627b5-4c70-4a85-be5b-82f624acbdd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:56.465157 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c627b5-4c70-4a85-be5b-82f624acbdd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:56.465468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c627b5-4c70-4a85-be5b-82f624acbdd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:56.466839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c627b5-4c70-4a85-be5b-82f624acbdd3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:56.484462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 334/653] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:56.484462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c627b5-4c70-4a85-be5b-82f624acbdd3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:56.539832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c6cd5-2d8f-4694-b06f-5047e9ff850b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:56.541692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c6cd5-2d8f-4694-b06f-5047e9ff850b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:56.593607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c627b5-4c70-4a85-be5b-82f624acbdd3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:56.621345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:56.631335 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473e6ac-f801-4f21-8bed-68887f2818c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:56.632154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473e6ac-f801-4f21-8bed-68887f2818c2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:56.632433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473e6ac-f801-4f21-8bed-68887f2818c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:56.632706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473e6ac-f801-4f21-8bed-68887f2818c2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:56.640655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473e6ac-f801-4f21-8bed-68887f2818c2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:56.642090 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473e6ac-f801-4f21-8bed-68887f2818c2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:56.647592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 320/654] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:56.649127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c6cd5-2d8f-4694-b06f-5047e9ff850b None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-3473e6ac-f801-4f21-8bed-68887f2818c2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:56.662040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:56.663050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:56.665225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:56.665225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:56.665225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:56.665225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:56.665225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:56.665225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:56.665225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:56.665225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:56.665225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 10:21:56.665225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:56.665225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 335/655] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:56.665225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473e6ac-f801-4f21-8bed-68887f2818c2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:56.703271 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:56.763640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c6cd5-2d8f-4694-b06f-5047e9ff850b None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:56.778758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473e6ac-f801-4f21-8bed-68887f2818c2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:56.797782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d852a-9c7e-495a-a875-864e569c40a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:56.798430 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d852a-9c7e-495a-a875-864e569c40a7 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:56.798706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d852a-9c7e-495a-a875-864e569c40a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:56.798975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d852a-9c7e-495a-a875-864e569c40a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:56.799831 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d852a-9c7e-495a-a875-864e569c40a7 None admin] RBAC: Adding query filter params (role.id=f6ffe6f612824e50a23f0b06a16a1f91, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=68f1b06364a24554bba9936621127752) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:56.800143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d852a-9c7e-495a-a875-864e569c40a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:56.801562 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d852a-9c7e-495a-a875-864e569c40a7 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:56.819496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 321/656] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:56 2022] GET /identity/v3/role_assignments?user.id=68f1b06364a24554bba9936621127752&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=f6ffe6f612824e50a23f0b06a16a1f91 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:56.819496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d852a-9c7e-495a-a875-864e569c40a7 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:56.823798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c13b7-63ff-4518-8a06-0352594628ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:56.824714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c13b7-63ff-4518-8a06-0352594628ea None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:56.825065 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c13b7-63ff-4518-8a06-0352594628ea None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:56.825466 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c13b7-63ff-4518-8a06-0352594628ea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:56.834105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c13b7-63ff-4518-8a06-0352594628ea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:56.836280 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c13b7-63ff-4518-8a06-0352594628ea None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-536c13b7-63ff-4518-8a06-0352594628ea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:56.852707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:56.853754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:56.854722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:56.854722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:56.854722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:56.854722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:56.854722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:56.854722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:56.854722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:56.854722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:56.854722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 10:21:56.854722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:56.858953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 336/657] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:21:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:56.860087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c13b7-63ff-4518-8a06-0352594628ea None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:56.884112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:56.968296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d852a-9c7e-495a-a875-864e569c40a7 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:56.972194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:56.981765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c13b7-63ff-4518-8a06-0352594628ea None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:57.024988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30f29e-c09c-45c6-a04b-b80ddffebdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:57.026127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30f29e-c09c-45c6-a04b-b80ddffebdfb None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:57.028792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30f29e-c09c-45c6-a04b-b80ddffebdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:57.028792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30f29e-c09c-45c6-a04b-b80ddffebdfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:57.041215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30f29e-c09c-45c6-a04b-b80ddffebdfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:57.041375 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281a532-a8f0-4293-8d89-1165617537bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:57.042358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281a532-a8f0-4293-8d89-1165617537bb None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:57.042877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281a532-a8f0-4293-8d89-1165617537bb None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:57.043359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281a532-a8f0-4293-8d89-1165617537bb None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:57.043798 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30f29e-c09c-45c6-a04b-b80ddffebdfb None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:57.044988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281a532-a8f0-4293-8d89-1165617537bb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:57.045554 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281a532-a8f0-4293-8d89-1165617537bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:57.048503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281a532-a8f0-4293-8d89-1165617537bb None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-5b30f29e-c09c-45c6-a04b-b80ddffebdfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:57.062185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:57.063302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:57.064455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:57.064455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:57.064455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:57.064455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:57.066131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 322/658] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:57.067042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30f29e-c09c-45c6-a04b-b80ddffebdfb None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:57.078484 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 337/659] 10.222.0.50 () {56 vars in 1139 bytes} [Wed Jun 15 10:21:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:57.083150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281a532-a8f0-4293-8d89-1165617537bb None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:57.196198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:57.205197 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30f29e-c09c-45c6-a04b-b80ddffebdfb None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:57.209217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281a532-a8f0-4293-8d89-1165617537bb None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:57.239475 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80789b-d57f-478d-aed6-15f87a4dc84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:57.240153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80789b-d57f-478d-aed6-15f87a4dc84e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:57.240441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80789b-d57f-478d-aed6-15f87a4dc84e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:57.240713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80789b-d57f-478d-aed6-15f87a4dc84e None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:57.242331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80789b-d57f-478d-aed6-15f87a4dc84e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:57.242644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80789b-d57f-478d-aed6-15f87a4dc84e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:57.244107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80789b-d57f-478d-aed6-15f87a4dc84e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:57.248060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857785af-5068-4f27-bfe1-0aee661352ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:57.248715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857785af-5068-4f27-bfe1-0aee661352ea None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:57.248994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857785af-5068-4f27-bfe1-0aee661352ea None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:57.249267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857785af-5068-4f27-bfe1-0aee661352ea None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:57.249978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857785af-5068-4f27-bfe1-0aee661352ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:57.250279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857785af-5068-4f27-bfe1-0aee661352ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:57.251636 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857785af-5068-4f27-bfe1-0aee661352ea None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:57.263199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 323/660] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Jun 15 10:21:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:57.268027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 338/661] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:57.268412 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80789b-d57f-478d-aed6-15f87a4dc84e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:57.269051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc60f-c609-4b9d-a235-3b2876f0a93f None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:57.269345 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc60f-c609-4b9d-a235-3b2876f0a93f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:57.269622 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafc60f-c609-4b9d-a235-3b2876f0a93f None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:57.270920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 339/662] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:57.271597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafc60f-c609-4b9d-a235-3b2876f0a93f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:57.289377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:57.381974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80789b-d57f-478d-aed6-15f87a4dc84e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:57.386053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafc60f-c609-4b9d-a235-3b2876f0a93f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:57.418605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e706f2-e3be-4fca-b1d6-951233022136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:57.419408 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e706f2-e3be-4fca-b1d6-951233022136 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:57.419724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e706f2-e3be-4fca-b1d6-951233022136 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:57.419973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e706f2-e3be-4fca-b1d6-951233022136 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:57.421817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a662b6-42d4-4f08-945f-81f8488dd5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:57.422459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a662b6-42d4-4f08-945f-81f8488dd5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:57.422738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a662b6-42d4-4f08-945f-81f8488dd5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:57.423010 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a662b6-42d4-4f08-945f-81f8488dd5b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:57.440749 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:57.493380 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e706f2-e3be-4fca-b1d6-951233022136 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:57.494862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e706f2-e3be-4fca-b1d6-951233022136 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:57.497094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a662b6-42d4-4f08-945f-81f8488dd5b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:57.498539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a662b6-42d4-4f08-945f-81f8488dd5b3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:57.513175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:57.602486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 324/663] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:57.603336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e706f2-e3be-4fca-b1d6-951233022136 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:57.617419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 340/664] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:21:57.617419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6719-307c-44d6-abc1-dcb18609a694 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:57.617419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6719-307c-44d6-abc1-dcb18609a694 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:57.617419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6719-307c-44d6-abc1-dcb18609a694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:57.632233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a4bf6719-307c-44d6-abc1-dcb18609a694 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:57.633971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a4bf6719-307c-44d6-abc1-dcb18609a694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:57.664729 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:57.713979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 341/665] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:21:57.715170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf6719-307c-44d6-abc1-dcb18609a694 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:57.719970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e706f2-e3be-4fca-b1d6-951233022136 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:57.761120 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656430cd-269b-4aab-9fa2-0e062a72914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:57.761962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656430cd-269b-4aab-9fa2-0e062a72914a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:57.762245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656430cd-269b-4aab-9fa2-0e062a72914a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:57.762517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656430cd-269b-4aab-9fa2-0e062a72914a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:57.768107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:57.770495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656430cd-269b-4aab-9fa2-0e062a72914a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:57.772038 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656430cd-269b-4aab-9fa2-0e062a72914a None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-656430cd-269b-4aab-9fa2-0e062a72914a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:21:57.786308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:57.787219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:57.788598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:21:57.788598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:21:57.788598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:21:57.788598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:21:57.788598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:21:57.788598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:21:57.788598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:57.788598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:57.788598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 325/666] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:57.788598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656430cd-269b-4aab-9fa2-0e062a72914a None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:57.833574 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf6719-307c-44d6-abc1-dcb18609a694 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:57.869606 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be60b9a-e553-45b6-b8bb-0858e0275ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:57.870431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be60b9a-e553-45b6-b8bb-0858e0275ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:57.870714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be60b9a-e553-45b6-b8bb-0858e0275ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:57.870989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be60b9a-e553-45b6-b8bb-0858e0275ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:57.881755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be60b9a-e553-45b6-b8bb-0858e0275ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:57.883766 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be60b9a-e553-45b6-b8bb-0858e0275ee1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:57.894675 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656430cd-269b-4aab-9fa2-0e062a72914a None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-0be60b9a-e553-45b6-b8bb-0858e0275ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:57.901326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:57.902391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:57.908256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:57.908256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:57.908256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:57.908256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:57.908256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 342/667] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:57.908256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be60b9a-e553-45b6-b8bb-0858e0275ee1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:57.913104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:57.938533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255279e6-f60c-4b6a-aff8-ed905df5e6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:57.939296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255279e6-f60c-4b6a-aff8-ed905df5e6fa None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:57.939611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255279e6-f60c-4b6a-aff8-ed905df5e6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:57.939877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255279e6-f60c-4b6a-aff8-ed905df5e6fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:57.954660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255279e6-f60c-4b6a-aff8-ed905df5e6fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:57.956148 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255279e6-f60c-4b6a-aff8-ed905df5e6fa None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-255279e6-f60c-4b6a-aff8-ed905df5e6fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:57.977931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:57.978911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:57.979919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:57.979919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:57.979919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:57.979919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:57.985115 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 326/668] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:57.985115 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255279e6-f60c-4b6a-aff8-ed905df5e6fa None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:58.008333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:58.016029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be60b9a-e553-45b6-b8bb-0858e0275ee1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:58.052898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accc12e-a89d-4fa0-9600-43f501f07368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:58.053715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc12e-a89d-4fa0-9600-43f501f07368 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:58.054000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc12e-a89d-4fa0-9600-43f501f07368 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:58.054796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc12e-a89d-4fa0-9600-43f501f07368 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:58.069127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accc12e-a89d-4fa0-9600-43f501f07368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-5accc12e-a89d-4fa0-9600-43f501f07368 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:21:58.080193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:58.081164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:58.087130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:58.087130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:58.087130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:58.087130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:58.087130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:21:58.087130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:21:58.087130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:21:58.087130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:21:58.087130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:21:58.087130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:21:58.087130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:21:58.087130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:58.087130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 343/669] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:21:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:58.087130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accc12e-a89d-4fa0-9600-43f501f07368 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:58.090470 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255279e6-f60c-4b6a-aff8-ed905df5e6fa None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:58.126654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4068a-341e-48c2-beb7-938687621453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:58.127234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4068a-341e-48c2-beb7-938687621453 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:58.127546 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4068a-341e-48c2-beb7-938687621453 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:58.127827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4068a-341e-48c2-beb7-938687621453 None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:58.128615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4068a-341e-48c2-beb7-938687621453 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:58.128927 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4068a-341e-48c2-beb7-938687621453 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:58.130368 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4068a-341e-48c2-beb7-938687621453 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:58.143776 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 327/670] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:21:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:58.144393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4068a-341e-48c2-beb7-938687621453 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:58.168640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:58.201417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accc12e-a89d-4fa0-9600-43f501f07368 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:58.236119 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d60c2-8829-4d11-a9fc-e5064a62a267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:58.237176 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d60c2-8829-4d11-a9fc-e5064a62a267 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:58.237520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d60c2-8829-4d11-a9fc-e5064a62a267 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:58.237762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d60c2-8829-4d11-a9fc-e5064a62a267 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:58.238426 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d60c2-8829-4d11-a9fc-e5064a62a267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:58.238729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d60c2-8829-4d11-a9fc-e5064a62a267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:58.240099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d60c2-8829-4d11-a9fc-e5064a62a267 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:58.249302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4068a-341e-48c2-beb7-938687621453 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:58.257368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 344/671] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:58.257368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d60c2-8829-4d11-a9fc-e5064a62a267 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:58.273312 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:58.287799 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47a710-d585-4bce-b42b-770d2cdcff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:58.289271 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47a710-d585-4bce-b42b-770d2cdcff8c None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:58.289555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47a710-d585-4bce-b42b-770d2cdcff8c None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:58.290193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47a710-d585-4bce-b42b-770d2cdcff8c None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:58.291233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47a710-d585-4bce-b42b-770d2cdcff8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:58.291816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47a710-d585-4bce-b42b-770d2cdcff8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:58.293194 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47a710-d585-4bce-b42b-770d2cdcff8c None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:58.307241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 328/672] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:58.308081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47a710-d585-4bce-b42b-770d2cdcff8c None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:58.367576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d60c2-8829-4d11-a9fc-e5064a62a267 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:58.395234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:58.404077 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72417854-d711-436c-9f4e-990f37930c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:58.404736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417854-d711-436c-9f4e-990f37930c2e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:58.405006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417854-d711-436c-9f4e-990f37930c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:58.405285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417854-d711-436c-9f4e-990f37930c2e None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:58.406066 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72417854-d711-436c-9f4e-990f37930c2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:58.406371 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72417854-d711-436c-9f4e-990f37930c2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:58.407770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72417854-d711-436c-9f4e-990f37930c2e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:58.415590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47a710-d585-4bce-b42b-770d2cdcff8c None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:58.418459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 345/673] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:21:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:58.419179 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72417854-d711-436c-9f4e-990f37930c2e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:58.459517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f744739-6ebf-488f-8ef2-e2c006a454e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:58.460173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f744739-6ebf-488f-8ef2-e2c006a454e7 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:58.460452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f744739-6ebf-488f-8ef2-e2c006a454e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:58.460764 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f744739-6ebf-488f-8ef2-e2c006a454e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:58.462205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f744739-6ebf-488f-8ef2-e2c006a454e7 None admin] RBAC: Adding query filter params (role.id=f6ffe6f612824e50a23f0b06a16a1f91, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=81e9805ec4c44cedb658b7becf768369) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:58.462520 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f744739-6ebf-488f-8ef2-e2c006a454e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:58.464425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f744739-6ebf-488f-8ef2-e2c006a454e7 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:58.483577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 329/674] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:58 2022] GET /identity/v3/role_assignments?user.id=81e9805ec4c44cedb658b7becf768369&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=f6ffe6f612824e50a23f0b06a16a1f91 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:58.483577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f744739-6ebf-488f-8ef2-e2c006a454e7 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:58.504292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:58.538478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72417854-d711-436c-9f4e-990f37930c2e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:58.588972 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bf64d-4e62-4a46-b7e5-6faf4bef28dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:58.590290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bf64d-4e62-4a46-b7e5-6faf4bef28dd None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:58.590572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bf64d-4e62-4a46-b7e5-6faf4bef28dd None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:58.590852 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bf64d-4e62-4a46-b7e5-6faf4bef28dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:58.601401 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bf64d-4e62-4a46-b7e5-6faf4bef28dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:58.603823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bf64d-4e62-4a46-b7e5-6faf4bef28dd None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:58.615972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f744739-6ebf-488f-8ef2-e2c006a454e7 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-189bf64d-4e62-4a46-b7e5-6faf4bef28dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:21:58.626685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:58.627745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:58.628662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:21:58.628662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:21:58.628662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:21:58.628662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:21:58.628662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:21:58.628662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:21:58.628662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:58.628662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:58.635390 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 346/675] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:58.635390 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bf64d-4e62-4a46-b7e5-6faf4bef28dd None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:58.673276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65307f1b-dea9-4194-a5b3-945971897679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:58.674083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65307f1b-dea9-4194-a5b3-945971897679 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:58.674364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65307f1b-dea9-4194-a5b3-945971897679 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:58.674634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65307f1b-dea9-4194-a5b3-945971897679 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:58.686646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65307f1b-dea9-4194-a5b3-945971897679 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:58.688468 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65307f1b-dea9-4194-a5b3-945971897679 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-65307f1b-dea9-4194-a5b3-945971897679 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:21:58.705574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:58.706541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:58.708474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:21:58.708474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:21:58.708474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:21:58.708474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:21:58.708474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:21:58.708474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:21:58.708474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:21:58.708474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:21:58.708474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 330/676] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:21:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:58.708474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65307f1b-dea9-4194-a5b3-945971897679 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:58.718235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:58.779207 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bf64d-4e62-4a46-b7e5-6faf4bef28dd None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:58.814677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc2ee4-89fb-49cd-bd23-67d01c67febf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:58.815485 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc2ee4-89fb-49cd-bd23-67d01c67febf None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:58.815787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc2ee4-89fb-49cd-bd23-67d01c67febf None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:58.816058 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc2ee4-89fb-49cd-bd23-67d01c67febf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:58.819008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:58.827041 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc2ee4-89fb-49cd-bd23-67d01c67febf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:58.828528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc2ee4-89fb-49cd-bd23-67d01c67febf None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:58.842915 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65307f1b-dea9-4194-a5b3-945971897679 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-f9fc2ee4-89fb-49cd-bd23-67d01c67febf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:58.847559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:58.848476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:58.849419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:58.849419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:58.849419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:58.849419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:58.849419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 347/677] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:58.849721 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc2ee4-89fb-49cd-bd23-67d01c67febf None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:58.885210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3d51e-cf7a-4541-a738-04cfa3b70c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:58.886136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3d51e-cf7a-4541-a738-04cfa3b70c3d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:58.886755 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3d51e-cf7a-4541-a738-04cfa3b70c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:58.887111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3d51e-cf7a-4541-a738-04cfa3b70c3d None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:58.888189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3d51e-cf7a-4541-a738-04cfa3b70c3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:58.888495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3d51e-cf7a-4541-a738-04cfa3b70c3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:58.891080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3d51e-cf7a-4541-a738-04cfa3b70c3d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:58.907562 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 331/678] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:21:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:58.908425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3d51e-cf7a-4541-a738-04cfa3b70c3d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:58.973763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc2ee4-89fb-49cd-bd23-67d01c67febf None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:58.982098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:59.019246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76d3da-900b-494d-b725-73e372cfb446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:59.020578 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76d3da-900b-494d-b725-73e372cfb446 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:59.020971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76d3da-900b-494d-b725-73e372cfb446 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:59.021251 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76d3da-900b-494d-b725-73e372cfb446 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:59.021610 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3d51e-cf7a-4541-a738-04cfa3b70c3d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:59.022228 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76d3da-900b-494d-b725-73e372cfb446 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:59.022772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76d3da-900b-494d-b725-73e372cfb446 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:59.027618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76d3da-900b-494d-b725-73e372cfb446 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:59.050131 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 348/679] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:21:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:59.051308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76d3da-900b-494d-b725-73e372cfb446 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:59.066723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47928382-8c3c-4457-90bf-0be1b5c7888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:59.067605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47928382-8c3c-4457-90bf-0be1b5c7888f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:59.067991 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47928382-8c3c-4457-90bf-0be1b5c7888f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:59.068366 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47928382-8c3c-4457-90bf-0be1b5c7888f None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:59.069212 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47928382-8c3c-4457-90bf-0be1b5c7888f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:59.069622 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47928382-8c3c-4457-90bf-0be1b5c7888f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:59.071732 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47928382-8c3c-4457-90bf-0be1b5c7888f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:59.089830 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 332/680] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:59.090864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47928382-8c3c-4457-90bf-0be1b5c7888f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:59.117279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:59.170772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76d3da-900b-494d-b725-73e372cfb446 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:59.196928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47928382-8c3c-4457-90bf-0be1b5c7888f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:59.205925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38277a5d-b806-4bd8-a4f9-f387155b3b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:59.206588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277a5d-b806-4bd8-a4f9-f387155b3b5f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:59.206873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277a5d-b806-4bd8-a4f9-f387155b3b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:59.207152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277a5d-b806-4bd8-a4f9-f387155b3b5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:59.208015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38277a5d-b806-4bd8-a4f9-f387155b3b5f None admin] RBAC: Adding query filter params (role.id=f6ffe6f612824e50a23f0b06a16a1f91, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=5f2e2038f69f49019a1e528107296223) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:59.208329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38277a5d-b806-4bd8-a4f9-f387155b3b5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:59.209773 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38277a5d-b806-4bd8-a4f9-f387155b3b5f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:59.216756 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 349/681] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:59 2022] GET /identity/v3/role_assignments?user.id=5f2e2038f69f49019a1e528107296223&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=f6ffe6f612824e50a23f0b06a16a1f91 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:59.217383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38277a5d-b806-4bd8-a4f9-f387155b3b5f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:59.234851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:59.245708 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c847d9e-2ef5-4558-9fb1-a3867e1a0eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:59.246697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c847d9e-2ef5-4558-9fb1-a3867e1a0eed None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:59.247192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c847d9e-2ef5-4558-9fb1-a3867e1a0eed None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:59.247696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c847d9e-2ef5-4558-9fb1-a3867e1a0eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:59.248975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c847d9e-2ef5-4558-9fb1-a3867e1a0eed None admin] RBAC: Adding query filter params (role.id=f6ffe6f612824e50a23f0b06a16a1f91, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=383ef65dd6b14810a7a2a8e06143eca2) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:59.249295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c847d9e-2ef5-4558-9fb1-a3867e1a0eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:59.250791 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c847d9e-2ef5-4558-9fb1-a3867e1a0eed None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:59.267960 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 333/682] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:21:59 2022] GET /identity/v3/role_assignments?user.id=383ef65dd6b14810a7a2a8e06143eca2&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=f6ffe6f612824e50a23f0b06a16a1f91 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:59.269777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802a56b-2092-48fc-9d1f-02c873e783c7 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:59.270071 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802a56b-2092-48fc-9d1f-02c873e783c7 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:59.270350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802a56b-2092-48fc-9d1f-02c873e783c7 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:59.272037 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 334/683] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:21:59.282493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c51dd6-906a-4fe4-8289-7231f400971c None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:59.282758 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c51dd6-906a-4fe4-8289-7231f400971c None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:59.283038 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c51dd6-906a-4fe4-8289-7231f400971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:59.334638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-29c51dd6-906a-4fe4-8289-7231f400971c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:21:59.336515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-29c51dd6-906a-4fe4-8289-7231f400971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:21:59.390146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38277a5d-b806-4bd8-a4f9-f387155b3b5f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:59.411725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:59.445055 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a4712-9c82-4592-aec5-7b62511c9c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:59.446394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a4712-9c82-4592-aec5-7b62511c9c29 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:59.446890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a4712-9c82-4592-aec5-7b62511c9c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:59.447445 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a4712-9c82-4592-aec5-7b62511c9c29 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:59.461823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a4712-9c82-4592-aec5-7b62511c9c29 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:59.463753 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a4712-9c82-4592-aec5-7b62511c9c29 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:59.486971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 335/684] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-375a4712-9c82-4592-aec5-7b62511c9c29 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:21:59.488755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:59.489750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:59.491311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:59.491311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:59.491311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:21:59.491311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:21:59.491311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:21:59.491311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:21:59.491311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:21:59.491311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:21:59.491311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 10:21:59.491311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:59.491311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 350/685] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:21:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:21:59.495828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c51dd6-906a-4fe4-8289-7231f400971c None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:59.517540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a4712-9c82-4592-aec5-7b62511c9c29 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:59.623806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c51dd6-906a-4fe4-8289-7231f400971c None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:59.664442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:59.686136 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a4712-9c82-4592-aec5-7b62511c9c29 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:59.691753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63896678-5cd3-476d-b0e6-3ebd5dc03035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:59.692434 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63896678-5cd3-476d-b0e6-3ebd5dc03035 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:59.692714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63896678-5cd3-476d-b0e6-3ebd5dc03035 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:59.692986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63896678-5cd3-476d-b0e6-3ebd5dc03035 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:59.693839 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63896678-5cd3-476d-b0e6-3ebd5dc03035 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:21:59.694145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63896678-5cd3-476d-b0e6-3ebd5dc03035 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:59.696174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63896678-5cd3-476d-b0e6-3ebd5dc03035 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:59.733665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 336/686] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Jun 15 10:21:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:21:59.735164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63896678-5cd3-476d-b0e6-3ebd5dc03035 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:59.738642 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2284-afd5-4325-bec9-9304b47e812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:59.739374 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2284-afd5-4325-bec9-9304b47e812c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:59.739694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2284-afd5-4325-bec9-9304b47e812c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:59.739969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2284-afd5-4325-bec9-9304b47e812c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:59.752954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b2284-afd5-4325-bec9-9304b47e812c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:21:59.754416 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b2284-afd5-4325-bec9-9304b47e812c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-b05b2284-afd5-4325-bec9-9304b47e812c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:21:59.772334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:21:59.773361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:21:59.774281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:21:59.774281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:21:59.774281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:21:59.774281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:21:59.774281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 351/687] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:21:59.779614 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2284-afd5-4325-bec9-9304b47e812c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:21:59.808173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:21:59.859041 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63896678-5cd3-476d-b0e6-3ebd5dc03035 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:59.910094 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315bf7b-d3ec-4007-8fc6-41d72407a387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:21:59.910752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315bf7b-d3ec-4007-8fc6-41d72407a387 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:21:59.911035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315bf7b-d3ec-4007-8fc6-41d72407a387 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:21:59.911311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315bf7b-d3ec-4007-8fc6-41d72407a387 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:21:59.954287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2284-afd5-4325-bec9-9304b47e812c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:21:59.983660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:00.010678 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315bf7b-d3ec-4007-8fc6-41d72407a387 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:00.012203 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315bf7b-d3ec-4007-8fc6-41d72407a387 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:00.027628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74dadd-7c10-45ac-91ba-9dadd6a20a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:00.028300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74dadd-7c10-45ac-91ba-9dadd6a20a35 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:00.028649 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74dadd-7c10-45ac-91ba-9dadd6a20a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:00.028930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74dadd-7c10-45ac-91ba-9dadd6a20a35 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:00.029668 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74dadd-7c10-45ac-91ba-9dadd6a20a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:00.029979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74dadd-7c10-45ac-91ba-9dadd6a20a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:00.031344 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74dadd-7c10-45ac-91ba-9dadd6a20a35 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:00.058089 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 352/688] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:00.064377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74dadd-7c10-45ac-91ba-9dadd6a20a35 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:00.211790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:00.226954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 337/689] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:21:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:00.229072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74dadd-7c10-45ac-91ba-9dadd6a20a35 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:00.233351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315bf7b-d3ec-4007-8fc6-41d72407a387 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:00.268006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89e282-0015-4680-8626-69b47141a7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:00.268601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89e282-0015-4680-8626-69b47141a7d4 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:00.268886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89e282-0015-4680-8626-69b47141a7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:00.269163 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89e282-0015-4680-8626-69b47141a7d4 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:00.269887 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89e282-0015-4680-8626-69b47141a7d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:00.271316 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89e282-0015-4680-8626-69b47141a7d4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:00.312841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 353/690] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:22:00 2022] POST /identity/v3/users => generated 254 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:22:00.369506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:00.393383 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315bf7b-d3ec-4007-8fc6-41d72407a387 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:00.438151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26d429-fb81-4871-82a5-a62cd66b4c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:00.438964 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26d429-fb81-4871-82a5-a62cd66b4c81 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:00.439247 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26d429-fb81-4871-82a5-a62cd66b4c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:00.440472 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26d429-fb81-4871-82a5-a62cd66b4c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:00.455867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26d429-fb81-4871-82a5-a62cd66b4c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:00.457352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26d429-fb81-4871-82a5-a62cd66b4c81 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-5f26d429-fb81-4871-82a5-a62cd66b4c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:00.485666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:00.486692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:00.488096 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:00.488096 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:00.488096 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:00.488096 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:00.488096 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 338/691] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:00.494790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89e282-0015-4680-8626-69b47141a7d4 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:00.631556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89e282-0015-4680-8626-69b47141a7d4 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:00.687081 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b895bfb-d816-4182-86c4-0b31801de9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:00.688166 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895bfb-d816-4182-86c4-0b31801de9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:00.688670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895bfb-d816-4182-86c4-0b31801de9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:00.689140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895bfb-d816-4182-86c4-0b31801de9c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:00.690689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b895bfb-d816-4182-86c4-0b31801de9c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:00.691455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b895bfb-d816-4182-86c4-0b31801de9c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:00.693129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b895bfb-d816-4182-86c4-0b31801de9c0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:00.706962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:00.715805 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 354/692] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:00.718998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26d429-fb81-4871-82a5-a62cd66b4c81 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:00.827834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26d429-fb81-4871-82a5-a62cd66b4c81 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:00.857893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:00.868118 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6a8b1-a365-43ce-87db-933098b2c445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:00.869499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a8b1-a365-43ce-87db-933098b2c445 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:00.870184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a8b1-a365-43ce-87db-933098b2c445 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:00.870747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a8b1-a365-43ce-87db-933098b2c445 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:00.878389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6a8b1-a365-43ce-87db-933098b2c445 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:00.880714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6a8b1-a365-43ce-87db-933098b2c445 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-23f6a8b1-a365-43ce-87db-933098b2c445 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:00.897159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:00.898261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:00.899338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:00.899338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:00.899338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:00.899338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:00.899338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:00.899338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:00.899338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:00.899338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:00.899834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 339/693] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:00.907107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b895bfb-d816-4182-86c4-0b31801de9c0 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:01.034268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484284e-a736-4a9e-a421-9ff6ddc9ed44 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:01.034618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484284e-a736-4a9e-a421-9ff6ddc9ed44 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:01.034818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484284e-a736-4a9e-a421-9ff6ddc9ed44 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:01.036345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 340/694] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:22:01.040640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b895bfb-d816-4182-86c4-0b31801de9c0 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:01.042103 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376838f2-8a4e-4b90-8ea4-39641ce946e0 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:01.042391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376838f2-8a4e-4b90-8ea4-39641ce946e0 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:01.042688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376838f2-8a4e-4b90-8ea4-39641ce946e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:01.071391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-376838f2-8a4e-4b90-8ea4-39641ce946e0 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:01.072711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-376838f2-8a4e-4b90-8ea4-39641ce946e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:01.078306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564032d6-7b89-4406-b410-763e4d7e422d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:01.078966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564032d6-7b89-4406-b410-763e4d7e422d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:01.079244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564032d6-7b89-4406-b410-763e4d7e422d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:01.079599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564032d6-7b89-4406-b410-763e4d7e422d None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:01.080321 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564032d6-7b89-4406-b410-763e4d7e422d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:01.080628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564032d6-7b89-4406-b410-763e4d7e422d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:01.082340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564032d6-7b89-4406-b410-763e4d7e422d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:01.102169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 355/695] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:01.123282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564032d6-7b89-4406-b410-763e4d7e422d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:01.216370 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 341/696] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:22:01.244278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:01.252115 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376838f2-8a4e-4b90-8ea4-39641ce946e0 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:01.293685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564032d6-7b89-4406-b410-763e4d7e422d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:01.331357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963695a4-1310-4a36-9b41-bb21e8c44998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:01.332063 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963695a4-1310-4a36-9b41-bb21e8c44998 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:01.332352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963695a4-1310-4a36-9b41-bb21e8c44998 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:01.333501 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963695a4-1310-4a36-9b41-bb21e8c44998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:01.334350 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963695a4-1310-4a36-9b41-bb21e8c44998 None admin] RBAC: Adding query filter params (role.id=f6ffe6f612824e50a23f0b06a16a1f91, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=7673b1c4f6184570b0039f9285bf1286) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:01.334667 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963695a4-1310-4a36-9b41-bb21e8c44998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:01.336152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963695a4-1310-4a36-9b41-bb21e8c44998 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:01.352216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 356/697] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:22:01 2022] GET /identity/v3/role_assignments?user.id=7673b1c4f6184570b0039f9285bf1286&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=f6ffe6f612824e50a23f0b06a16a1f91 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:01.459755 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376838f2-8a4e-4b90-8ea4-39641ce946e0 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:01.495326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:01.518513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22770481-6406-4c44-bc8d-c59dff1ad45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:01.519318 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22770481-6406-4c44-bc8d-c59dff1ad45c None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:01.519625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22770481-6406-4c44-bc8d-c59dff1ad45c None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:01.519900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22770481-6406-4c44-bc8d-c59dff1ad45c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:01.535097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22770481-6406-4c44-bc8d-c59dff1ad45c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-22770481-6406-4c44-bc8d-c59dff1ad45c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:01.543309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:01.544331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:01.545223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:01.545223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:01.545223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:01.545223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:01.545223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:01.545223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:01.545223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:01.545223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:01.545223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:01.545223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:01.545223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:01.545223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:01.545223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 342/698] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:22:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:01.556594 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963695a4-1310-4a36-9b41-bb21e8c44998 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:01.681976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963695a4-1310-4a36-9b41-bb21e8c44998 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:01.706100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:01.717901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127eb34-bc0e-4df6-9a4c-d5d51a5569b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:01.718790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127eb34-bc0e-4df6-9a4c-d5d51a5569b4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:01.719097 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127eb34-bc0e-4df6-9a4c-d5d51a5569b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:01.719333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127eb34-bc0e-4df6-9a4c-d5d51a5569b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:01.720116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127eb34-bc0e-4df6-9a4c-d5d51a5569b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:01.720421 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127eb34-bc0e-4df6-9a4c-d5d51a5569b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:01.721775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127eb34-bc0e-4df6-9a4c-d5d51a5569b4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:01.731443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 357/699] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:22:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:01.736502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22770481-6406-4c44-bc8d-c59dff1ad45c None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:01.848301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22770481-6406-4c44-bc8d-c59dff1ad45c None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:01.885655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf87d8f-ba9e-4b39-9d20-c7578b57cf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:01.886453 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf87d8f-ba9e-4b39-9d20-c7578b57cf55 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:01.886724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf87d8f-ba9e-4b39-9d20-c7578b57cf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:01.886995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf87d8f-ba9e-4b39-9d20-c7578b57cf55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:01.893570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04722e-be10-4b35-843c-01f6c78f2a7b None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:01.893853 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04722e-be10-4b35-843c-01f6c78f2a7b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:01.894129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04722e-be10-4b35-843c-01f6c78f2a7b None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:01.896314 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 358/700] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:01.900097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf87d8f-ba9e-4b39-9d20-c7578b57cf55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:01.901577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf87d8f-ba9e-4b39-9d20-c7578b57cf55 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:01.902030 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1046b8b-5bc5-4255-b571-964a47bc65bb None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:01.902318 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1046b8b-5bc5-4255-b571-964a47bc65bb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:01.902597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1046b8b-5bc5-4255-b571-964a47bc65bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:01.921345 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b1046b8b-5bc5-4255-b571-964a47bc65bb None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:01.922536 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b1046b8b-5bc5-4255-b571-964a47bc65bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-bbf87d8f-ba9e-4b39-9d20-c7578b57cf55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:01.923008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:01.925050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:01.927209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:01.927209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:01.927209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:01.927209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:01.927209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 343/701] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:01.927209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4aecc-b999-4595-9855-c5143969b52e None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:01.927209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4aecc-b999-4595-9855-c5143969b52e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:01.927209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4aecc-b999-4595-9855-c5143969b52e None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:01.928301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 344/702] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:01.933754 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c934a-adf8-4181-9fae-a4e3a988bbcb None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:01.934039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c934a-adf8-4181-9fae-a4e3a988bbcb None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:01.934315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c934a-adf8-4181-9fae-a4e3a988bbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:01.952046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-f38c934a-adf8-4181-9fae-a4e3a988bbcb None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:01.953220 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f38c934a-adf8-4181-9fae-a4e3a988bbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:01.981751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:02.018393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 359/703] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 10:22:02.019527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1046b8b-5bc5-4255-b571-964a47bc65bb None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:02.034348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 345/704] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:22:02.058303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c934a-adf8-4181-9fae-a4e3a988bbcb None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:02.165460 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c934a-adf8-4181-9fae-a4e3a988bbcb None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:02.173819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1046b8b-5bc5-4255-b571-964a47bc65bb None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:02.201323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:02.208959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317a22f-9b92-43d9-bc23-3e7d8484e690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:02.209805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317a22f-9b92-43d9-bc23-3e7d8484e690 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:02.210336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317a22f-9b92-43d9-bc23-3e7d8484e690 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:02.211190 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317a22f-9b92-43d9-bc23-3e7d8484e690 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:02.211902 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317a22f-9b92-43d9-bc23-3e7d8484e690 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:02.213929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317a22f-9b92-43d9-bc23-3e7d8484e690 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:02.219173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e649a-5daa-4bbc-acd3-85af4bdf1038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:02.220272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e649a-5daa-4bbc-acd3-85af4bdf1038 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:02.220737 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e649a-5daa-4bbc-acd3-85af4bdf1038 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:02.221210 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e649a-5daa-4bbc-acd3-85af4bdf1038 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:02.222112 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e649a-5daa-4bbc-acd3-85af4bdf1038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:02.222596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e649a-5daa-4bbc-acd3-85af4bdf1038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:02.224164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e649a-5daa-4bbc-acd3-85af4bdf1038 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-9317a22f-9b92-43d9-bc23-3e7d8484e690 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:02.230420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:02.231452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:02.232374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 346/705] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Jun 15 10:22:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:02.233284 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317a22f-9b92-43d9-bc23-3e7d8484e690 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:02.246765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 360/706] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:02.248004 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e649a-5daa-4bbc-acd3-85af4bdf1038 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:02.270462 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:02.369568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317a22f-9b92-43d9-bc23-3e7d8484e690 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:02.386479 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e649a-5daa-4bbc-acd3-85af4bdf1038 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:02.414505 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4971554-1b93-4971-b187-60c8bcd649d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:02.415335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4971554-1b93-4971-b187-60c8bcd649d9 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:02.415704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4971554-1b93-4971-b187-60c8bcd649d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:02.415931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4971554-1b93-4971-b187-60c8bcd649d9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:02.416855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4971554-1b93-4971-b187-60c8bcd649d9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:02.419066 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4971554-1b93-4971-b187-60c8bcd649d9 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:02.429878 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db2942-1310-4873-a290-91d7442f7c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:02.430810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db2942-1310-4873-a290-91d7442f7c1f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:02.431293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db2942-1310-4873-a290-91d7442f7c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:02.431793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db2942-1310-4873-a290-91d7442f7c1f None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:02.432701 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db2942-1310-4873-a290-91d7442f7c1f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:02.433224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db2942-1310-4873-a290-91d7442f7c1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-e4971554-1b93-4971-b187-60c8bcd649d9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:02.433855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:02.434930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:02.435889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 347/707] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:02 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:02.436757 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4971554-1b93-4971-b187-60c8bcd649d9 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:02.438295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db2942-1310-4873-a290-91d7442f7c1f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:02.445609 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 361/708] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Jun 15 10:22:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:02.446706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db2942-1310-4873-a290-91d7442f7c1f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:02.501995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:02.544964 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:02.557731 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4971554-1b93-4971-b187-60c8bcd649d9 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:02.583218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db2942-1310-4873-a290-91d7442f7c1f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:02.595825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcfd35-fa20-4523-a80a-63e88a58c972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:02.597029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcfd35-fa20-4523-a80a-63e88a58c972 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:02.597573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcfd35-fa20-4523-a80a-63e88a58c972 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:02.598049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcfd35-fa20-4523-a80a-63e88a58c972 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:02.606876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcfd35-fa20-4523-a80a-63e88a58c972 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:02.608600 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcfd35-fa20-4523-a80a-63e88a58c972 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:02.622120 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8738115-0cfc-4c38-b54d-433b5522af7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:02.623068 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8738115-0cfc-4c38-b54d-433b5522af7a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:02.623599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8738115-0cfc-4c38-b54d-433b5522af7a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:02.624076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8738115-0cfc-4c38-b54d-433b5522af7a None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:02.625000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8738115-0cfc-4c38-b54d-433b5522af7a None admin] RBAC: Adding query filter params (name=network) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:02.625529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8738115-0cfc-4c38-b54d-433b5522af7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-fddcfd35-fa20-4523-a80a-63e88a58c972 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:02.626447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:02.627382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:02.628406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:02.628406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:02.628406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:02.628406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:02.628406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:02.628406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:02.628406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:02.628406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:02.628406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:22:02.628406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:02.630148 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8738115-0cfc-4c38-b54d-433b5522af7a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:02.631541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 348/709] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Jun 15 10:22:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:02.633145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcfd35-fa20-4523-a80a-63e88a58c972 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:02.638470 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 362/710] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Jun 15 10:22:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:02.639420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8738115-0cfc-4c38-b54d-433b5522af7a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:02.766187 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8738115-0cfc-4c38-b54d-433b5522af7a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:02.769344 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:02.773929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcfd35-fa20-4523-a80a-63e88a58c972 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:02.803532 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ce5b7-d609-40d2-894c-89647abaa777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:02.804320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ce5b7-d609-40d2-894c-89647abaa777 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:02.805076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ce5b7-d609-40d2-894c-89647abaa777 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:02.805573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ce5b7-d609-40d2-894c-89647abaa777 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:02.806243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ce5b7-d609-40d2-894c-89647abaa777 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:02.806556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ce5b7-d609-40d2-894c-89647abaa777 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:02.808026 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ce5b7-d609-40d2-894c-89647abaa777 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:02.819106 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d36c8-6a0d-42d9-ac1f-c58607248627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:02.820142 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d36c8-6a0d-42d9-ac1f-c58607248627 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:02.820640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d36c8-6a0d-42d9-ac1f-c58607248627 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:02.821111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d36c8-6a0d-42d9-ac1f-c58607248627 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:02.822058 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d36c8-6a0d-42d9-ac1f-c58607248627 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:02.823064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d36c8-6a0d-42d9-ac1f-c58607248627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:02.824949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d36c8-6a0d-42d9-ac1f-c58607248627 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:02.826174 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 363/711] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Jun 15 10:22:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:02.827003 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ce5b7-d609-40d2-894c-89647abaa777 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:02.832889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 349/712] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Jun 15 10:22:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:02.833981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d36c8-6a0d-42d9-ac1f-c58607248627 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:02.854634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:02.960915 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ce5b7-d609-40d2-894c-89647abaa777 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:02.964314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d36c8-6a0d-42d9-ac1f-c58607248627 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:03.002626 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a2746-55ef-494d-b634-798b038411e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:03.003508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a2746-55ef-494d-b634-798b038411e1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:03.003910 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a2746-55ef-494d-b634-798b038411e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:03.004335 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a2746-55ef-494d-b634-798b038411e1 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:03.005165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a2746-55ef-494d-b634-798b038411e1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:03.005636 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a2746-55ef-494d-b634-798b038411e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:03.007147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a2746-55ef-494d-b634-798b038411e1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:03.017616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b771918-f5c6-47ad-bcd1-4bd53c652a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:03.020123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b771918-f5c6-47ad-bcd1-4bd53c652a11 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:03.020403 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b771918-f5c6-47ad-bcd1-4bd53c652a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:03.020676 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b771918-f5c6-47ad-bcd1-4bd53c652a11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:03.021755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 364/713] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Jun 15 10:22:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:03.110414 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e03e9-a58a-429c-b851-cdf087888d98 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:03.110733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e03e9-a58a-429c-b851-cdf087888d98 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:03.111014 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e03e9-a58a-429c-b851-cdf087888d98 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:03.112687 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 365/714] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:22:03.119009 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd826a6-4400-4be2-8f73-3d8f839fdf7f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:03.119353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd826a6-4400-4be2-8f73-3d8f839fdf7f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:03.119599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd826a6-4400-4be2-8f73-3d8f839fdf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:03.140669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b771918-f5c6-47ad-bcd1-4bd53c652a11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:03.142174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b771918-f5c6-47ad-bcd1-4bd53c652a11 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:03.143658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3fd826a6-4400-4be2-8f73-3d8f839fdf7f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:03.146067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3fd826a6-4400-4be2-8f73-3d8f839fdf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:03.163000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:03.173722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:03.258598 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 366/715] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:22:03.265670 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 350/716] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:22:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 10:22:03.271299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd826a6-4400-4be2-8f73-3d8f839fdf7f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:03.282199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b771918-f5c6-47ad-bcd1-4bd53c652a11 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:03.400438 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b771918-f5c6-47ad-bcd1-4bd53c652a11 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:03.405683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd826a6-4400-4be2-8f73-3d8f839fdf7f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:03.440931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:03.450044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae71f56-89d5-4bae-aa02-8d3d714a8ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:03.451061 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae71f56-89d5-4bae-aa02-8d3d714a8ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:03.451533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae71f56-89d5-4bae-aa02-8d3d714a8ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:03.451992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae71f56-89d5-4bae-aa02-8d3d714a8ca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:03.473097 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae71f56-89d5-4bae-aa02-8d3d714a8ca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:03.475576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae71f56-89d5-4bae-aa02-8d3d714a8ca6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:03.488473 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09a80d-f10b-47f5-850a-23dbaf6a7d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:03.489547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09a80d-f10b-47f5-850a-23dbaf6a7d8f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:03.490002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09a80d-f10b-47f5-850a-23dbaf6a7d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:03.490428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09a80d-f10b-47f5-850a-23dbaf6a7d8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:03.503412 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09a80d-f10b-47f5-850a-23dbaf6a7d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-bae71f56-89d5-4bae-aa02-8d3d714a8ca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:03.504173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:03.505087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:03.506044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:03.506044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:03.506044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:03.506044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:03.506044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 367/717] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:03.512472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae71f56-89d5-4bae-aa02-8d3d714a8ca6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-7c09a80d-f10b-47f5-850a-23dbaf6a7d8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:03.515658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:03.516628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:03.517575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:03.517575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:03.517575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:03.517575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:03.517575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:03.517575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:03.517575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:03.517575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:03.517575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:03.517575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:03.517575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:22:03.517575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:03.520391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 351/718] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:22:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:03.528303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09a80d-f10b-47f5-850a-23dbaf6a7d8f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:03.531831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:03.670016 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae71f56-89d5-4bae-aa02-8d3d714a8ca6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:03.706401 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a629c1-b94c-4684-ad9e-6caa2ccf6053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:03.707365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a629c1-b94c-4684-ad9e-6caa2ccf6053 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:03.707695 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a629c1-b94c-4684-ad9e-6caa2ccf6053 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:03.707968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a629c1-b94c-4684-ad9e-6caa2ccf6053 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:03.708698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a629c1-b94c-4684-ad9e-6caa2ccf6053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:03.709003 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a629c1-b94c-4684-ad9e-6caa2ccf6053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:03.710373 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a629c1-b94c-4684-ad9e-6caa2ccf6053 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:03.727566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 368/719] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:03.728799 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a629c1-b94c-4684-ad9e-6caa2ccf6053 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:03.745576 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09a80d-f10b-47f5-850a-23dbaf6a7d8f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:03.816265 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723ba76-7b0b-454e-9e99-3df58c750ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:03.816869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723ba76-7b0b-454e-9e99-3df58c750ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:03.817151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723ba76-7b0b-454e-9e99-3df58c750ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:03.817425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723ba76-7b0b-454e-9e99-3df58c750ec4 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:03.818181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723ba76-7b0b-454e-9e99-3df58c750ec4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:03.818487 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723ba76-7b0b-454e-9e99-3df58c750ec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:03.820425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723ba76-7b0b-454e-9e99-3df58c750ec4 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:03.831961 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:03.833147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 352/720] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:22:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:03.839844 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723ba76-7b0b-454e-9e99-3df58c750ec4 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:03.842457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a629c1-b94c-4684-ad9e-6caa2ccf6053 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:03.881514 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ce310-772c-464a-959c-e3a841d08b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:03.882375 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ce310-772c-464a-959c-e3a841d08b13 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:03.882657 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ce310-772c-464a-959c-e3a841d08b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:03.882929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ce310-772c-464a-959c-e3a841d08b13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:03.899817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ce310-772c-464a-959c-e3a841d08b13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:03.902431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ce310-772c-464a-959c-e3a841d08b13 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:03.916136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-e97ce310-772c-464a-959c-e3a841d08b13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:03.931854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:03.932833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:03.933784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:03.933784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:03.933784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:03.933784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:03.933784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:03.933784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:03.933784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:03.933784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:03.933784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 369/721] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:03.938767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ce310-772c-464a-959c-e3a841d08b13 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:03.999126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723ba76-7b0b-454e-9e99-3df58c750ec4 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:04.038024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646b13b-50c7-4f6b-a197-93aed7d2af4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:04.039825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646b13b-50c7-4f6b-a197-93aed7d2af4d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:04.040515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646b13b-50c7-4f6b-a197-93aed7d2af4d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:04.040998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646b13b-50c7-4f6b-a197-93aed7d2af4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:04.056523 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646b13b-50c7-4f6b-a197-93aed7d2af4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:04.057381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646b13b-50c7-4f6b-a197-93aed7d2af4d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-e646b13b-50c7-4f6b-a197-93aed7d2af4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:04.086792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:04.087856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:04.088824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:04.088824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:04.088824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:04.088824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:04.103164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 353/722] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:04.112622 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646b13b-50c7-4f6b-a197-93aed7d2af4d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:04.170742 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ce310-772c-464a-959c-e3a841d08b13 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:04.200387 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:04.209904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07f055-1e1e-4ce2-adce-654666d025c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:04.210597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f055-1e1e-4ce2-adce-654666d025c1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:04.210882 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f055-1e1e-4ce2-adce-654666d025c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:04.211153 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f055-1e1e-4ce2-adce-654666d025c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:04.212001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07f055-1e1e-4ce2-adce-654666d025c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:04.212311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07f055-1e1e-4ce2-adce-654666d025c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:04.213739 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07f055-1e1e-4ce2-adce-654666d025c1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:04.227309 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 370/723] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:04.228665 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c46668-fcce-404d-a515-4236458470e7 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:04.228951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c46668-fcce-404d-a515-4236458470e7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:04.229225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c46668-fcce-404d-a515-4236458470e7 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:04.230784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 371/724] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:04.236598 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c46668-fcce-404d-a515-4236458470e7 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:04.260076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:04.267794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646b13b-50c7-4f6b-a197-93aed7d2af4d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:04.311625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7df192-0c46-4ad8-af9f-66005b2e0b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:04.312382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7df192-0c46-4ad8-af9f-66005b2e0b5e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:04.312726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7df192-0c46-4ad8-af9f-66005b2e0b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:04.313217 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7df192-0c46-4ad8-af9f-66005b2e0b5e None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:04.314018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7df192-0c46-4ad8-af9f-66005b2e0b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:04.314396 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7df192-0c46-4ad8-af9f-66005b2e0b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:04.316612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7df192-0c46-4ad8-af9f-66005b2e0b5e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:04.331637 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 354/725] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:04.333252 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0022c-874d-41e2-930f-4e6979bd7487 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:04.333596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0022c-874d-41e2-930f-4e6979bd7487 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:04.334096 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0022c-874d-41e2-930f-4e6979bd7487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:04.352010 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c46668-fcce-404d-a515-4236458470e7 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:04.354089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-b0c0022c-874d-41e2-930f-4e6979bd7487 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:04.356101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b0c0022c-874d-41e2-930f-4e6979bd7487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:04.394282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ba5f6-8fa3-44bd-b024-c301fbb1f146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:04.395016 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ba5f6-8fa3-44bd-b024-c301fbb1f146 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:04.395424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ba5f6-8fa3-44bd-b024-c301fbb1f146 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:04.395730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ba5f6-8fa3-44bd-b024-c301fbb1f146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:04.396628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ba5f6-8fa3-44bd-b024-c301fbb1f146 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=81e9805ec4c44cedb658b7becf768369) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:04.397020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ba5f6-8fa3-44bd-b024-c301fbb1f146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:04.399366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ba5f6-8fa3-44bd-b024-c301fbb1f146 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:04.411664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 372/726] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:22:04 2022] GET /identity/v3/role_assignments?user.id=81e9805ec4c44cedb658b7becf768369&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=e1a2021d08e14daa969362b3d23face3 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:04.413313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ba5f6-8fa3-44bd-b024-c301fbb1f146 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:04.437492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 355/727] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:22:04.505109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:04.521595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0022c-874d-41e2-930f-4e6979bd7487 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:04.562904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ba5f6-8fa3-44bd-b024-c301fbb1f146 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:04.598047 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae35c9-4a31-4e27-ada8-7cffcf7d2962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:04.598857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae35c9-4a31-4e27-ada8-7cffcf7d2962 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:04.599137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae35c9-4a31-4e27-ada8-7cffcf7d2962 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:04.599406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae35c9-4a31-4e27-ada8-7cffcf7d2962 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:04.610682 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae35c9-4a31-4e27-ada8-7cffcf7d2962 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:04.612134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae35c9-4a31-4e27-ada8-7cffcf7d2962 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-aaae35c9-4a31-4e27-ada8-7cffcf7d2962 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:04.628475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:04.629730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:04.630968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:04.630968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:04.630968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:04.630968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:04.630968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:04.630968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:04.630968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:04.630968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:04.630968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 10:22:04.630968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:04.632235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 373/728] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Jun 15 10:22:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:04.644561 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae35c9-4a31-4e27-ada8-7cffcf7d2962 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:04.666633 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:04.695284 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0022c-874d-41e2-930f-4e6979bd7487 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:04.734508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d19c9-a370-4138-9dcd-4f80c7c8bf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:04.735797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d19c9-a370-4138-9dcd-4f80c7c8bf4e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:04.738229 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d19c9-a370-4138-9dcd-4f80c7c8bf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:04.738704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d19c9-a370-4138-9dcd-4f80c7c8bf4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:04.756474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d19c9-a370-4138-9dcd-4f80c7c8bf4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-c66d19c9-a370-4138-9dcd-4f80c7c8bf4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:04.769039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:04.770073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:04.770996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:04.770996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:04.770996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:04.770996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:04.770996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:04.770996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:04.770996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:04.770996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:04.770996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:04.770996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:04.770996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:04.770996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:04.775027 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 356/729] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:22:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:04.782086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d19c9-a370-4138-9dcd-4f80c7c8bf4e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:04.833429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae35c9-4a31-4e27-ada8-7cffcf7d2962 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:04.863897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:04.896715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62aa378-9f28-478b-ab6b-3375b5a9fd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:04.897378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa378-9f28-478b-ab6b-3375b5a9fd8c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:04.897661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa378-9f28-478b-ab6b-3375b5a9fd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:04.898475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62aa378-9f28-478b-ab6b-3375b5a9fd8c None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:04.899317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62aa378-9f28-478b-ab6b-3375b5a9fd8c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:04.899648 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62aa378-9f28-478b-ab6b-3375b5a9fd8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:04.901069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62aa378-9f28-478b-ab6b-3375b5a9fd8c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:04.925143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 374/730] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Jun 15 10:22:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:04.930617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62aa378-9f28-478b-ab6b-3375b5a9fd8c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:04.974308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d19c9-a370-4138-9dcd-4f80c7c8bf4e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:05.052708 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b7940-c878-4cdb-b7ff-cc7b141aa4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:05.053371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b7940-c878-4cdb-b7ff-cc7b141aa4ee None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:05.053650 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b7940-c878-4cdb-b7ff-cc7b141aa4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:05.053921 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b7940-c878-4cdb-b7ff-cc7b141aa4ee None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:05.054705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b7940-c878-4cdb-b7ff-cc7b141aa4ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:05.055009 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b7940-c878-4cdb-b7ff-cc7b141aa4ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:05.056410 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b7940-c878-4cdb-b7ff-cc7b141aa4ee None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:05.074807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:05.082658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 357/731] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:22:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:05.085535 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62aa378-9f28-478b-ab6b-3375b5a9fd8c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:05.088747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b7940-c878-4cdb-b7ff-cc7b141aa4ee None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:05.158861 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6ac20-ef84-4836-8e3b-6bb3766b6110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:05.159429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6ac20-ef84-4836-8e3b-6bb3766b6110 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:05.159737 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6ac20-ef84-4836-8e3b-6bb3766b6110 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:05.160012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6ac20-ef84-4836-8e3b-6bb3766b6110 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:05.237223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:05.270393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b7940-c878-4cdb-b7ff-cc7b141aa4ee None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:05.305466 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6ac20-ef84-4836-8e3b-6bb3766b6110 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:05.306993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6ac20-ef84-4836-8e3b-6bb3766b6110 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:05.339789 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50b282-c993-40e6-b6b4-65337d79e464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:05.340895 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50b282-c993-40e6-b6b4-65337d79e464 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:05.341180 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50b282-c993-40e6-b6b4-65337d79e464 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:05.341457 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50b282-c993-40e6-b6b4-65337d79e464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:05.354850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50b282-c993-40e6-b6b4-65337d79e464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:05.356343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50b282-c993-40e6-b6b4-65337d79e464 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-ae50b282-c993-40e6-b6b4-65337d79e464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:05.380437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:05.381569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:05.382663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:05.382663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:05.382663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:05.382663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:05.382663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 358/732] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:05.384060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12372df-ec54-4f1f-aa2e-1360a8f36512 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:05.386492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12372df-ec54-4f1f-aa2e-1360a8f36512 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:05.386492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12372df-ec54-4f1f-aa2e-1360a8f36512 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:05.390298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 359/733] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:05.391699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772beecc-9f2c-4971-bc08-317eceac0033 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:05.391979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772beecc-9f2c-4971-bc08-317eceac0033 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:05.392259 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772beecc-9f2c-4971-bc08-317eceac0033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:05.419257 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-772beecc-9f2c-4971-bc08-317eceac0033 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:05.421103 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-772beecc-9f2c-4971-bc08-317eceac0033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:05.435736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 375/734] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:22:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 10:22:05.436962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6ac20-ef84-4836-8e3b-6bb3766b6110 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:05.482759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:05.511555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 360/735] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:22:05.512430 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772beecc-9f2c-4971-bc08-317eceac0033 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:05.537802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:05.577038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6ac20-ef84-4836-8e3b-6bb3766b6110 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:05.630476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef089a9-31bf-492b-b34d-64987ff22da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:05.631561 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef089a9-31bf-492b-b34d-64987ff22da0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:05.631891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef089a9-31bf-492b-b34d-64987ff22da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:05.632172 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef089a9-31bf-492b-b34d-64987ff22da0 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:05.632988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef089a9-31bf-492b-b34d-64987ff22da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:05.633301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef089a9-31bf-492b-b34d-64987ff22da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:05.634764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef089a9-31bf-492b-b34d-64987ff22da0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:05.654110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 376/736] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:05.654110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef089a9-31bf-492b-b34d-64987ff22da0 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:05.667355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772beecc-9f2c-4971-bc08-317eceac0033 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:05.705953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33014882-9994-46d3-b945-1b8c9a6bc9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:05.706856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33014882-9994-46d3-b945-1b8c9a6bc9dc None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:05.707236 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33014882-9994-46d3-b945-1b8c9a6bc9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:05.707601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33014882-9994-46d3-b945-1b8c9a6bc9dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:05.718569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33014882-9994-46d3-b945-1b8c9a6bc9dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:05.720094 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33014882-9994-46d3-b945-1b8c9a6bc9dc None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-33014882-9994-46d3-b945-1b8c9a6bc9dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:05.738751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:05.739756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:05.740717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:05.740717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:05.740717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:05.740717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:05.740717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 361/737] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:05.741924 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33014882-9994-46d3-b945-1b8c9a6bc9dc None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:05.767627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef089a9-31bf-492b-b34d-64987ff22da0 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:05.778780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:05.799433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:05.806209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ec744-2adc-4bd7-b657-3b18ab541156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:05.806870 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ec744-2adc-4bd7-b657-3b18ab541156 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:05.807157 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ec744-2adc-4bd7-b657-3b18ab541156 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:05.807419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ec744-2adc-4bd7-b657-3b18ab541156 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:05.808160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ec744-2adc-4bd7-b657-3b18ab541156 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:05.809587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ec744-2adc-4bd7-b657-3b18ab541156 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:05.825629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 377/738] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Jun 15 10:22:05 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:22:05.827321 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bb316-4f8e-454f-97d4-ab3692b72c3f None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:05.827649 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bb316-4f8e-454f-97d4-ab3692b72c3f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:05.827928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bb316-4f8e-454f-97d4-ab3692b72c3f None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:05.833829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 378/739] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:05.833829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bb316-4f8e-454f-97d4-ab3692b72c3f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:05.868175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33014882-9994-46d3-b945-1b8c9a6bc9dc None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:05.914530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691fba6-e763-4d9c-af3d-7922059a4c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:05.915537 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691fba6-e763-4d9c-af3d-7922059a4c4d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:05.915824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691fba6-e763-4d9c-af3d-7922059a4c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:05.916224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691fba6-e763-4d9c-af3d-7922059a4c4d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:05.925117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691fba6-e763-4d9c-af3d-7922059a4c4d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:05.926608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691fba6-e763-4d9c-af3d-7922059a4c4d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-8691fba6-e763-4d9c-af3d-7922059a4c4d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:05.943992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:05.945623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:05.946615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:05.946615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:05.946615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:05.946615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:05.946615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:05.946615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:05.946615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:05.946615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:05.946615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 10:22:05.946615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:05.950654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 362/740] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:22:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:05.952161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c096d-580e-4fb0-a704-c00e76ddaa05 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:05.952447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c096d-580e-4fb0-a704-c00e76ddaa05 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:05.952723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c096d-580e-4fb0-a704-c00e76ddaa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:05.975373 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-525c096d-580e-4fb0-a704-c00e76ddaa05 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:05.976982 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-525c096d-580e-4fb0-a704-c00e76ddaa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:05.998338 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bb316-4f8e-454f-97d4-ab3692b72c3f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:06.045843 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dead3-3a6b-41bd-a894-d7bffcfd5ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:06.046505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dead3-3a6b-41bd-a894-d7bffcfd5ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:06.046789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dead3-3a6b-41bd-a894-d7bffcfd5ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:06.047065 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dead3-3a6b-41bd-a894-d7bffcfd5ac8 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:06.047831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dead3-3a6b-41bd-a894-d7bffcfd5ac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:06.048140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dead3-3a6b-41bd-a894-d7bffcfd5ac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:06.049582 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dead3-3a6b-41bd-a894-d7bffcfd5ac8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:06.062642 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 379/741] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:06.063962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dead3-3a6b-41bd-a894-d7bffcfd5ac8 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:06.073872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 363/742] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 10:22:06.074641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c096d-580e-4fb0-a704-c00e76ddaa05 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:06.098041 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:06.131636 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:06.186452 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dead3-3a6b-41bd-a894-d7bffcfd5ac8 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:06.191862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c096d-580e-4fb0-a704-c00e76ddaa05 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:06.229699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c42d5-b5a8-443d-8d39-4c3793a33d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:06.231069 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c42d5-b5a8-443d-8d39-4c3793a33d30 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:06.231435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c42d5-b5a8-443d-8d39-4c3793a33d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:06.232046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c42d5-b5a8-443d-8d39-4c3793a33d30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:06.236448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa2899-6e64-46ea-8774-adc572198b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:06.237339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa2899-6e64-46ea-8774-adc572198b13 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:06.237794 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa2899-6e64-46ea-8774-adc572198b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:06.238243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa2899-6e64-46ea-8774-adc572198b13 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:06.239565 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa2899-6e64-46ea-8774-adc572198b13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:06.239861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c42d5-b5a8-443d-8d39-4c3793a33d30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:06.240264 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa2899-6e64-46ea-8774-adc572198b13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:06.241432 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c42d5-b5a8-443d-8d39-4c3793a33d30 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:06.242983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa2899-6e64-46ea-8774-adc572198b13 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-298c42d5-b5a8-443d-8d39-4c3793a33d30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:06.260310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:06.261315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:06.262248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:06.262248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:06.262248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:06.262248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:06.262248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:06.262248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:06.262248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:06.262248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:06.263541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 364/743] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:06.264530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c42d5-b5a8-443d-8d39-4c3793a33d30 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:06.269688 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 380/744] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Jun 15 10:22:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:06.270753 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa2899-6e64-46ea-8774-adc572198b13 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:06.366466 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:06.390172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c42d5-b5a8-443d-8d39-4c3793a33d30 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:06.397878 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa2899-6e64-46ea-8774-adc572198b13 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:06.407707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:06.432824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb55a4-6e94-402a-8074-66c210b85b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:06.433476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb55a4-6e94-402a-8074-66c210b85b9f None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:06.433790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb55a4-6e94-402a-8074-66c210b85b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:06.434031 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb55a4-6e94-402a-8074-66c210b85b9f None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:06.435017 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb55a4-6e94-402a-8074-66c210b85b9f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:06.436283 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701c141-41ca-4c96-b9f7-aeb2e06a1fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:06.436507 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb55a4-6e94-402a-8074-66c210b85b9f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:06.437330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701c141-41ca-4c96-b9f7-aeb2e06a1fde None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:06.437799 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701c141-41ca-4c96-b9f7-aeb2e06a1fde None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:06.438327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701c141-41ca-4c96-b9f7-aeb2e06a1fde None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:06.439572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701c141-41ca-4c96-b9f7-aeb2e06a1fde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:06.440061 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701c141-41ca-4c96-b9f7-aeb2e06a1fde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:06.442359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701c141-41ca-4c96-b9f7-aeb2e06a1fde None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:06.459593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 365/745] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Jun 15 10:22:06 2022] POST /identity/v3/services => generated 240 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:22:06.459593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb55a4-6e94-402a-8074-66c210b85b9f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:06.459885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 381/746] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:06.464254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701c141-41ca-4c96-b9f7-aeb2e06a1fde None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:06.650513 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701c141-41ca-4c96-b9f7-aeb2e06a1fde None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:06.677015 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb55a4-6e94-402a-8074-66c210b85b9f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:06.702273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16823614-8c2b-45a9-9959-f9e7f3108583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:06.702849 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16823614-8c2b-45a9-9959-f9e7f3108583 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:06.703129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16823614-8c2b-45a9-9959-f9e7f3108583 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:06.703402 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16823614-8c2b-45a9-9959-f9e7f3108583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:06.704258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16823614-8c2b-45a9-9959-f9e7f3108583 None admin] RBAC: Adding query filter params (role.id=f6ffe6f612824e50a23f0b06a16a1f91, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=d44268b4ab154bea8c958be5f3e30714) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:06.704568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16823614-8c2b-45a9-9959-f9e7f3108583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:06.706039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16823614-8c2b-45a9-9959-f9e7f3108583 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:06.713263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 382/747] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:22:06 2022] GET /identity/v3/role_assignments?user.id=d44268b4ab154bea8c958be5f3e30714&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=f6ffe6f612824e50a23f0b06a16a1f91 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:06.728063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9877c9-0cdc-4538-8525-81453d628b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:06.729142 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9877c9-0cdc-4538-8525-81453d628b9f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:06.729625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9877c9-0cdc-4538-8525-81453d628b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:06.730101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9877c9-0cdc-4538-8525-81453d628b9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:06.734741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:06.815291 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9877c9-0cdc-4538-8525-81453d628b9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:06.817880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9877c9-0cdc-4538-8525-81453d628b9f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:06.850040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade00a7-e8d4-4cf0-be75-29ec86153c7e None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:06.850572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade00a7-e8d4-4cf0-be75-29ec86153c7e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:06.850572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade00a7-e8d4-4cf0-be75-29ec86153c7e None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:06.852838 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 383/748] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:06.858664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1ddc2-02e2-474c-9932-3f323cf11d30 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:06.858993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1ddc2-02e2-474c-9932-3f323cf11d30 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:06.859228 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1ddc2-02e2-474c-9932-3f323cf11d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:06.879316 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-28e1ddc2-02e2-474c-9932-3f323cf11d30 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:06.880609 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-28e1ddc2-02e2-474c-9932-3f323cf11d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:06.910148 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:06.945334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 366/749] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:22:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:22:06.951006 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9877c9-0cdc-4538-8525-81453d628b9f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:06.965439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 384/750] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:06.988232 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1ddc2-02e2-474c-9932-3f323cf11d30 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:06.997521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:07.114827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9877c9-0cdc-4538-8525-81453d628b9f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:07.187400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804921c8-d3a5-42d4-9ddf-387775ec94ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:07.188214 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804921c8-d3a5-42d4-9ddf-387775ec94ca None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:07.188496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804921c8-d3a5-42d4-9ddf-387775ec94ca None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:07.188770 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804921c8-d3a5-42d4-9ddf-387775ec94ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:07.194861 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1ddc2-02e2-474c-9932-3f323cf11d30 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:07.211679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804921c8-d3a5-42d4-9ddf-387775ec94ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:07.213139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804921c8-d3a5-42d4-9ddf-387775ec94ca None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-804921c8-d3a5-42d4-9ddf-387775ec94ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:07.236842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:07.237795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:07.239298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:07.239298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:07.239298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:07.239298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:07.239298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 367/751] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:07.245910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804921c8-d3a5-42d4-9ddf-387775ec94ca None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:07.263919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bed86-ca25-472d-a2d4-b309b6241eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:07.264711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bed86-ca25-472d-a2d4-b309b6241eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:07.264990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bed86-ca25-472d-a2d4-b309b6241eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:07.265262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bed86-ca25-472d-a2d4-b309b6241eb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:07.281121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bed86-ca25-472d-a2d4-b309b6241eb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-ac3bed86-ca25-472d-a2d4-b309b6241eb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:07.296885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:07.298783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:07.300368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:07.300368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:07.300368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:07.300368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:07.300368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:07.300368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:07.300368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:07.300368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:07.300368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:07.300368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:07.300368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:07.300368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:07.300368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 385/752] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:22:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:07.312467 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bed86-ca25-472d-a2d4-b309b6241eb0 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:07.354037 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:07.392613 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:07.422258 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804921c8-d3a5-42d4-9ddf-387775ec94ca None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:07.437561 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bed86-ca25-472d-a2d4-b309b6241eb0 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:07.489170 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea4641-f133-475a-9136-f4aa14c84c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:07.489754 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea4641-f133-475a-9136-f4aa14c84c62 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:07.490037 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea4641-f133-475a-9136-f4aa14c84c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:07.490313 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea4641-f133-475a-9136-f4aa14c84c62 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:07.491044 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea4641-f133-475a-9136-f4aa14c84c62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:07.491346 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea4641-f133-475a-9136-f4aa14c84c62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:07.493042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebea4641-f133-475a-9136-f4aa14c84c62 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:07.495142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae52e7-ca7a-43a9-b967-0a27680fee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:07.495830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae52e7-ca7a-43a9-b967-0a27680fee70 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:07.496108 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae52e7-ca7a-43a9-b967-0a27680fee70 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:07.496378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae52e7-ca7a-43a9-b967-0a27680fee70 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:07.497130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae52e7-ca7a-43a9-b967-0a27680fee70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:07.497434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae52e7-ca7a-43a9-b967-0a27680fee70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:07.498788 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae52e7-ca7a-43a9-b967-0a27680fee70 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:07.516400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 386/753] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:22:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:07.522359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae52e7-ca7a-43a9-b967-0a27680fee70 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:07.527501 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 368/754] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:07.532579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea4641-f133-475a-9136-f4aa14c84c62 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:07.613547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:07.631305 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae52e7-ca7a-43a9-b967-0a27680fee70 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:07.666087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e71ad8-4240-403f-acf8-11600abc4cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:07.666885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e71ad8-4240-403f-acf8-11600abc4cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:07.667171 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e71ad8-4240-403f-acf8-11600abc4cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:07.667454 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e71ad8-4240-403f-acf8-11600abc4cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:07.678818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e71ad8-4240-403f-acf8-11600abc4cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:07.680960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e71ad8-4240-403f-acf8-11600abc4cd5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-47e71ad8-4240-403f-acf8-11600abc4cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:07.698951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:07.701102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:07.703296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:07.703296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:07.703296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:07.703296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:07.703296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 387/755] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:07.705923 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e71ad8-4240-403f-acf8-11600abc4cd5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:07.806480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e71ad8-4240-403f-acf8-11600abc4cd5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:07.842010 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c00f9-c162-43c3-a74b-d6aaedca3899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:07.842857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c00f9-c162-43c3-a74b-d6aaedca3899 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:07.843142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c00f9-c162-43c3-a74b-d6aaedca3899 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:07.843419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c00f9-c162-43c3-a74b-d6aaedca3899 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:07.844170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c00f9-c162-43c3-a74b-d6aaedca3899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:07.844469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c00f9-c162-43c3-a74b-d6aaedca3899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:07.845833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c00f9-c162-43c3-a74b-d6aaedca3899 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:07.848550 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:07.859151 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 388/756] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:07.864384 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c00f9-c162-43c3-a74b-d6aaedca3899 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:07.887152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea4641-f133-475a-9136-f4aa14c84c62 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:07.963391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dad72-e8a9-4f34-be4f-4d226720c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:07.964214 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dad72-e8a9-4f34-be4f-4d226720c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:07.964498 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dad72-e8a9-4f34-be4f-4d226720c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:07.964793 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dad72-e8a9-4f34-be4f-4d226720c9a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:07.983307 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6dad72-e8a9-4f34-be4f-4d226720c9a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:07.984822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6dad72-e8a9-4f34-be4f-4d226720c9a3 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-0a6dad72-e8a9-4f34-be4f-4d226720c9a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:08.018192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:08.019233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:08.021350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:08.021350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:08.021350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:08.021350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:08.021350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:08.021350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:08.021350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:08.021350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:08.021350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 369/757] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 487 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:08.025796 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dad72-e8a9-4f34-be4f-4d226720c9a3 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:08.056654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:08.161868 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c00f9-c162-43c3-a74b-d6aaedca3899 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:08.216489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dad72-e8a9-4f34-be4f-4d226720c9a3 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:08.226772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2778013-b026-4015-a917-9d0c8a23baac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:08.227582 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2778013-b026-4015-a917-9d0c8a23baac None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:08.227865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2778013-b026-4015-a917-9d0c8a23baac None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:08.228134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2778013-b026-4015-a917-9d0c8a23baac None admin] PATH_INFO: `/v3/users/nova` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:08.239753 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2778013-b026-4015-a917-9d0c8a23baac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:08.243634 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2778013-b026-4015-a917-9d0c8a23baac None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-b2778013-b026-4015-a917-9d0c8a23baac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:08.264249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:08.265250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:08.266221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:08.266221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:08.266221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:08.266221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:08.266221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:08.266221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:08.266221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:08.266221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:08.266221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:22:08.266221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:08.267930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 389/758] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Jun 15 10:22:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:08.274556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2778013-b026-4015-a917-9d0c8a23baac None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:08.279774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3cf98-c81f-40f8-b7c1-13cb73349f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:08.280438 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3cf98-c81f-40f8-b7c1-13cb73349f58 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:08.280718 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3cf98-c81f-40f8-b7c1-13cb73349f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:08.280994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3cf98-c81f-40f8-b7c1-13cb73349f58 None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:08.281783 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3cf98-c81f-40f8-b7c1-13cb73349f58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:08.282090 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3cf98-c81f-40f8-b7c1-13cb73349f58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:08.283542 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3cf98-c81f-40f8-b7c1-13cb73349f58 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:08.303949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 370/759] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:08.312366 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3cf98-c81f-40f8-b7c1-13cb73349f58 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:08.385348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:08.430253 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:08.449139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2778013-b026-4015-a917-9d0c8a23baac None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:08.473731 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3cf98-c81f-40f8-b7c1-13cb73349f58 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:08.486539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0de4e-1d56-4a0d-bb7a-d2c1709b9b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:08.487374 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0de4e-1d56-4a0d-bb7a-d2c1709b9b4b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:08.487751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0de4e-1d56-4a0d-bb7a-d2c1709b9b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:08.488032 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0de4e-1d56-4a0d-bb7a-d2c1709b9b4b None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:08.488869 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0de4e-1d56-4a0d-bb7a-d2c1709b9b4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:08.489175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0de4e-1d56-4a0d-bb7a-d2c1709b9b4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:08.490842 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0de4e-1d56-4a0d-bb7a-d2c1709b9b4b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:08.513977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 390/760] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Jun 15 10:22:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:08.515366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7e73-8ad0-492a-94c3-60df24aae7a3 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:08.515570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63acfe-44e4-442b-a869-3dad38687ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:08.515790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7e73-8ad0-492a-94c3-60df24aae7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:08.516045 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b7e73-8ad0-492a-94c3-60df24aae7a3 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:08.516668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63acfe-44e4-442b-a869-3dad38687ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:08.517265 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63acfe-44e4-442b-a869-3dad38687ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:08.517592 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 391/761] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:08.517709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63acfe-44e4-442b-a869-3dad38687ca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:08.518283 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7e73-8ad0-492a-94c3-60df24aae7a3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:08.518816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63acfe-44e4-442b-a869-3dad38687ca2 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=7673b1c4f6184570b0039f9285bf1286) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:08.519132 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63acfe-44e4-442b-a869-3dad38687ca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:08.520609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63acfe-44e4-442b-a869-3dad38687ca2 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:08.528863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 371/762] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:22:08 2022] GET /identity/v3/role_assignments?user.id=7673b1c4f6184570b0039f9285bf1286&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=e1a2021d08e14daa969362b3d23face3 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:08.536886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9c7f-c2a9-4d03-8e34-9093c336a0ff None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:08.537198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9c7f-c2a9-4d03-8e34-9093c336a0ff None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:08.539436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d9c7f-c2a9-4d03-8e34-9093c336a0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:08.570930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-a44d9c7f-c2a9-4d03-8e34-9093c336a0ff None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:08.572105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a44d9c7f-c2a9-4d03-8e34-9093c336a0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:08.720469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b7e73-8ad0-492a-94c3-60df24aae7a3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:08.725058 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 372/763] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:08.744262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:08.759328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946f893-f362-45da-8cc2-1ccf89017395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:08.760180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946f893-f362-45da-8cc2-1ccf89017395 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:08.760497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946f893-f362-45da-8cc2-1ccf89017395 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:08.760782 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946f893-f362-45da-8cc2-1ccf89017395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:08.762026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d9c7f-c2a9-4d03-8e34-9093c336a0ff None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:08.776531 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946f893-f362-45da-8cc2-1ccf89017395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:08.778360 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946f893-f362-45da-8cc2-1ccf89017395 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-4946f893-f362-45da-8cc2-1ccf89017395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:08.798126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:08.799093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:08.800076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:08.800076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:08.800076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:08.800076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:08.802321 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 392/764] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:08.809185 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946f893-f362-45da-8cc2-1ccf89017395 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:08.857573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:08.907426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d9c7f-c2a9-4d03-8e34-9093c336a0ff None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:08.983978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d025ef-cefb-4fe0-82b5-50a323b379b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:08.985190 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d025ef-cefb-4fe0-82b5-50a323b379b0 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:08.985724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d025ef-cefb-4fe0-82b5-50a323b379b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:08.986198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d025ef-cefb-4fe0-82b5-50a323b379b0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:08.987079 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d025ef-cefb-4fe0-82b5-50a323b379b0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:08.989759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d025ef-cefb-4fe0-82b5-50a323b379b0 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-63d025ef-cefb-4fe0-82b5-50a323b379b0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:09.023660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:09.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:09.025607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 373/765] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Jun 15 10:22:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:09.032934 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946f893-f362-45da-8cc2-1ccf89017395 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:09.033396 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d025ef-cefb-4fe0-82b5-50a323b379b0 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:09.070380 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe66b09-a4ee-4e13-bf47-cd50a7e6832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:09.071411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66b09-a4ee-4e13-bf47-cd50a7e6832e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:09.071924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66b09-a4ee-4e13-bf47-cd50a7e6832e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:09.072410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66b09-a4ee-4e13-bf47-cd50a7e6832e None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:09.073237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe66b09-a4ee-4e13-bf47-cd50a7e6832e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:09.073668 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe66b09-a4ee-4e13-bf47-cd50a7e6832e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:09.075183 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe66b09-a4ee-4e13-bf47-cd50a7e6832e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:09.088446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 393/766] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:09.090051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99396eb-91c6-4f38-b22a-ac0ba864586f None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:09.090449 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99396eb-91c6-4f38-b22a-ac0ba864586f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:09.090796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99396eb-91c6-4f38-b22a-ac0ba864586f None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:09.095521 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 394/767] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:09.095521 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99396eb-91c6-4f38-b22a-ac0ba864586f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:09.134157 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:09.183402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d025ef-cefb-4fe0-82b5-50a323b379b0 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:09.213810 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:09.222850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c535bb-7cd2-4da7-9f87-c2231c2cb282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:09.223538 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c535bb-7cd2-4da7-9f87-c2231c2cb282 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:09.223877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c535bb-7cd2-4da7-9f87-c2231c2cb282 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:09.224098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c535bb-7cd2-4da7-9f87-c2231c2cb282 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:09.224800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c535bb-7cd2-4da7-9f87-c2231c2cb282 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:09.224990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99396eb-91c6-4f38-b22a-ac0ba864586f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:09.225093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c535bb-7cd2-4da7-9f87-c2231c2cb282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:09.226499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c535bb-7cd2-4da7-9f87-c2231c2cb282 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:09.231871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 374/768] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Jun 15 10:22:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:09.232863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680f2f9-007c-460e-80be-b5b90675cf3e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:09.233152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680f2f9-007c-460e-80be-b5b90675cf3e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:09.233430 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680f2f9-007c-460e-80be-b5b90675cf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:09.250496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-e680f2f9-007c-460e-80be-b5b90675cf3e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:09.251710 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-e680f2f9-007c-460e-80be-b5b90675cf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:09.262221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae57f6-eed2-4c71-91dd-d23c377dadf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:09.263007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae57f6-eed2-4c71-91dd-d23c377dadf8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:09.263284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae57f6-eed2-4c71-91dd-d23c377dadf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:09.263583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae57f6-eed2-4c71-91dd-d23c377dadf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:09.270662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae57f6-eed2-4c71-91dd-d23c377dadf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:09.272111 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae57f6-eed2-4c71-91dd-d23c377dadf8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-b3ae57f6-eed2-4c71-91dd-d23c377dadf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:09.285884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:09.286795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:09.288341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:09.288341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:09.288341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:09.288341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:09.288341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:09.288341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:09.288341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:09.288341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:09.288341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 395/769] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:09.288874 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa79503-4a2b-4fd5-8abf-ee69959cfca6 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:09.288874 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa79503-4a2b-4fd5-8abf-ee69959cfca6 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:09.289210 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa79503-4a2b-4fd5-8abf-ee69959cfca6 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:09.290496 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 396/770] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:09.291001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa79503-4a2b-4fd5-8abf-ee69959cfca6 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:09.336451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 375/771] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:09.336451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680f2f9-007c-460e-80be-b5b90675cf3e None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:09.388727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:09.406850 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa79503-4a2b-4fd5-8abf-ee69959cfca6 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:09.439893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680f2f9-007c-460e-80be-b5b90675cf3e None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:09.446178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af9fbb-e72f-4396-858c-4bfbfdec3727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:09.446832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af9fbb-e72f-4396-858c-4bfbfdec3727 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:09.447113 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af9fbb-e72f-4396-858c-4bfbfdec3727 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:09.447386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af9fbb-e72f-4396-858c-4bfbfdec3727 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:09.448117 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af9fbb-e72f-4396-858c-4bfbfdec3727 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:09.448429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af9fbb-e72f-4396-858c-4bfbfdec3727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:09.449787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af9fbb-e72f-4396-858c-4bfbfdec3727 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:09.455205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 397/772] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Jun 15 10:22:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:09.456227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840f749-5135-482f-8726-140b398a90fc None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:09.456514 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840f749-5135-482f-8726-140b398a90fc None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:09.456783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840f749-5135-482f-8726-140b398a90fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:09.468006 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:09.473329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8840f749-5135-482f-8726-140b398a90fc None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:09.474543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8840f749-5135-482f-8726-140b398a90fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:09.485706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50d442-6998-4798-a145-4a6b577bb7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:09.486369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50d442-6998-4798-a145-4a6b577bb7ba None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:09.486651 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50d442-6998-4798-a145-4a6b577bb7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:09.486925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50d442-6998-4798-a145-4a6b577bb7ba None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:09.487740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50d442-6998-4798-a145-4a6b577bb7ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:09.488047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50d442-6998-4798-a145-4a6b577bb7ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:09.489469 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50d442-6998-4798-a145-4a6b577bb7ba None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:09.502445 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 376/773] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:09.503037 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50d442-6998-4798-a145-4a6b577bb7ba None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:09.548903 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 398/774] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:09.550042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840f749-5135-482f-8726-140b398a90fc None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:09.613656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50d442-6998-4798-a145-4a6b577bb7ba None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:09.644644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:09.649868 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c9bfd-f393-4274-950c-9804fb4124db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:09.650654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c9bfd-f393-4274-950c-9804fb4124db None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:09.650932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c9bfd-f393-4274-950c-9804fb4124db None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:09.651202 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c9bfd-f393-4274-950c-9804fb4124db None admin] PATH_INFO: `/v3/services/network` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:09.654697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c9bfd-f393-4274-950c-9804fb4124db None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:09.654697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c9bfd-f393-4274-950c-9804fb4124db None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-8c4c9bfd-f393-4274-950c-9804fb4124db None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:09.665829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:09.666850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:09.667772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 377/775] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:09 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:09.668625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c9bfd-f393-4274-950c-9804fb4124db None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:09.675854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840f749-5135-482f-8726-140b398a90fc None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:09.715405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65129849-4d1b-4dc3-9aba-019a82351280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:09.716229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65129849-4d1b-4dc3-9aba-019a82351280 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:09.716574 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65129849-4d1b-4dc3-9aba-019a82351280 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:09.717026 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65129849-4d1b-4dc3-9aba-019a82351280 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:09.717865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65129849-4d1b-4dc3-9aba-019a82351280 None admin] RBAC: Adding query filter params (interface=public, service_id=97518f99a0454dfdabaef61d8de48bcf, region_id=RegionOne) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:09.718260 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65129849-4d1b-4dc3-9aba-019a82351280 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:09.719602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:09.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65129849-4d1b-4dc3-9aba-019a82351280 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:09.730887 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 399/776] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Jun 15 10:22:09 2022] GET /identity/v3/endpoints?service_id=97518f99a0454dfdabaef61d8de48bcf&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:09.731910 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65129849-4d1b-4dc3-9aba-019a82351280 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:09.783113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c9bfd-f393-4274-950c-9804fb4124db None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:09.818700 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1dca8-1c03-4bbd-81ca-cf859d8364aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:09.819619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1dca8-1c03-4bbd-81ca-cf859d8364aa None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:09.819928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1dca8-1c03-4bbd-81ca-cf859d8364aa None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:09.820201 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1dca8-1c03-4bbd-81ca-cf859d8364aa None admin] PATH_INFO: `/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/81e9805ec4c44cedb658b7becf768369/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:09.822173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1dca8-1c03-4bbd-81ca-cf859d8364aa None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2eb230241340229293ca1aa5585cdc, user_id=81e9805ec4c44cedb658b7becf768369, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:09.823661 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1dca8-1c03-4bbd-81ca-cf859d8364aa None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:09.838225 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 378/777] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:22:09 2022] PUT /identity/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/81e9805ec4c44cedb658b7becf768369/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:22:09.839298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1dca8-1c03-4bbd-81ca-cf859d8364aa None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:09.857125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65129849-4d1b-4dc3-9aba-019a82351280 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:09.904757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9aca5-48a7-4b11-afa5-5de1a902ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:09.906195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9aca5-48a7-4b11-afa5-5de1a902ad3f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:09.906890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9aca5-48a7-4b11-afa5-5de1a902ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:09.907807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9aca5-48a7-4b11-afa5-5de1a902ad3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:09.924734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9aca5-48a7-4b11-afa5-5de1a902ad3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-aff9aca5-48a7-4b11-afa5-5de1a902ad3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:09.935218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:09.936330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:09.937295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:09.937295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:09.937295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:09.937295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:09.937295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:09.937295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:09.937295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:09.937295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:09.937295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:09.937295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:09.937295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:22:09.937295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:09.940486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 400/778] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:22:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:09.941526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9aca5-48a7-4b11-afa5-5de1a902ad3f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:09.955648 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:09.966834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1dca8-1c03-4bbd-81ca-cf859d8364aa None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:09.971227 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:10.014590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094384e-dd4c-4a74-a61c-5a8aca5dbb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:10.015694 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094384e-dd4c-4a74-a61c-5a8aca5dbb20 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:10.016183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094384e-dd4c-4a74-a61c-5a8aca5dbb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:10.016661 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094384e-dd4c-4a74-a61c-5a8aca5dbb20 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:10.017596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094384e-dd4c-4a74-a61c-5a8aca5dbb20 None admin] RBAC: Adding query filter params (name=network) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:10.018105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094384e-dd4c-4a74-a61c-5a8aca5dbb20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:10.020499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094384e-dd4c-4a74-a61c-5a8aca5dbb20 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:10.026618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 379/779] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Jun 15 10:22:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:10.027481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094384e-dd4c-4a74-a61c-5a8aca5dbb20 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:10.085861 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9aca5-48a7-4b11-afa5-5de1a902ad3f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:10.132101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6f566-4568-4b94-916e-ad5644131995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:10.133342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6f566-4568-4b94-916e-ad5644131995 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:10.133773 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6f566-4568-4b94-916e-ad5644131995 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:10.134445 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6f566-4568-4b94-916e-ad5644131995 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:10.135739 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6f566-4568-4b94-916e-ad5644131995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:10.137774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6f566-4568-4b94-916e-ad5644131995 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:10.145294 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 401/780] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Jun 15 10:22:09 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:10.145495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094384e-dd4c-4a74-a61c-5a8aca5dbb20 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:10.146389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6f566-4568-4b94-916e-ad5644131995 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:10.187701 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce6cd3-ade6-4fd9-b171-792554e800df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:10.188616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce6cd3-ade6-4fd9-b171-792554e800df None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:10.189047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce6cd3-ade6-4fd9-b171-792554e800df None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:10.189468 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce6cd3-ade6-4fd9-b171-792554e800df None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:10.190364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce6cd3-ade6-4fd9-b171-792554e800df None admin] RBAC: Adding query filter params (name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:10.190921 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce6cd3-ade6-4fd9-b171-792554e800df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:10.192549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce6cd3-ade6-4fd9-b171-792554e800df None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:10.203155 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 380/781] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:22:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:10.209407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce6cd3-ade6-4fd9-b171-792554e800df None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:10.227403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:10.245384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:10.266128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6f566-4568-4b94-916e-ad5644131995 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:10.303540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acda511-f40f-45d7-aee4-df6e036db646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:10.304129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acda511-f40f-45d7-aee4-df6e036db646 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:10.304413 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acda511-f40f-45d7-aee4-df6e036db646 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:10.304732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acda511-f40f-45d7-aee4-df6e036db646 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:10.305439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acda511-f40f-45d7-aee4-df6e036db646 None admin] RBAC: Adding query filter params (type=network) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:10.305797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acda511-f40f-45d7-aee4-df6e036db646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:10.307221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acda511-f40f-45d7-aee4-df6e036db646 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:10.313246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 402/782] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Jun 15 10:22:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:10.326997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acda511-f40f-45d7-aee4-df6e036db646 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:10.337542 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce6cd3-ade6-4fd9-b171-792554e800df None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:10.376884 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79be993-d2fa-45ac-935b-c1576ba15695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:10.377949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79be993-d2fa-45ac-935b-c1576ba15695 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:10.378372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79be993-d2fa-45ac-935b-c1576ba15695 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:10.378870 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79be993-d2fa-45ac-935b-c1576ba15695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:10.395159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79be993-d2fa-45ac-935b-c1576ba15695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:10.397029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79be993-d2fa-45ac-935b-c1576ba15695 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-c79be993-d2fa-45ac-935b-c1576ba15695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:10.418660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:10.419703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:10.420638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:10.420638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:10.420638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:10.420638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:10.427009 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 381/783] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:10.427009 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79be993-d2fa-45ac-935b-c1576ba15695 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:10.498173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acda511-f40f-45d7-aee4-df6e036db646 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:10.531935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:10.538205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:10.546295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5e647-5922-45bb-8222-f42de42b36be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:10.547129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5e647-5922-45bb-8222-f42de42b36be None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:10.547500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5e647-5922-45bb-8222-f42de42b36be None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:10.547876 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5e647-5922-45bb-8222-f42de42b36be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:10.548943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5e647-5922-45bb-8222-f42de42b36be None admin] RBAC: Adding query filter params (interface=public, service_id=304fac9c72bb42cd8cbb062050f8f124, region_id=RegionOne) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:10.549564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5e647-5922-45bb-8222-f42de42b36be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:10.551202 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5e647-5922-45bb-8222-f42de42b36be None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:10.558200 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79be993-d2fa-45ac-935b-c1576ba15695 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:10.563991 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 403/784] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Jun 15 10:22:10 2022] GET /identity/v3/endpoints?service_id=304fac9c72bb42cd8cbb062050f8f124&interface=public®ion_id=RegionOne => generated 194 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:10.570237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5e647-5922-45bb-8222-f42de42b36be None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:10.604523 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af24b32-ce53-418b-9ceb-772f7180ced5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:10.605597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af24b32-ce53-418b-9ceb-772f7180ced5 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:10.606088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af24b32-ce53-418b-9ceb-772f7180ced5 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:10.606562 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af24b32-ce53-418b-9ceb-772f7180ced5 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:10.607501 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af24b32-ce53-418b-9ceb-772f7180ced5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:10.608056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af24b32-ce53-418b-9ceb-772f7180ced5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:10.609646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af24b32-ce53-418b-9ceb-772f7180ced5 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:10.630259 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 382/785] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:10.637355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af24b32-ce53-418b-9ceb-772f7180ced5 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:10.777635 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5e647-5922-45bb-8222-f42de42b36be None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:10.821994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af24b32-ce53-418b-9ceb-772f7180ced5 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:10.851078 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fba29-89c5-468b-9134-eb1fa4b4e610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:10.851766 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fba29-89c5-468b-9134-eb1fa4b4e610 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:10.852048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fba29-89c5-468b-9134-eb1fa4b4e610 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:10.852317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fba29-89c5-468b-9134-eb1fa4b4e610 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:10.852998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fba29-89c5-468b-9134-eb1fa4b4e610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:10.854366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fba29-89c5-468b-9134-eb1fa4b4e610 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:10.860177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655060c0-111b-40a8-b4c5-e774f8d94b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:10.860444 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 404/786] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Jun 15 10:22:10 2022] GET /identity/v3/services => generated 772 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:10.860987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655060c0-111b-40a8-b4c5-e774f8d94b11 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:10.861266 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655060c0-111b-40a8-b4c5-e774f8d94b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:10.861538 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655060c0-111b-40a8-b4c5-e774f8d94b11 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:10.861705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5dc15-58ac-41e0-bf6a-22cfe17debbd None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:10.861956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5dc15-58ac-41e0-bf6a-22cfe17debbd None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:10.862236 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5dc15-58ac-41e0-bf6a-22cfe17debbd None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:10.863822 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 405/787] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:10.872896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a693a59-7bb3-4769-bffd-80474e0f8a69 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:10.873174 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a693a59-7bb3-4769-bffd-80474e0f8a69 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:10.873665 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a693a59-7bb3-4769-bffd-80474e0f8a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:10.874701 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655060c0-111b-40a8-b4c5-e774f8d94b11 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:10.876274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655060c0-111b-40a8-b4c5-e774f8d94b11 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-655060c0-111b-40a8-b4c5-e774f8d94b11 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:10.906221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:10.907288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:10.908958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:10.908958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:10.908958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:10.908958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:10.908958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:10.908958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:10.908958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:10.908958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:10.908958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 10:22:10.908958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:10.908958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 383/788] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Jun 15 10:22:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:10.914328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4a693a59-7bb3-4769-bffd-80474e0f8a69 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:10.914328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4a693a59-7bb3-4769-bffd-80474e0f8a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:10.915342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655060c0-111b-40a8-b4c5-e774f8d94b11 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:10.919156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:10.992297 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:11.008683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 406/789] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:11.036799 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655060c0-111b-40a8-b4c5-e774f8d94b11 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:11.043046 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a693a59-7bb3-4769-bffd-80474e0f8a69 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:11.093276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99115db2-1594-4004-ac43-4d4db588b1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:11.094224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99115db2-1594-4004-ac43-4d4db588b1be None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:11.094668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99115db2-1594-4004-ac43-4d4db588b1be None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:11.095198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99115db2-1594-4004-ac43-4d4db588b1be None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:11.096297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99115db2-1594-4004-ac43-4d4db588b1be None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:11.096749 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99115db2-1594-4004-ac43-4d4db588b1be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:11.098369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99115db2-1594-4004-ac43-4d4db588b1be None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:11.139781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 384/790] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Jun 15 10:22:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:11.145408 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99115db2-1594-4004-ac43-4d4db588b1be None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:11.181962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a693a59-7bb3-4769-bffd-80474e0f8a69 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:11.232412 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ec012-86e0-421d-8822-9a12c1dbe00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:11.233807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:11.236242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ec012-86e0-421d-8822-9a12c1dbe00c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:11.236559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ec012-86e0-421d-8822-9a12c1dbe00c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:11.237988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ec012-86e0-421d-8822-9a12c1dbe00c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:11.257415 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ec012-86e0-421d-8822-9a12c1dbe00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-6b7ec012-86e0-421d-8822-9a12c1dbe00c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:11.268431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:11.269468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:11.270340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:11.270340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:11.270340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:11.270340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:11.270340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:11.270340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:11.270340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:11.270340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:11.270340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:11.270340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:11.270340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:11.270340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:11.273457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 407/791] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:22:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:11.280159 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ec012-86e0-421d-8822-9a12c1dbe00c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:11.296568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99115db2-1594-4004-ac43-4d4db588b1be None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:11.335057 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeeaa8c-2d03-470d-8f40-251bb1e6a302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:11.335820 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:11.336950 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeeaa8c-2d03-470d-8f40-251bb1e6a302 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:11.337451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeeaa8c-2d03-470d-8f40-251bb1e6a302 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:11.337927 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeeaa8c-2d03-470d-8f40-251bb1e6a302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:11.358387 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeeaa8c-2d03-470d-8f40-251bb1e6a302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:11.360283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeeaa8c-2d03-470d-8f40-251bb1e6a302 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-5eeeaa8c-2d03-470d-8f40-251bb1e6a302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:11.381192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:11.382254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:11.383285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:11.383285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:11.383285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:11.383285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:11.386455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 385/792] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:11.395752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeeaa8c-2d03-470d-8f40-251bb1e6a302 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:11.408949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ec012-86e0-421d-8822-9a12c1dbe00c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:11.471143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7223b8-beec-44e1-a42c-6714baf3881c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:11.471847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7223b8-beec-44e1-a42c-6714baf3881c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:11.472127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7223b8-beec-44e1-a42c-6714baf3881c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:11.472397 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7223b8-beec-44e1-a42c-6714baf3881c None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:11.473141 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7223b8-beec-44e1-a42c-6714baf3881c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:11.473448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7223b8-beec-44e1-a42c-6714baf3881c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:11.474802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7223b8-beec-44e1-a42c-6714baf3881c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:11.491132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 408/793] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:22:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:11.493891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7223b8-beec-44e1-a42c-6714baf3881c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:11.575892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeeaa8c-2d03-470d-8f40-251bb1e6a302 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:11.596343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:11.638887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1af9e-5760-45d7-9a09-a6f107082c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:11.639574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1af9e-5760-45d7-9a09-a6f107082c50 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:11.639859 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1af9e-5760-45d7-9a09-a6f107082c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:11.640134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1af9e-5760-45d7-9a09-a6f107082c50 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:11.640864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1af9e-5760-45d7-9a09-a6f107082c50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:11.641169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1af9e-5760-45d7-9a09-a6f107082c50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:11.642541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1af9e-5760-45d7-9a09-a6f107082c50 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:11.664716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7223b8-beec-44e1-a42c-6714baf3881c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:11.679911 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:11.681602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 386/794] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:11.687018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1af9e-5760-45d7-9a09-a6f107082c50 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:11.700764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0af765-5805-4a1c-85ba-5cb02d1c082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:11.701551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0af765-5805-4a1c-85ba-5cb02d1c082e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:11.701831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0af765-5805-4a1c-85ba-5cb02d1c082e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:11.702101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0af765-5805-4a1c-85ba-5cb02d1c082e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:11.715693 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0af765-5805-4a1c-85ba-5cb02d1c082e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:11.717150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0af765-5805-4a1c-85ba-5cb02d1c082e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-4e0af765-5805-4a1c-85ba-5cb02d1c082e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:11.734971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:11.735978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:11.737343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:11.737343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:11.737343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:11.737343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:11.737343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 409/795] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:11.742372 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0af765-5805-4a1c-85ba-5cb02d1c082e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:11.888103 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1af9e-5760-45d7-9a09-a6f107082c50 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:11.920917 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0af765-5805-4a1c-85ba-5cb02d1c082e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:11.941605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523293d-1d20-44fe-932e-29ba01632068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:11.942409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523293d-1d20-44fe-932e-29ba01632068 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:11.942699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523293d-1d20-44fe-932e-29ba01632068 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:11.942965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523293d-1d20-44fe-932e-29ba01632068 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:11.954374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523293d-1d20-44fe-932e-29ba01632068 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:11.955862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523293d-1d20-44fe-932e-29ba01632068 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:11.957229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182dd3d-de42-4783-b483-b80e3a381541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:11.957889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182dd3d-de42-4783-b483-b80e3a381541 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:11.958167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182dd3d-de42-4783-b483-b80e3a381541 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:11.958440 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182dd3d-de42-4783-b483-b80e3a381541 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:11.959153 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182dd3d-de42-4783-b483-b80e3a381541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:11.959454 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182dd3d-de42-4783-b483-b80e3a381541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:11.961490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182dd3d-de42-4783-b483-b80e3a381541 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:11.974516 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 410/796] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:11.979842 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182dd3d-de42-4783-b483-b80e3a381541 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-6523293d-1d20-44fe-932e-29ba01632068 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:11.986532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:11.987486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:11.989123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:11.989123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:11.989123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:11.989123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:11.989123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:11.989123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:11.989123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:11.989123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:11.989123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 387/797] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:11.993624 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523293d-1d20-44fe-932e-29ba01632068 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:12.005896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:12.076467 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:12.087675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182dd3d-de42-4783-b483-b80e3a381541 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:12.123248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46247526-c27b-4e37-bc21-44a814bcac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:12.124058 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46247526-c27b-4e37-bc21-44a814bcac6d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:12.124340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46247526-c27b-4e37-bc21-44a814bcac6d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:12.124617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46247526-c27b-4e37-bc21-44a814bcac6d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:12.131985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46247526-c27b-4e37-bc21-44a814bcac6d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:12.134130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46247526-c27b-4e37-bc21-44a814bcac6d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-46247526-c27b-4e37-bc21-44a814bcac6d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:12.149235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:12.151549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:12.153835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:12.153835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:12.153835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:12.153835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:12.153835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:12.153835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:12.153835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:12.153835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:12.153835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 10:22:12.153835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:12.153835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 411/798] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:22:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:12.159827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46247526-c27b-4e37-bc21-44a814bcac6d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:12.237476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523293d-1d20-44fe-932e-29ba01632068 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:12.308020 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a1b45-7ebb-453d-bb69-a343e867d5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:12.308998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a1b45-7ebb-453d-bb69-a343e867d5ed None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:12.309690 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a1b45-7ebb-453d-bb69-a343e867d5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:12.310618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a1b45-7ebb-453d-bb69-a343e867d5ed None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:12.311937 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a1b45-7ebb-453d-bb69-a343e867d5ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:12.312426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a1b45-7ebb-453d-bb69-a343e867d5ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:12.313140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:12.315783 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a1b45-7ebb-453d-bb69-a343e867d5ed None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:12.346403 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 388/799] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:12.352638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46247526-c27b-4e37-bc21-44a814bcac6d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:12.367235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a1b45-7ebb-453d-bb69-a343e867d5ed None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:12.428344 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d7328-fc90-44e2-92f7-2ea138d1ad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:12.428955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d7328-fc90-44e2-92f7-2ea138d1ad67 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:12.429775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d7328-fc90-44e2-92f7-2ea138d1ad67 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:12.430052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d7328-fc90-44e2-92f7-2ea138d1ad67 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:12.430906 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d7328-fc90-44e2-92f7-2ea138d1ad67 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:12.431215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d7328-fc90-44e2-92f7-2ea138d1ad67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:12.432677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d7328-fc90-44e2-92f7-2ea138d1ad67 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:12.460456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 412/800] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Jun 15 10:22:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:12.466261 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbdfa1-1a53-4a9c-988b-a4f87a805d39 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:12.466954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbdfa1-1a53-4a9c-988b-a4f87a805d39 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:12.467436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbdfa1-1a53-4a9c-988b-a4f87a805d39 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:12.469277 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 413/801] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:12.470209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbdfa1-1a53-4a9c-988b-a4f87a805d39 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:12.477578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:12.485895 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a1b45-7ebb-453d-bb69-a343e867d5ed None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:12.530311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f0d24-99c6-44a1-ab48-501c263ee9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:12.531989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0d24-99c6-44a1-ab48-501c263ee9d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:12.532422 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0d24-99c6-44a1-ab48-501c263ee9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:12.533173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f0d24-99c6-44a1-ab48-501c263ee9d6 None admin] PATH_INFO: `/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/d44268b4ab154bea8c958be5f3e30714/roles/f6ffe6f612824e50a23f0b06a16a1f91` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:12.553345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f0d24-99c6-44a1-ab48-501c263ee9d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2eb230241340229293ca1aa5585cdc, user_id=d44268b4ab154bea8c958be5f3e30714, role_id=f6ffe6f612824e50a23f0b06a16a1f91)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:12.555905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f0d24-99c6-44a1-ab48-501c263ee9d6 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:12.574182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 389/802] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:22:12 2022] PUT /identity/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/d44268b4ab154bea8c958be5f3e30714/roles/f6ffe6f612824e50a23f0b06a16a1f91 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:22:12.575789 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926122a-21d2-4c22-b2d1-f7748bd06f6a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:12.576251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926122a-21d2-4c22-b2d1-f7748bd06f6a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:12.576687 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926122a-21d2-4c22-b2d1-f7748bd06f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:12.593484 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbdfa1-1a53-4a9c-988b-a4f87a805d39 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:12.600402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-b926122a-21d2-4c22-b2d1-f7748bd06f6a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:12.602306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b926122a-21d2-4c22-b2d1-f7748bd06f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:12.636841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f82ae-0e08-4719-912d-53c40890fabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:12.637792 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f82ae-0e08-4719-912d-53c40890fabc None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:12.638244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f82ae-0e08-4719-912d-53c40890fabc None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:12.638599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f82ae-0e08-4719-912d-53c40890fabc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:12.651174 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f82ae-0e08-4719-912d-53c40890fabc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:12.652978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f82ae-0e08-4719-912d-53c40890fabc None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:12.655168 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-719f82ae-0e08-4719-912d-53c40890fabc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:12.694502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:12.695619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:12.696589 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:12.696589 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:12.696589 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:12.696589 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:12.698752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 390/803] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:12.699621 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 414/804] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:12.705107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926122a-21d2-4c22-b2d1-f7748bd06f6a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:12.741269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f82ae-0e08-4719-912d-53c40890fabc None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:12.789719 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:12.827507 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926122a-21d2-4c22-b2d1-f7748bd06f6a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:12.871499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f610a4-5217-4842-bd71-364b966c14f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:12.873038 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f610a4-5217-4842-bd71-364b966c14f7 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:12.873531 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f610a4-5217-4842-bd71-364b966c14f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:12.874028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f610a4-5217-4842-bd71-364b966c14f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:12.875024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f610a4-5217-4842-bd71-364b966c14f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:12.875616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f610a4-5217-4842-bd71-364b966c14f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:12.877632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f610a4-5217-4842-bd71-364b966c14f7 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:12.894136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 391/805] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:12.901774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f610a4-5217-4842-bd71-364b966c14f7 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:12.947765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f82ae-0e08-4719-912d-53c40890fabc None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:12.986225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdbacd-b06e-4e98-9fa2-29c755650cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:12.987053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdbacd-b06e-4e98-9fa2-29c755650cda None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:12.987292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdbacd-b06e-4e98-9fa2-29c755650cda None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:12.987594 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdbacd-b06e-4e98-9fa2-29c755650cda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:13.000272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdbacd-b06e-4e98-9fa2-29c755650cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-b3fdbacd-b06e-4e98-9fa2-29c755650cda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:13.008332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:13.009304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:13.010186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:13.010186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:13.010186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:13.010186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:13.010186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:13.010186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:13.010186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:13.010186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:13.010186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:13.010186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:13.010186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:13.010186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:13.013544 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 415/806] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:22:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:13.015778 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48fa97-117f-4538-b418-e075a2a41a98 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:13.016435 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48fa97-117f-4538-b418-e075a2a41a98 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:13.017061 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48fa97-117f-4538-b418-e075a2a41a98 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:13.019446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 416/807] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:13.024305 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48fa97-117f-4538-b418-e075a2a41a98 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:13.037310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f610a4-5217-4842-bd71-364b966c14f7 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:13.075944 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:13.083833 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bade50-9317-40a9-a08c-43def002f755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:13.084630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bade50-9317-40a9-a08c-43def002f755 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:13.084911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bade50-9317-40a9-a08c-43def002f755 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:13.085181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bade50-9317-40a9-a08c-43def002f755 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:13.094541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:13.095747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bade50-9317-40a9-a08c-43def002f755 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:13.097879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bade50-9317-40a9-a08c-43def002f755 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-a8bade50-9317-40a9-a08c-43def002f755 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:13.117603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:13.118598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:13.119660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:13.119660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:13.119660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:13.119660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:13.119660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:13.119660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:13.119660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:13.119660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:13.119660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 392/808] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:13.124523 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c86bf4-7cf0-4d07-a2c4-6b182e04bf01 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:13.125060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c86bf4-7cf0-4d07-a2c4-6b182e04bf01 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:13.127169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c86bf4-7cf0-4d07-a2c4-6b182e04bf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:13.155871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-c7c86bf4-7cf0-4d07-a2c4-6b182e04bf01 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:13.157224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c7c86bf4-7cf0-4d07-a2c4-6b182e04bf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:13.168324 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48fa97-117f-4538-b418-e075a2a41a98 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:13.215276 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef4c7-43ef-4925-8073-0ec6c1bf54c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:13.216051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef4c7-43ef-4925-8073-0ec6c1bf54c6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:13.216434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef4c7-43ef-4925-8073-0ec6c1bf54c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:13.216812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef4c7-43ef-4925-8073-0ec6c1bf54c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:13.217657 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef4c7-43ef-4925-8073-0ec6c1bf54c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:13.218116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef4c7-43ef-4925-8073-0ec6c1bf54c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:13.219723 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef4c7-43ef-4925-8073-0ec6c1bf54c6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:13.229515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 417/809] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:22:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:13.230511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef4c7-43ef-4925-8073-0ec6c1bf54c6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:13.243488 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 393/810] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:13.244672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c86bf4-7cf0-4d07-a2c4-6b182e04bf01 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:13.345052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef4c7-43ef-4925-8073-0ec6c1bf54c6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:13.357599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c86bf4-7cf0-4d07-a2c4-6b182e04bf01 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:13.363889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:13.385771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257fdb6-7701-4862-8f1f-3e0b4eaaeef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:13.386456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257fdb6-7701-4862-8f1f-3e0b4eaaeef9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:13.386739 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257fdb6-7701-4862-8f1f-3e0b4eaaeef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:13.387021 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257fdb6-7701-4862-8f1f-3e0b4eaaeef9 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:13.387673 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:13.387868 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257fdb6-7701-4862-8f1f-3e0b4eaaeef9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:13.388184 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257fdb6-7701-4862-8f1f-3e0b4eaaeef9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:13.390437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257fdb6-7701-4862-8f1f-3e0b4eaaeef9 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:13.402204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665dbea-63aa-4b1c-ab66-6aad49c6f80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:13.403410 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665dbea-63aa-4b1c-ab66-6aad49c6f80a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:13.403920 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665dbea-63aa-4b1c-ab66-6aad49c6f80a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:13.404388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665dbea-63aa-4b1c-ab66-6aad49c6f80a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:13.415116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 418/811] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:13.415116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257fdb6-7701-4862-8f1f-3e0b4eaaeef9 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:13.424630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665dbea-63aa-4b1c-ab66-6aad49c6f80a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:13.426458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665dbea-63aa-4b1c-ab66-6aad49c6f80a None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-7665dbea-63aa-4b1c-ab66-6aad49c6f80a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:13.446161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:13.447117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:13.448081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:13.448081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:13.448081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:13.448081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:13.449050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 394/812] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:13.449682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665dbea-63aa-4b1c-ab66-6aad49c6f80a None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:13.525603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257fdb6-7701-4862-8f1f-3e0b4eaaeef9 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:13.554836 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665dbea-63aa-4b1c-ab66-6aad49c6f80a None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:13.562043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f83b6-14bc-46d4-a281-6cc87b950ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:13.562839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f83b6-14bc-46d4-a281-6cc87b950ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:13.563114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f83b6-14bc-46d4-a281-6cc87b950ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:13.563377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f83b6-14bc-46d4-a281-6cc87b950ae7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:13.564060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f83b6-14bc-46d4-a281-6cc87b950ae7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:13.565401 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f83b6-14bc-46d4-a281-6cc87b950ae7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-6a7f83b6-14bc-46d4-a281-6cc87b950ae7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:13.579761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:13.580951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:13.582087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 419/813] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Jun 15 10:22:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:13.582975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92d27c-328e-4fd8-8e25-c6df5829d819 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:13.582975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92d27c-328e-4fd8-8e25-c6df5829d819 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:13.583105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92d27c-328e-4fd8-8e25-c6df5829d819 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:13.587502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 420/814] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:13.587502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92d27c-328e-4fd8-8e25-c6df5829d819 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:13.598895 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143751a-4cbc-4486-9abd-f4896821c44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:13.599833 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143751a-4cbc-4486-9abd-f4896821c44e None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:13.600113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143751a-4cbc-4486-9abd-f4896821c44e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:13.600385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143751a-4cbc-4486-9abd-f4896821c44e None admin] PATH_INFO: `/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/7673b1c4f6184570b0039f9285bf1286/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:13.603001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143751a-4cbc-4486-9abd-f4896821c44e None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2eb230241340229293ca1aa5585cdc, user_id=7673b1c4f6184570b0039f9285bf1286, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:13.604466 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143751a-4cbc-4486-9abd-f4896821c44e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:13.620930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 395/815] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:22:13 2022] PUT /identity/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/7673b1c4f6184570b0039f9285bf1286/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:22:13.621850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143751a-4cbc-4486-9abd-f4896821c44e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:13.645438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:13.678656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:13.723414 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92d27c-328e-4fd8-8e25-c6df5829d819 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:13.765247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f592e9f-44bc-48bf-a581-e38d49090b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:13.766301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592e9f-44bc-48bf-a581-e38d49090b88 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:13.766810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592e9f-44bc-48bf-a581-e38d49090b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:13.767405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592e9f-44bc-48bf-a581-e38d49090b88 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:13.768566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f592e9f-44bc-48bf-a581-e38d49090b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:13.769095 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f592e9f-44bc-48bf-a581-e38d49090b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:13.770762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f592e9f-44bc-48bf-a581-e38d49090b88 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:13.771092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143751a-4cbc-4486-9abd-f4896821c44e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:13.785847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 421/816] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:13.787571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfbe0b-bb7b-4ac2-b64a-9c879e07c0d8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:13.788125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfbe0b-bb7b-4ac2-b64a-9c879e07c0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:13.789317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfbe0b-bb7b-4ac2-b64a-9c879e07c0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:13.808590 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-16cfbe0b-bb7b-4ac2-b64a-9c879e07c0d8 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:13.810197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-16cfbe0b-bb7b-4ac2-b64a-9c879e07c0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:13.815293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a123d-991d-4292-bd03-8a6b740142e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:13.816000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a123d-991d-4292-bd03-8a6b740142e0 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:13.816305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a123d-991d-4292-bd03-8a6b740142e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:13.816617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a123d-991d-4292-bd03-8a6b740142e0 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:13.817344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a123d-991d-4292-bd03-8a6b740142e0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:13.817650 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a123d-991d-4292-bd03-8a6b740142e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:13.819064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a123d-991d-4292-bd03-8a6b740142e0 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:13.827540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 396/817] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Jun 15 10:22:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:13.827540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a123d-991d-4292-bd03-8a6b740142e0 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:13.900331 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 422/818] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:13.901739 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfbe0b-bb7b-4ac2-b64a-9c879e07c0d8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:13.942181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:13.943498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:13.947807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a123d-991d-4292-bd03-8a6b740142e0 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:13.986267 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2e0b4-d9ff-48a0-89b8-2f9ca01c84eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:13.987232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2e0b4-d9ff-48a0-89b8-2f9ca01c84eb None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:13.987648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2e0b4-d9ff-48a0-89b8-2f9ca01c84eb None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:13.988049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2e0b4-d9ff-48a0-89b8-2f9ca01c84eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:13.996725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2e0b4-d9ff-48a0-89b8-2f9ca01c84eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:13.998460 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2e0b4-d9ff-48a0-89b8-2f9ca01c84eb None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-54f2e0b4-d9ff-48a0-89b8-2f9ca01c84eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:14.015345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:14.016592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:14.017882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:14.017882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:14.017882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:14.017882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:14.017882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:14.017882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:14.017882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:14.017882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:14.017882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:22:14.017882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:14.019730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 397/819] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Jun 15 10:22:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:14.020620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2e0b4-d9ff-48a0-89b8-2f9ca01c84eb None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:14.044628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfbe0b-bb7b-4ac2-b64a-9c879e07c0d8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:14.081543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba3dfd-2f6a-474e-8caf-1fa97e54310a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:14.082576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba3dfd-2f6a-474e-8caf-1fa97e54310a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:14.083087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba3dfd-2f6a-474e-8caf-1fa97e54310a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:14.083640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba3dfd-2f6a-474e-8caf-1fa97e54310a None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:14.084596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba3dfd-2f6a-474e-8caf-1fa97e54310a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:14.085094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba3dfd-2f6a-474e-8caf-1fa97e54310a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:14.087365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba3dfd-2f6a-474e-8caf-1fa97e54310a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:14.093636 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 423/820] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Jun 15 10:22:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:14.094846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba3dfd-2f6a-474e-8caf-1fa97e54310a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:14.148899 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2e0b4-d9ff-48a0-89b8-2f9ca01c84eb None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:14.197503 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4577-5a5c-45e0-a1e4-279562821a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:14.198818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4577-5a5c-45e0-a1e4-279562821a87 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:14.199159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4577-5a5c-45e0-a1e4-279562821a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:14.199441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb4577-5a5c-45e0-a1e4-279562821a87 None admin] PATH_INFO: `/v3/services/network` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:14.200350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb4577-5a5c-45e0-a1e4-279562821a87 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:14.202022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb4577-5a5c-45e0-a1e4-279562821a87 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:14.206674 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:14.216012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba3dfd-2f6a-474e-8caf-1fa97e54310a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-38eb4577-5a5c-45e0-a1e4-279562821a87 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:14.220644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:14.221652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:14.222512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:14.222512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:14.222512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:14.222512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:14.222512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:14.222512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:14.222512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:14.222512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:14.222512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:14.222512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:14.222512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:14.222512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:14.222512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 10:22:14.222512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:14.226756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 398/821] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:14 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:14.228171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4577-5a5c-45e0-a1e4-279562821a87 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:14.256416 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30eade-2363-4241-a37c-5e97012bb8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:14.257960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30eade-2363-4241-a37c-5e97012bb8ea None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:14.258465 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30eade-2363-4241-a37c-5e97012bb8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:14.258933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30eade-2363-4241-a37c-5e97012bb8ea None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:14.259999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30eade-2363-4241-a37c-5e97012bb8ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:14.260503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30eade-2363-4241-a37c-5e97012bb8ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:14.261003 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:14.262852 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30eade-2363-4241-a37c-5e97012bb8ea None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:14.282794 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 424/822] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Jun 15 10:22:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:14.283937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30eade-2363-4241-a37c-5e97012bb8ea None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:14.366434 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb4577-5a5c-45e0-a1e4-279562821a87 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:14.394150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30eade-2363-4241-a37c-5e97012bb8ea None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:14.413950 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbe305-ee95-4bfb-8fb2-97b336925fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:14.414999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbe305-ee95-4bfb-8fb2-97b336925fcc None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:14.415590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbe305-ee95-4bfb-8fb2-97b336925fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:14.415869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbe305-ee95-4bfb-8fb2-97b336925fcc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:14.416618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbe305-ee95-4bfb-8fb2-97b336925fcc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:14.417994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbe305-ee95-4bfb-8fb2-97b336925fcc None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:14.434767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd5495-6618-4624-88ba-e93d46d3d69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:14.435745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd5495-6618-4624-88ba-e93d46d3d69e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:14.435999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd5495-6618-4624-88ba-e93d46d3d69e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:14.436441 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd5495-6618-4624-88ba-e93d46d3d69e None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:14.437301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd5495-6618-4624-88ba-e93d46d3d69e None admin] RBAC: Adding query filter params (name=network) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:14.437470 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd5495-6618-4624-88ba-e93d46d3d69e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:14.438914 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd5495-6618-4624-88ba-e93d46d3d69e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:14.447748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 399/823] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Jun 15 10:22:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:22:14.448880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbe305-ee95-4bfb-8fb2-97b336925fcc None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:14.449763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 425/824] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Jun 15 10:22:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:14.450727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd5495-6618-4624-88ba-e93d46d3d69e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:14.472303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:14.566939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:14.571870 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd5495-6618-4624-88ba-e93d46d3d69e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:14.612867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbe305-ee95-4bfb-8fb2-97b336925fcc None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:14.622568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cb232-7737-4ae4-9c01-b389bfbf5f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:14.623655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cb232-7737-4ae4-9c01-b389bfbf5f6f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:14.623655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cb232-7737-4ae4-9c01-b389bfbf5f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:14.623858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cb232-7737-4ae4-9c01-b389bfbf5f6f None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:14.624429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cb232-7737-4ae4-9c01-b389bfbf5f6f None admin] RBAC: Adding query filter params (type=network) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:14.624732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cb232-7737-4ae4-9c01-b389bfbf5f6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:14.626143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cb232-7737-4ae4-9c01-b389bfbf5f6f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:14.632712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 426/825] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Jun 15 10:22:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:14.638409 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cb232-7737-4ae4-9c01-b389bfbf5f6f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:14.660984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cebae7-e168-45f9-b8c2-aa5a4c9ea47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:14.662563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cebae7-e168-45f9-b8c2-aa5a4c9ea47b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:14.663247 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cebae7-e168-45f9-b8c2-aa5a4c9ea47b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:14.663922 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cebae7-e168-45f9-b8c2-aa5a4c9ea47b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:14.745893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:14.773841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cb232-7737-4ae4-9c01-b389bfbf5f6f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:14.778411 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cebae7-e168-45f9-b8c2-aa5a4c9ea47b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:14.779935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cebae7-e168-45f9-b8c2-aa5a4c9ea47b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:14.811398 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b9d9f-ab86-4ee7-8872-260ed4319943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:14.812397 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9d9f-ab86-4ee7-8872-260ed4319943 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:14.812941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9d9f-ab86-4ee7-8872-260ed4319943 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:14.813223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b9d9f-ab86-4ee7-8872-260ed4319943 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:14.813976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b9d9f-ab86-4ee7-8872-260ed4319943 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:14.816273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b9d9f-ab86-4ee7-8872-260ed4319943 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:14.840784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 427/826] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Jun 15 10:22:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:22:14.867874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:14.896776 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 400/827] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:22:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:22:14.901945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b9d9f-ab86-4ee7-8872-260ed4319943 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:15.037541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b9d9f-ab86-4ee7-8872-260ed4319943 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:15.068228 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:15.076565 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c6f28-f503-4348-8e2c-8b20a2543a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:15.077646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c6f28-f503-4348-8e2c-8b20a2543a6a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:15.078406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c6f28-f503-4348-8e2c-8b20a2543a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:15.078896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c6f28-f503-4348-8e2c-8b20a2543a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:15.089893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c6f28-f503-4348-8e2c-8b20a2543a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:15.091503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c6f28-f503-4348-8e2c-8b20a2543a6a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:15.104151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134fd40-19ca-48be-9f9b-4d92b4936d77 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:15.104702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134fd40-19ca-48be-9f9b-4d92b4936d77 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:15.105139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134fd40-19ca-48be-9f9b-4d92b4936d77 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:15.106895 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 401/828] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-e08c6f28-f503-4348-8e2c-8b20a2543a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:15.112733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:15.113890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:15.115043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:15.115043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:15.115043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:15.115043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:15.116187 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd26653-bae7-480a-96ef-42583ec3fbb8 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:15.117183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd26653-bae7-480a-96ef-42583ec3fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:15.117606 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd26653-bae7-480a-96ef-42583ec3fbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:15.118117 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 428/829] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:15.125203 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c6f28-f503-4348-8e2c-8b20a2543a6a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:15.137567 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-afd26653-bae7-480a-96ef-42583ec3fbb8 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:15.139169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-afd26653-bae7-480a-96ef-42583ec3fbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:15.220955 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 402/830] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:15.234052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c6f28-f503-4348-8e2c-8b20a2543a6a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:15.247803 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd26653-bae7-480a-96ef-42583ec3fbb8 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:15.269256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482933a9-53f9-4b1b-944b-08025ab177f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:15.270051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482933a9-53f9-4b1b-944b-08025ab177f9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:15.270452 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482933a9-53f9-4b1b-944b-08025ab177f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:15.270824 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482933a9-53f9-4b1b-944b-08025ab177f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:15.271674 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482933a9-53f9-4b1b-944b-08025ab177f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:15.272300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482933a9-53f9-4b1b-944b-08025ab177f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:15.274115 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482933a9-53f9-4b1b-944b-08025ab177f9 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:15.286627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 429/831] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:15.292783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482933a9-53f9-4b1b-944b-08025ab177f9 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:15.335924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:15.361913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd26653-bae7-480a-96ef-42583ec3fbb8 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:15.364594 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:15.398232 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482933a9-53f9-4b1b-944b-08025ab177f9 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:15.404252 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff69c48-d276-4766-bb94-72050d3f303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:15.405249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff69c48-d276-4766-bb94-72050d3f303f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:15.405848 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff69c48-d276-4766-bb94-72050d3f303f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:15.406397 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff69c48-d276-4766-bb94-72050d3f303f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:15.419732 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff69c48-d276-4766-bb94-72050d3f303f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-fff69c48-d276-4766-bb94-72050d3f303f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:15.428589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:15.429634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:15.430526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:15.430526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:15.430526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:15.430526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:15.430526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:15.430526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:15.430526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:15.430526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:15.430526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:15.430526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:15.430526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:22:15.430526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:15.435134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 403/832] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:22:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:15.440614 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483c08-8081-4323-8765-51968ace538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:15.441564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff69c48-d276-4766-bb94-72050d3f303f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:15.441948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483c08-8081-4323-8765-51968ace538d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:15.442482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483c08-8081-4323-8765-51968ace538d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:15.443215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483c08-8081-4323-8765-51968ace538d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:15.453067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df483c08-8081-4323-8765-51968ace538d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:15.455639 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df483c08-8081-4323-8765-51968ace538d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-df483c08-8081-4323-8765-51968ace538d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:15.471281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:15.472427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:15.473571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:15.473571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:15.473571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:15.473571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:15.473571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:15.473571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:15.473571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:15.473571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:15.475729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 430/833] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:15.481819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483c08-8081-4323-8765-51968ace538d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:15.551356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff69c48-d276-4766-bb94-72050d3f303f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:15.583840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:15.587705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483c08-8081-4323-8765-51968ace538d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:15.589693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820b406-11bb-440a-94e4-29822a7c014f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:15.591535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820b406-11bb-440a-94e4-29822a7c014f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:15.591535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820b406-11bb-440a-94e4-29822a7c014f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:15.591535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820b406-11bb-440a-94e4-29822a7c014f None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:15.592398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820b406-11bb-440a-94e4-29822a7c014f None admin] RBAC: Adding query filter params (name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:15.592800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820b406-11bb-440a-94e4-29822a7c014f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:15.594284 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820b406-11bb-440a-94e4-29822a7c014f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:15.607581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 404/834] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:22:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:15.609324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820b406-11bb-440a-94e4-29822a7c014f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:15.625666 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759830fa-14f3-4e8c-9ff4-cae91756053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:15.626575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759830fa-14f3-4e8c-9ff4-cae91756053a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:15.626997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759830fa-14f3-4e8c-9ff4-cae91756053a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:15.627493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759830fa-14f3-4e8c-9ff4-cae91756053a None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:15.628462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759830fa-14f3-4e8c-9ff4-cae91756053a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:15.628907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759830fa-14f3-4e8c-9ff4-cae91756053a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:15.630460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759830fa-14f3-4e8c-9ff4-cae91756053a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:15.648791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 431/835] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:15.650641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759830fa-14f3-4e8c-9ff4-cae91756053a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:15.732703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:15.734810 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820b406-11bb-440a-94e4-29822a7c014f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:15.754755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759830fa-14f3-4e8c-9ff4-cae91756053a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:15.780043 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f04179-18c9-45ea-b87e-2251ab7376b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:15.781268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f04179-18c9-45ea-b87e-2251ab7376b0 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:15.781578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f04179-18c9-45ea-b87e-2251ab7376b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:15.782096 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f04179-18c9-45ea-b87e-2251ab7376b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:15.791969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed89410-63ef-4a84-91af-7a001c6e0a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:15.792612 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed89410-63ef-4a84-91af-7a001c6e0a6f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:15.792891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed89410-63ef-4a84-91af-7a001c6e0a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:15.793161 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed89410-63ef-4a84-91af-7a001c6e0a6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:15.793987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed89410-63ef-4a84-91af-7a001c6e0a6f None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=81e9805ec4c44cedb658b7becf768369) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:15.794291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed89410-63ef-4a84-91af-7a001c6e0a6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:15.795774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed89410-63ef-4a84-91af-7a001c6e0a6f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:15.796440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f04179-18c9-45ea-b87e-2251ab7376b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:15.798297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f04179-18c9-45ea-b87e-2251ab7376b0 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:15.802292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 432/836] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:22:15 2022] GET /identity/v3/role_assignments?user.id=81e9805ec4c44cedb658b7becf768369&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=e1a2021d08e14daa969362b3d23face3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-44f04179-18c9-45ea-b87e-2251ab7376b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:15.817987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:15.819189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:15.820797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:15.820797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:15.820797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:15.820797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:15.822861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 405/837] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:15.828676 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed89410-63ef-4a84-91af-7a001c6e0a6f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:15.858667 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:15.950773 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed89410-63ef-4a84-91af-7a001c6e0a6f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:15.987935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcf073-d9a2-4f4b-a352-19ce922ce1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:15.988534 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcf073-d9a2-4f4b-a352-19ce922ce1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:15.988816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcf073-d9a2-4f4b-a352-19ce922ce1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:15.989088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcf073-d9a2-4f4b-a352-19ce922ce1d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:15.989828 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcf073-d9a2-4f4b-a352-19ce922ce1d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:15.990136 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcf073-d9a2-4f4b-a352-19ce922ce1d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:15.992147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcf073-d9a2-4f4b-a352-19ce922ce1d5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:16.005665 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 433/838] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:16.011484 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f04179-18c9-45ea-b87e-2251ab7376b0 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:16.102228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:16.116935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00640b-cd4e-4b1e-b09e-22490ac8e821 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:16.117377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00640b-cd4e-4b1e-b09e-22490ac8e821 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:16.117756 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00640b-cd4e-4b1e-b09e-22490ac8e821 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:16.119531 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 434/839] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:16.124500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d59eae-6fd2-499b-b399-97765100a16d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:16.124785 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d59eae-6fd2-499b-b399-97765100a16d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:16.125069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d59eae-6fd2-499b-b399-97765100a16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:16.127911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f04179-18c9-45ea-b87e-2251ab7376b0 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:16.142508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f2d59eae-6fd2-499b-b399-97765100a16d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:16.143736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f2d59eae-6fd2-499b-b399-97765100a16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:16.165477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5532b5d-ec53-495e-988b-c6fdb4b2d397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:16.166900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5532b5d-ec53-495e-988b-c6fdb4b2d397 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:16.167386 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5532b5d-ec53-495e-988b-c6fdb4b2d397 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:16.168087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5532b5d-ec53-495e-988b-c6fdb4b2d397 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:16.178626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5532b5d-ec53-495e-988b-c6fdb4b2d397 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:16.182081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5532b5d-ec53-495e-988b-c6fdb4b2d397 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-a5532b5d-ec53-495e-988b-c6fdb4b2d397 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:16.202047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:16.203064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:16.204649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:16.204649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:16.204649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:16.204649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:16.204649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:16.204649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:16.204649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:16.204649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:16.204649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 10:22:16.204649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:16.205481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 406/840] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Jun 15 10:22:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:16.210383 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5532b5d-ec53-495e-988b-c6fdb4b2d397 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:16.221505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 435/841] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:16.246695 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d59eae-6fd2-499b-b399-97765100a16d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:16.263392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:16.363790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d59eae-6fd2-499b-b399-97765100a16d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:16.404719 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237558d-bd19-4b20-b98f-d27db219dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:16.405772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237558d-bd19-4b20-b98f-d27db219dcb9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:16.406133 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237558d-bd19-4b20-b98f-d27db219dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:16.406526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237558d-bd19-4b20-b98f-d27db219dcb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:16.419382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237558d-bd19-4b20-b98f-d27db219dcb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-0237558d-bd19-4b20-b98f-d27db219dcb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:16.427367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:16.428420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:16.429988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:16.429988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:16.429988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:16.429988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:16.429988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:16.429988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:16.429988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:16.429988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:16.429988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:16.429988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:16.429988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:16.429988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:16.429988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 436/842] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:22:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:16.435074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237558d-bd19-4b20-b98f-d27db219dcb9 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:16.473594 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5532b5d-ec53-495e-988b-c6fdb4b2d397 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:16.517019 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f483a-b661-486d-99cf-cf5b345b2a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:16.517965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f483a-b661-486d-99cf-cf5b345b2a69 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:16.518249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f483a-b661-486d-99cf-cf5b345b2a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:16.518525 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f483a-b661-486d-99cf-cf5b345b2a69 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:16.519717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f483a-b661-486d-99cf-cf5b345b2a69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:16.520309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f483a-b661-486d-99cf-cf5b345b2a69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:16.522079 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f483a-b661-486d-99cf-cf5b345b2a69 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:16.522671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:16.533011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:16.545111 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237558d-bd19-4b20-b98f-d27db219dcb9 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:16.547607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 407/843] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Jun 15 10:22:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:16.551551 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f483a-b661-486d-99cf-cf5b345b2a69 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:16.592307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbddd0-2740-474f-b8cf-ea6f881219a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:16.592987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbddd0-2740-474f-b8cf-ea6f881219a7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:16.593274 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbddd0-2740-474f-b8cf-ea6f881219a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:16.593550 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbddd0-2740-474f-b8cf-ea6f881219a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:16.594301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbddd0-2740-474f-b8cf-ea6f881219a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:16.594609 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbddd0-2740-474f-b8cf-ea6f881219a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:16.595999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbddd0-2740-474f-b8cf-ea6f881219a7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:16.607505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 437/844] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:22:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:16.613029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbddd0-2740-474f-b8cf-ea6f881219a7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:16.678512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f483a-b661-486d-99cf-cf5b345b2a69 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:16.721701 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd65797-82a8-444b-af39-e294faa720bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:16.722478 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd65797-82a8-444b-af39-e294faa720bc None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:16.722823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd65797-82a8-444b-af39-e294faa720bc None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:16.723559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd65797-82a8-444b-af39-e294faa720bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:16.745755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbddd0-2740-474f-b8cf-ea6f881219a7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:16.787143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c6150-6556-4cfe-9a94-f5b3593930c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:16.788963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c6150-6556-4cfe-9a94-f5b3593930c2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:16.789440 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c6150-6556-4cfe-9a94-f5b3593930c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:16.790012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c6150-6556-4cfe-9a94-f5b3593930c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:16.793509 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:16.798785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:16.806199 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c6150-6556-4cfe-9a94-f5b3593930c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:16.807479 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd65797-82a8-444b-af39-e294faa720bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:16.808116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c6150-6556-4cfe-9a94-f5b3593930c2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:16.809034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd65797-82a8-444b-af39-e294faa720bc None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-4f8c6150-6556-4cfe-9a94-f5b3593930c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:16.830873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:16.831990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:16.832939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:16.832939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:16.832939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:16.832939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:16.835809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 438/845] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:16.838521 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c6150-6556-4cfe-9a94-f5b3593930c2 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:16.929831 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 408/846] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:22:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 10:22:16.931259 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd65797-82a8-444b-af39-e294faa720bc None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:16.972069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c6150-6556-4cfe-9a94-f5b3593930c2 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:17.010443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cfde9-87d1-48ae-8123-efacfacbc707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:17.011571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cfde9-87d1-48ae-8123-efacfacbc707 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:17.012069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cfde9-87d1-48ae-8123-efacfacbc707 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:17.012581 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cfde9-87d1-48ae-8123-efacfacbc707 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:17.013541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cfde9-87d1-48ae-8123-efacfacbc707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:17.014069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cfde9-87d1-48ae-8123-efacfacbc707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:17.015707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cfde9-87d1-48ae-8123-efacfacbc707 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:17.035272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 439/847] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:17.036616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cfde9-87d1-48ae-8123-efacfacbc707 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:17.040999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:17.048329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd65797-82a8-444b-af39-e294faa720bc None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:17.087386 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db3ce3-ecdd-4a77-b1c1-1bc779868a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:17.088209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db3ce3-ecdd-4a77-b1c1-1bc779868a56 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:17.088605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db3ce3-ecdd-4a77-b1c1-1bc779868a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:17.088881 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db3ce3-ecdd-4a77-b1c1-1bc779868a56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:17.092029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:17.101091 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db3ce3-ecdd-4a77-b1c1-1bc779868a56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:17.102458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db3ce3-ecdd-4a77-b1c1-1bc779868a56 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-c1db3ce3-ecdd-4a77-b1c1-1bc779868a56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:17.120706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:17.121892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:17.122865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:17.122865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:17.122865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:17.122865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:17.122865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 409/848] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:17.123163 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c8e2a-e860-4ed6-ab6f-14eb5b617782 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:17.123866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c8e2a-e860-4ed6-ab6f-14eb5b617782 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:17.123866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c8e2a-e860-4ed6-ab6f-14eb5b617782 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:17.125222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 410/849] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:17.130793 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c8e2a-e860-4ed6-ab6f-14eb5b617782 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:17.154900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cfde9-87d1-48ae-8123-efacfacbc707 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:17.193196 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33a230-8357-4d9d-8160-cdb8d1b1608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:17.194280 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33a230-8357-4d9d-8160-cdb8d1b1608a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:17.195218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33a230-8357-4d9d-8160-cdb8d1b1608a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:17.195507 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33a230-8357-4d9d-8160-cdb8d1b1608a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:17.203353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33a230-8357-4d9d-8160-cdb8d1b1608a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:17.204820 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33a230-8357-4d9d-8160-cdb8d1b1608a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-7f33a230-8357-4d9d-8160-cdb8d1b1608a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:17.219783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:17.220768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:17.221827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:17.221827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:17.221827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:17.221827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:17.221827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:17.221827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:17.221827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:17.221827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:17.221827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 10:22:17.221827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:17.225243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 440/850] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:22:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:17.226364 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb522a01-d8ee-4a6b-ba68-71160fcf719f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:17.226650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb522a01-d8ee-4a6b-ba68-71160fcf719f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:17.226930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb522a01-d8ee-4a6b-ba68-71160fcf719f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:17.243233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-cb522a01-d8ee-4a6b-ba68-71160fcf719f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:17.244456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cb522a01-d8ee-4a6b-ba68-71160fcf719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:17.252829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c8e2a-e860-4ed6-ab6f-14eb5b617782 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:17.287608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea235a13-4b1e-48eb-a236-95ad98631495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:17.288440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235a13-4b1e-48eb-a236-95ad98631495 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:17.288816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235a13-4b1e-48eb-a236-95ad98631495 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:17.289202 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235a13-4b1e-48eb-a236-95ad98631495 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:17.290019 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea235a13-4b1e-48eb-a236-95ad98631495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:17.290323 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea235a13-4b1e-48eb-a236-95ad98631495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:17.291755 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea235a13-4b1e-48eb-a236-95ad98631495 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:17.307782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 411/851] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:17.307782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea235a13-4b1e-48eb-a236-95ad98631495 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:17.316237 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:17.327486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 441/852] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:17.327486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb522a01-d8ee-4a6b-ba68-71160fcf719f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:17.368362 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:17.413669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea235a13-4b1e-48eb-a236-95ad98631495 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:17.430577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb522a01-d8ee-4a6b-ba68-71160fcf719f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:17.450047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e95efe-9c0a-4440-971f-f7a1a00d6352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:17.450712 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e95efe-9c0a-4440-971f-f7a1a00d6352 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:17.450992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e95efe-9c0a-4440-971f-f7a1a00d6352 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:17.451380 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e95efe-9c0a-4440-971f-f7a1a00d6352 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:17.452524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e95efe-9c0a-4440-971f-f7a1a00d6352 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:17.452836 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e95efe-9c0a-4440-971f-f7a1a00d6352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:17.454375 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e95efe-9c0a-4440-971f-f7a1a00d6352 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:17.465107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e1ae4-53b5-42e6-9d2d-050efca1f8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:17.465888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e1ae4-53b5-42e6-9d2d-050efca1f8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:17.466165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e1ae4-53b5-42e6-9d2d-050efca1f8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:17.466430 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e1ae4-53b5-42e6-9d2d-050efca1f8c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:17.476494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 412/853] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Jun 15 10:22:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:17.476494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e95efe-9c0a-4440-971f-f7a1a00d6352 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:17.478474 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e1ae4-53b5-42e6-9d2d-050efca1f8c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:17.480046 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e1ae4-53b5-42e6-9d2d-050efca1f8c1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-7d9e1ae4-53b5-42e6-9d2d-050efca1f8c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:17.494307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:17.495259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:17.496244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:17.496244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:17.496244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:17.496244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:17.496244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:17.496244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:17.496244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:17.496244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:17.496244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 442/854] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:17.496244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e1ae4-53b5-42e6-9d2d-050efca1f8c1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:17.549177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:17.587101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e95efe-9c0a-4440-971f-f7a1a00d6352 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:17.596780 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:17.600938 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e1ae4-53b5-42e6-9d2d-050efca1f8c1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:17.623569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdeddf-7938-4a37-9a4b-ee87344cf01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:17.624362 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdeddf-7938-4a37-9a4b-ee87344cf01d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:17.624639 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdeddf-7938-4a37-9a4b-ee87344cf01d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:17.624907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdeddf-7938-4a37-9a4b-ee87344cf01d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:17.625548 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdeddf-7938-4a37-9a4b-ee87344cf01d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:17.626913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdeddf-7938-4a37-9a4b-ee87344cf01d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:17.638253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa13459-f7f6-48a6-9850-504ff6ebc42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-e6cdeddf-7938-4a37-9a4b-ee87344cf01d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:17.638486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:17.639517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:17.640441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 413/855] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:22:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:17.641794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdeddf-7938-4a37-9a4b-ee87344cf01d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:17.642578 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa13459-f7f6-48a6-9850-504ff6ebc42b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:17.642868 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa13459-f7f6-48a6-9850-504ff6ebc42b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:17.643146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa13459-f7f6-48a6-9850-504ff6ebc42b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:17.718517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa13459-f7f6-48a6-9850-504ff6ebc42b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:17.720085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa13459-f7f6-48a6-9850-504ff6ebc42b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:17.767876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdeddf-7938-4a37-9a4b-ee87344cf01d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:17.799378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:17.808841 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fd176-a6fd-4326-8ccb-0974d003caaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:17.809507 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fd176-a6fd-4326-8ccb-0974d003caaa None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:17.809794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fd176-a6fd-4326-8ccb-0974d003caaa None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:17.810065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fd176-a6fd-4326-8ccb-0974d003caaa None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:17.810861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fd176-a6fd-4326-8ccb-0974d003caaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:17.811169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fd176-a6fd-4326-8ccb-0974d003caaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:17.812643 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fd176-a6fd-4326-8ccb-0974d003caaa None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:17.816738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:17.823364 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 443/856] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:22:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:22:17.824211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa13459-f7f6-48a6-9850-504ff6ebc42b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:17.834958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 414/857] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:17.834958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fd176-a6fd-4326-8ccb-0974d003caaa None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:17.932294 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa13459-f7f6-48a6-9850-504ff6ebc42b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:17.939058 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fd176-a6fd-4326-8ccb-0974d003caaa None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:17.969718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa779d0-6848-4846-bae6-8388b22ec14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:17.970384 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa779d0-6848-4846-bae6-8388b22ec14e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:17.970664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa779d0-6848-4846-bae6-8388b22ec14e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:17.970944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa779d0-6848-4846-bae6-8388b22ec14e None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:17.971672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa779d0-6848-4846-bae6-8388b22ec14e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:17.971988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa779d0-6848-4846-bae6-8388b22ec14e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:17.973332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa779d0-6848-4846-bae6-8388b22ec14e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:17.974712 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3893737-0206-46dc-a123-72d28096589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:17.975542 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3893737-0206-46dc-a123-72d28096589b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:17.975820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3893737-0206-46dc-a123-72d28096589b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:17.976086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3893737-0206-46dc-a123-72d28096589b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:17.982672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 444/858] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:22:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:17.982672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa779d0-6848-4846-bae6-8388b22ec14e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:17.990812 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3893737-0206-46dc-a123-72d28096589b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:17.992658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3893737-0206-46dc-a123-72d28096589b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-f3893737-0206-46dc-a123-72d28096589b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:18.011668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:18.012602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:18.013514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:18.013514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:18.013514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:18.013514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:18.013514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 415/859] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:18.014395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3893737-0206-46dc-a123-72d28096589b None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:18.053431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:18.060526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:18.098619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa779d0-6848-4846-bae6-8388b22ec14e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:18.119111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3893737-0206-46dc-a123-72d28096589b None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:18.133293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0fe3a-abbc-4162-9b3f-b26c2349a2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:18.133938 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0fe3a-abbc-4162-9b3f-b26c2349a2ef None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:18.134218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0fe3a-abbc-4162-9b3f-b26c2349a2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:18.134493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0fe3a-abbc-4162-9b3f-b26c2349a2ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:18.135314 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0fe3a-abbc-4162-9b3f-b26c2349a2ef None admin] RBAC: Adding query filter params (role.id=f6ffe6f612824e50a23f0b06a16a1f91, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=d44268b4ab154bea8c958be5f3e30714) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:18.135650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0fe3a-abbc-4162-9b3f-b26c2349a2ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:18.137073 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0fe3a-abbc-4162-9b3f-b26c2349a2ef None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:18.142944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 445/860] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:22:17 2022] GET /identity/v3/role_assignments?user.id=d44268b4ab154bea8c958be5f3e30714&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=f6ffe6f612824e50a23f0b06a16a1f91 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:18.143674 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0fe3a-abbc-4162-9b3f-b26c2349a2ef None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:18.156119 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b2218-4fa3-4509-aad4-f5b371754861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:18.156802 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b2218-4fa3-4509-aad4-f5b371754861 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:18.157078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b2218-4fa3-4509-aad4-f5b371754861 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:18.157347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b2218-4fa3-4509-aad4-f5b371754861 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:18.158081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b2218-4fa3-4509-aad4-f5b371754861 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:18.158384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b2218-4fa3-4509-aad4-f5b371754861 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:18.159904 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b2218-4fa3-4509-aad4-f5b371754861 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:18.166068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 416/861] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:22:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:18.167309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73f96a-c214-4088-a25d-35fe9deeda92 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:18.167629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73f96a-c214-4088-a25d-35fe9deeda92 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:18.167902 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73f96a-c214-4088-a25d-35fe9deeda92 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:18.169534 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 417/862] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:18.175404 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74970b-8e9e-447d-bbc5-81e581203617 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:18.175757 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74970b-8e9e-447d-bbc5-81e581203617 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:18.176017 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74970b-8e9e-447d-bbc5-81e581203617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:18.196905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-2d74970b-8e9e-447d-bbc5-81e581203617 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:18.198716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-2d74970b-8e9e-447d-bbc5-81e581203617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:18.291958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 418/863] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:18.304712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0fe3a-abbc-4162-9b3f-b26c2349a2ef None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:18.310548 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74970b-8e9e-447d-bbc5-81e581203617 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:18.340817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:18.353417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29cb38-8451-4226-b768-532155f8b474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:18.354356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29cb38-8451-4226-b768-532155f8b474 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:18.354356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29cb38-8451-4226-b768-532155f8b474 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:18.354615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29cb38-8451-4226-b768-532155f8b474 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:18.355385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29cb38-8451-4226-b768-532155f8b474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:18.356403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29cb38-8451-4226-b768-532155f8b474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:18.357024 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29cb38-8451-4226-b768-532155f8b474 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:18.360064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:18.371277 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 446/864] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:18.377921 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29cb38-8451-4226-b768-532155f8b474 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:18.442830 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74970b-8e9e-447d-bbc5-81e581203617 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:18.490020 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6f06e-c5c7-4fd2-b87c-fc9127aa7b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:18.490834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6f06e-c5c7-4fd2-b87c-fc9127aa7b15 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:18.491160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6f06e-c5c7-4fd2-b87c-fc9127aa7b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:18.491422 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6f06e-c5c7-4fd2-b87c-fc9127aa7b15 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:18.492625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6f06e-c5c7-4fd2-b87c-fc9127aa7b15 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:18.494091 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6f06e-c5c7-4fd2-b87c-fc9127aa7b15 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:18.501369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29cb38-8451-4226-b768-532155f8b474 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-02d6f06e-c5c7-4fd2-b87c-fc9127aa7b15 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:18.507107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:18.508164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:18.509051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 419/865] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Jun 15 10:22:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:18.514117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6f06e-c5c7-4fd2-b87c-fc9127aa7b15 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:18.555259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80df6-50d4-48bd-bb3d-5625f4bac7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:18.555995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80df6-50d4-48bd-bb3d-5625f4bac7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:18.556282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80df6-50d4-48bd-bb3d-5625f4bac7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:18.556539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c80df6-50d4-48bd-bb3d-5625f4bac7d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:18.565460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80df6-50d4-48bd-bb3d-5625f4bac7d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:18.566900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c80df6-50d4-48bd-bb3d-5625f4bac7d8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-49c80df6-50d4-48bd-bb3d-5625f4bac7d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:18.580758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:18.581735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:18.582673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:18.582673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:18.582673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:18.582673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:18.582673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:18.582673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:18.582673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:18.582673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:18.582673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 447/866] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:18.587963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80df6-50d4-48bd-bb3d-5625f4bac7d8 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:18.646372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:18.650352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6f06e-c5c7-4fd2-b87c-fc9127aa7b15 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:18.667833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:18.692590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670c8ab-d0ab-4e8e-af77-13dae8a09b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:18.693251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670c8ab-d0ab-4e8e-af77-13dae8a09b58 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:18.693598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670c8ab-d0ab-4e8e-af77-13dae8a09b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:18.693902 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670c8ab-d0ab-4e8e-af77-13dae8a09b58 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:18.694635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670c8ab-d0ab-4e8e-af77-13dae8a09b58 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:18.694944 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670c8ab-d0ab-4e8e-af77-13dae8a09b58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:18.696384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670c8ab-d0ab-4e8e-af77-13dae8a09b58 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:18.705640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 420/867] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Jun 15 10:22:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:18.706662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670c8ab-d0ab-4e8e-af77-13dae8a09b58 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:18.723920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c80df6-50d4-48bd-bb3d-5625f4bac7d8 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:18.769200 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefa938-202a-4c95-b314-c8637b1da745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:18.770489 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefa938-202a-4c95-b314-c8637b1da745 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:18.771288 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefa938-202a-4c95-b314-c8637b1da745 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:18.772020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefa938-202a-4c95-b314-c8637b1da745 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:18.773027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefa938-202a-4c95-b314-c8637b1da745 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:18.773514 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefa938-202a-4c95-b314-c8637b1da745 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:18.775779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefa938-202a-4c95-b314-c8637b1da745 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:18.796518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 448/868] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:18.797394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefa938-202a-4c95-b314-c8637b1da745 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:18.823374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670c8ab-d0ab-4e8e-af77-13dae8a09b58 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:18.868112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e441199-cfc4-4eb8-88b6-4f582f966c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:18.868777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e441199-cfc4-4eb8-88b6-4f582f966c16 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:18.869055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e441199-cfc4-4eb8-88b6-4f582f966c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:18.869325 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e441199-cfc4-4eb8-88b6-4f582f966c16 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:18.870026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e441199-cfc4-4eb8-88b6-4f582f966c16 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:18.870327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e441199-cfc4-4eb8-88b6-4f582f966c16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:18.871741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e441199-cfc4-4eb8-88b6-4f582f966c16 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:18.876843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 421/869] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Jun 15 10:22:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:18.916974 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefa938-202a-4c95-b314-c8637b1da745 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:18.927925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:18.957974 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1066b1-d3a9-477d-9dc3-bbc3bbc73fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:18.958640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1066b1-d3a9-477d-9dc3-bbc3bbc73fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:18.958919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1066b1-d3a9-477d-9dc3-bbc3bbc73fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:18.959190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1066b1-d3a9-477d-9dc3-bbc3bbc73fb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:18.960076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1066b1-d3a9-477d-9dc3-bbc3bbc73fb8 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=7673b1c4f6184570b0039f9285bf1286) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:18.960926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1066b1-d3a9-477d-9dc3-bbc3bbc73fb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:18.962470 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1066b1-d3a9-477d-9dc3-bbc3bbc73fb8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:18.969870 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 449/870] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:22:18 2022] GET /identity/v3/role_assignments?user.id=7673b1c4f6184570b0039f9285bf1286&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=e1a2021d08e14daa969362b3d23face3 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:20.360930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889e899-72d4-4c36-a304-ac020215a228 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:20.361458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889e899-72d4-4c36-a304-ac020215a228 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:20.361458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889e899-72d4-4c36-a304-ac020215a228 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:20.363005 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 422/871] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:20.369265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88527d-cb85-45ff-ab27-8491903d6754 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:20.370147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88527d-cb85-45ff-ab27-8491903d6754 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:20.370640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88527d-cb85-45ff-ab27-8491903d6754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:20.391135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1f88527d-cb85-45ff-ab27-8491903d6754 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:20.392761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1f88527d-cb85-45ff-ab27-8491903d6754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:20.449895 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94588bf1-0a03-4dab-b0e7-7f4af4c763f8 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:20.450242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94588bf1-0a03-4dab-b0e7-7f4af4c763f8 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:20.450480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94588bf1-0a03-4dab-b0e7-7f4af4c763f8 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:20.452662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 423/872] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:22:20.457192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd32d06-df13-481f-8421-f65e1eb5d1b7 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:20.457475 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd32d06-df13-481f-8421-f65e1eb5d1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:20.457771 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd32d06-df13-481f-8421-f65e1eb5d1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:20.471802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 450/873] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:20.474607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-9dd32d06-df13-481f-8421-f65e1eb5d1b7 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:20.475835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-9dd32d06-df13-481f-8421-f65e1eb5d1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:20.491033 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88527d-cb85-45ff-ab27-8491903d6754 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:20.500445 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:20.546025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 424/874] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:20.569270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd32d06-df13-481f-8421-f65e1eb5d1b7 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:20.599819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:20.603209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88527d-cb85-45ff-ab27-8491903d6754 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:20.642266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ffbe1-d799-4214-b5b6-e82e19544e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:20.642940 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ffbe1-d799-4214-b5b6-e82e19544e02 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:20.643225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ffbe1-d799-4214-b5b6-e82e19544e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:20.643517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ffbe1-d799-4214-b5b6-e82e19544e02 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:20.644417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ffbe1-d799-4214-b5b6-e82e19544e02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:20.645787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ffbe1-d799-4214-b5b6-e82e19544e02 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:20.665961 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 451/875] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Jun 15 10:22:20 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:22:20.683891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd32d06-df13-481f-8421-f65e1eb5d1b7 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:20.729888 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b299dab-c2a8-4c3b-a5a4-f00fafe3e459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:20.730714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b299dab-c2a8-4c3b-a5a4-f00fafe3e459 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:20.730991 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b299dab-c2a8-4c3b-a5a4-f00fafe3e459 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:20.731258 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b299dab-c2a8-4c3b-a5a4-f00fafe3e459 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:20.743619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b299dab-c2a8-4c3b-a5a4-f00fafe3e459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-0b299dab-c2a8-4c3b-a5a4-f00fafe3e459 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:20.752356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:20.753400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:20.755144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:20.755144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:20.755144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:20.755144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:20.755144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:20.755144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:20.755144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:20.755144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:20.755144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:20.755144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:20.755144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 10:22:20.755144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:20.755144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 425/876] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Jun 15 10:22:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:20.760315 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ffbe1-d799-4214-b5b6-e82e19544e02 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:20.873405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ffbe1-d799-4214-b5b6-e82e19544e02 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:20.909077 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f35ea6-d4be-43ad-9930-ab92be08d35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:20.909661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f35ea6-d4be-43ad-9930-ab92be08d35e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:20.909942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f35ea6-d4be-43ad-9930-ab92be08d35e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:20.910212 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f35ea6-d4be-43ad-9930-ab92be08d35e None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:20.910951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f35ea6-d4be-43ad-9930-ab92be08d35e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:20.911255 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f35ea6-d4be-43ad-9930-ab92be08d35e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:20.912827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f35ea6-d4be-43ad-9930-ab92be08d35e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:20.921829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 452/877] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Jun 15 10:22:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:20.928552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b299dab-c2a8-4c3b-a5a4-f00fafe3e459 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:20.945670 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:21.036064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b299dab-c2a8-4c3b-a5a4-f00fafe3e459 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:21.052242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ea78-3616-44f5-a7c1-e9305a043c70 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:21.052546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ea78-3616-44f5-a7c1-e9305a043c70 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:21.052787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9ea78-3616-44f5-a7c1-e9305a043c70 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:21.054454 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 453/878] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:21.060796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7018ed-b0ea-4c62-97eb-3a6cbcd7739d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:21.061404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7018ed-b0ea-4c62-97eb-3a6cbcd7739d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:21.061887 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7018ed-b0ea-4c62-97eb-3a6cbcd7739d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:21.074892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84b55-4433-4e56-a233-416927113195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:21.076191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84b55-4433-4e56-a233-416927113195 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:21.076688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84b55-4433-4e56-a233-416927113195 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:21.077188 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84b55-4433-4e56-a233-416927113195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:21.084163 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-be7018ed-b0ea-4c62-97eb-3a6cbcd7739d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:21.086224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-be7018ed-b0ea-4c62-97eb-3a6cbcd7739d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:21.092415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84b55-4433-4e56-a233-416927113195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:21.093926 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84b55-4433-4e56-a233-416927113195 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:21.107796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-29e84b55-4433-4e56-a233-416927113195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:21.113578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:21.114959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:21.117171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:21.117171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:21.117171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:21.117171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:21.117171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 426/879] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:21.121657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84b55-4433-4e56-a233-416927113195 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:21.175698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 454/880] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:21 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:21.195264 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7018ed-b0ea-4c62-97eb-3a6cbcd7739d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:21.201883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:21.252491 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84b55-4433-4e56-a233-416927113195 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:21.293521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429d994-4b61-41e3-a739-1bf6c1483e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:21.294177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429d994-4b61-41e3-a739-1bf6c1483e4d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:21.294455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429d994-4b61-41e3-a739-1bf6c1483e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:21.294724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429d994-4b61-41e3-a739-1bf6c1483e4d None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:21.295442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429d994-4b61-41e3-a739-1bf6c1483e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:21.295763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429d994-4b61-41e3-a739-1bf6c1483e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:21.297124 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429d994-4b61-41e3-a739-1bf6c1483e4d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:21.311658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7018ed-b0ea-4c62-97eb-3a6cbcd7739d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:21.311832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 427/881] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:21.311832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245f8b9-12c8-4860-b4a9-2cb17a9dad79 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:21.311832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245f8b9-12c8-4860-b4a9-2cb17a9dad79 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:21.311832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245f8b9-12c8-4860-b4a9-2cb17a9dad79 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:21.312607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 428/882] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:21.315090 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245f8b9-12c8-4860-b4a9-2cb17a9dad79 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:21.348754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06506da7-b4e8-42b6-b871-738f376140c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:21.349684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06506da7-b4e8-42b6-b871-738f376140c7 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:21.349971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06506da7-b4e8-42b6-b871-738f376140c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:21.350252 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06506da7-b4e8-42b6-b871-738f376140c7 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:21.350992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06506da7-b4e8-42b6-b871-738f376140c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:21.352385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06506da7-b4e8-42b6-b871-738f376140c7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:21.368211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 455/883] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Jun 15 10:22:21 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:22:21.369768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ceca3-fe97-4f23-a6b1-a51166348cf2 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:21.370347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ceca3-fe97-4f23-a6b1-a51166348cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:21.370347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ceca3-fe97-4f23-a6b1-a51166348cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:21.396618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9e2ceca3-fe97-4f23-a6b1-a51166348cf2 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:21.398053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9e2ceca3-fe97-4f23-a6b1-a51166348cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:21.410029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:21.455007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245f8b9-12c8-4860-b4a9-2cb17a9dad79 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:21.485461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:21.500948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb092b9d-26b8-425f-85fe-dfd4817ba7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:21.502095 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb092b9d-26b8-425f-85fe-dfd4817ba7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:21.502587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb092b9d-26b8-425f-85fe-dfd4817ba7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:21.503100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb092b9d-26b8-425f-85fe-dfd4817ba7a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:21.512030 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb092b9d-26b8-425f-85fe-dfd4817ba7a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:21.519514 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 456/884] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:21.519701 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb092b9d-26b8-425f-85fe-dfd4817ba7a8 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:21.536520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ceca3-fe97-4f23-a6b1-a51166348cf2 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-eb092b9d-26b8-425f-85fe-dfd4817ba7a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:21.540788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:21.541781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:21.542778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:21.542778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:21.542778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:21.542778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:21.542778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:21.542778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:21.542778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:21.542778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:21.542778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 10:22:21.542778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:21.545975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 429/885] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Jun 15 10:22:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:21.551813 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb092b9d-26b8-425f-85fe-dfd4817ba7a8 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:21.656374 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ceca3-fe97-4f23-a6b1-a51166348cf2 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:21.685992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb092b9d-26b8-425f-85fe-dfd4817ba7a8 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:21.699926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6173766-21eb-4ad2-80d3-5a4c9e151faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:21.701089 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173766-21eb-4ad2-80d3-5a4c9e151faf None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:21.701435 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173766-21eb-4ad2-80d3-5a4c9e151faf None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:21.701782 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173766-21eb-4ad2-80d3-5a4c9e151faf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:21.702668 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6173766-21eb-4ad2-80d3-5a4c9e151faf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:21.704433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6173766-21eb-4ad2-80d3-5a4c9e151faf None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-e6173766-21eb-4ad2-80d3-5a4c9e151faf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:21.721638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:21.722711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:21.723677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:21.723677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:21.723677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:21.723677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:21.723677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:21.723677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:21.723677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:21.723677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:21.723677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:21.723677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:21.723677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:21.723677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:21.723677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:21.723677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:21.725313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 457/886] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Jun 15 10:22:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:21.731821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6173766-21eb-4ad2-80d3-5a4c9e151faf None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:21.732353 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7aa4d-fe92-4fcf-b42d-a11bc8b3597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:21.733273 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7aa4d-fe92-4fcf-b42d-a11bc8b3597e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:21.733765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7aa4d-fe92-4fcf-b42d-a11bc8b3597e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:21.734247 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7aa4d-fe92-4fcf-b42d-a11bc8b3597e None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:21.735287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7aa4d-fe92-4fcf-b42d-a11bc8b3597e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:21.735825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7aa4d-fe92-4fcf-b42d-a11bc8b3597e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:21.737480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7aa4d-fe92-4fcf-b42d-a11bc8b3597e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:21.741439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:21.759889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 430/887] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Jun 15 10:22:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:21.764930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7aa4d-fe92-4fcf-b42d-a11bc8b3597e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:21.811824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:21.854950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6173766-21eb-4ad2-80d3-5a4c9e151faf None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:21.877285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7aa4d-fe92-4fcf-b42d-a11bc8b3597e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:21.895030 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a89284-b5cd-4606-baee-abf5e8f49651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:21.895990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89284-b5cd-4606-baee-abf5e8f49651 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:21.896415 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89284-b5cd-4606-baee-abf5e8f49651 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:21.896862 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a89284-b5cd-4606-baee-abf5e8f49651 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:21.898254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a89284-b5cd-4606-baee-abf5e8f49651 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:21.898705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a89284-b5cd-4606-baee-abf5e8f49651 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:21.900333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a89284-b5cd-4606-baee-abf5e8f49651 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:21.910503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 458/888] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Jun 15 10:22:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:21.911899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a89284-b5cd-4606-baee-abf5e8f49651 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:21.915140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bc595-1ee3-4ff6-a35e-51e59c375807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:21.915939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bc595-1ee3-4ff6-a35e-51e59c375807 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:21.916320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bc595-1ee3-4ff6-a35e-51e59c375807 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:21.916692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bc595-1ee3-4ff6-a35e-51e59c375807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:21.988830 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bc595-1ee3-4ff6-a35e-51e59c375807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:21.989901 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bc595-1ee3-4ff6-a35e-51e59c375807 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:22.003839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:22.021367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a89284-b5cd-4606-baee-abf5e8f49651 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:22.032340 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:22.059801 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b17a3-5150-45ce-8064-0856b8284d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:22.060763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b17a3-5150-45ce-8064-0856b8284d05 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:22.061219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b17a3-5150-45ce-8064-0856b8284d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:22.061706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b17a3-5150-45ce-8064-0856b8284d05 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:22.062720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b17a3-5150-45ce-8064-0856b8284d05 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:22.063286 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b17a3-5150-45ce-8064-0856b8284d05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:22.064917 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b17a3-5150-45ce-8064-0856b8284d05 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:22.075989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 459/889] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Jun 15 10:22:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:22.098567 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 431/890] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:22:21 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 10:22:22.104928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b17a3-5150-45ce-8064-0856b8284d05 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:22.217391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b17a3-5150-45ce-8064-0856b8284d05 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:22.254956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d7084-7a1f-493c-9976-fb5258293dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:22.256114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d7084-7a1f-493c-9976-fb5258293dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:22.256616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d7084-7a1f-493c-9976-fb5258293dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:22.257127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d7084-7a1f-493c-9976-fb5258293dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:22.268160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d7084-7a1f-493c-9976-fb5258293dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:22.269988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d7084-7a1f-493c-9976-fb5258293dc3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:22.272076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-319d7084-7a1f-493c-9976-fb5258293dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:22.289044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:22.290007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:22.290948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:22.290948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:22.290948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:22.290948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:22.290948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 460/891] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:22.296129 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bc595-1ee3-4ff6-a35e-51e59c375807 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:22.401221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bc595-1ee3-4ff6-a35e-51e59c375807 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:22.436978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37ffc-ef42-465e-a692-4accdbe76dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:22.437987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37ffc-ef42-465e-a692-4accdbe76dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:22.438494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37ffc-ef42-465e-a692-4accdbe76dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:22.438992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37ffc-ef42-465e-a692-4accdbe76dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:22.439964 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a37ffc-ef42-465e-a692-4accdbe76dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:22.440477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a37ffc-ef42-465e-a692-4accdbe76dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:22.442049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a37ffc-ef42-465e-a692-4accdbe76dd0 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:22.452067 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:22.454682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 432/892] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:22.460463 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d7084-7a1f-493c-9976-fb5258293dc3 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:22.567976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d7084-7a1f-493c-9976-fb5258293dc3 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:22.604378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f6bdf-bb44-4b52-95cc-ce3ffa4a1c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:22.605626 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f6bdf-bb44-4b52-95cc-ce3ffa4a1c43 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:22.606158 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f6bdf-bb44-4b52-95cc-ce3ffa4a1c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:22.606630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f6bdf-bb44-4b52-95cc-ce3ffa4a1c43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:22.613778 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f6bdf-bb44-4b52-95cc-ce3ffa4a1c43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:22.615639 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f6bdf-bb44-4b52-95cc-ce3ffa4a1c43 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-956f6bdf-bb44-4b52-95cc-ce3ffa4a1c43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:22.630604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:22.631613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:22.633292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:22.633292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:22.633292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:22.633292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:22.633292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:22.633292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:22.633292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:22.633292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:22.635407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 461/893] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:22.641231 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37ffc-ef42-465e-a692-4accdbe76dd0 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:22.747498 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37ffc-ef42-465e-a692-4accdbe76dd0 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:22.782105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff39a3-2e74-4d66-8930-10697a808510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:22.782768 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff39a3-2e74-4d66-8930-10697a808510 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:22.783049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff39a3-2e74-4d66-8930-10697a808510 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:22.783320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff39a3-2e74-4d66-8930-10697a808510 None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:22.784127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff39a3-2e74-4d66-8930-10697a808510 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:22.784432 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff39a3-2e74-4d66-8930-10697a808510 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:22.785866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff39a3-2e74-4d66-8930-10697a808510 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:22.799743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 433/894] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:22.806120 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f6bdf-bb44-4b52-95cc-ce3ffa4a1c43 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:22.854775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:22.915254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f6bdf-bb44-4b52-95cc-ce3ffa4a1c43 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:22.953538 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3576ba1-d8e6-450b-836f-ea6723bd337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:22.954194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3576ba1-d8e6-450b-836f-ea6723bd337b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:22.954518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3576ba1-d8e6-450b-836f-ea6723bd337b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:22.954797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3576ba1-d8e6-450b-836f-ea6723bd337b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:22.955735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3576ba1-d8e6-450b-836f-ea6723bd337b None admin] RBAC: Adding query filter params (role.id=1f99b201b09e4780ba9ff6d5a33eb75d, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=d44268b4ab154bea8c958be5f3e30714) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:22.956181 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3576ba1-d8e6-450b-836f-ea6723bd337b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:22.957670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3576ba1-d8e6-450b-836f-ea6723bd337b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:22.963724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 462/895] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:22:22 2022] GET /identity/v3/role_assignments?user.id=d44268b4ab154bea8c958be5f3e30714&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=1f99b201b09e4780ba9ff6d5a33eb75d => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:22.978218 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae6130-85b5-4346-8823-4b0390d24918 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:22.978547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae6130-85b5-4346-8823-4b0390d24918 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:22.978761 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae6130-85b5-4346-8823-4b0390d24918 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:22.980438 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 434/896] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:22.989537 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d5772-add6-4fbe-bc32-00209269b3f9 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:22.989865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d5772-add6-4fbe-bc32-00209269b3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:22.990143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d5772-add6-4fbe-bc32-00209269b3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:23.009155 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a80d5772-add6-4fbe-bc32-00209269b3f9 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:23.010362 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a80d5772-add6-4fbe-bc32-00209269b3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:23.086587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 463/897] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:23.110409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae6130-85b5-4346-8823-4b0390d24918 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:23.178334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:23.224103 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae6130-85b5-4346-8823-4b0390d24918 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:23.261212 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69292596-daab-415e-8c78-01670ce896d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:23.262011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69292596-daab-415e-8c78-01670ce896d8 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:23.262268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69292596-daab-415e-8c78-01670ce896d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:23.262515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69292596-daab-415e-8c78-01670ce896d8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:23.263175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69292596-daab-415e-8c78-01670ce896d8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:23.264558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69292596-daab-415e-8c78-01670ce896d8 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-69292596-daab-415e-8c78-01670ce896d8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:23.276547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:23.280312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:23.283625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 435/898] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:22:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:23.292246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d5772-add6-4fbe-bc32-00209269b3f9 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:23.327874 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:23.388191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d5772-add6-4fbe-bc32-00209269b3f9 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:23.424015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102812ce-53a1-4125-a48a-611d6acb6488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:23.424673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102812ce-53a1-4125-a48a-611d6acb6488 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:23.425003 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102812ce-53a1-4125-a48a-611d6acb6488 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:23.425262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102812ce-53a1-4125-a48a-611d6acb6488 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:23.426071 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102812ce-53a1-4125-a48a-611d6acb6488 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:23.426371 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102812ce-53a1-4125-a48a-611d6acb6488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:23.427790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102812ce-53a1-4125-a48a-611d6acb6488 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:23.432843 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 464/899] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:22:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:23.438509 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69292596-daab-415e-8c78-01670ce896d8 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:23.541229 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69292596-daab-415e-8c78-01670ce896d8 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:23.571253 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:23.575553 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6580378-a694-4f65-b820-c73716348b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:23.576218 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580378-a694-4f65-b820-c73716348b08 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:23.576479 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580378-a694-4f65-b820-c73716348b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:23.576765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6580378-a694-4f65-b820-c73716348b08 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:23.577472 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6580378-a694-4f65-b820-c73716348b08 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:23.577776 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6580378-a694-4f65-b820-c73716348b08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:23.579147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6580378-a694-4f65-b820-c73716348b08 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:23.584900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 436/900] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:22:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:23.591118 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102812ce-53a1-4125-a48a-611d6acb6488 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:23.693337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102812ce-53a1-4125-a48a-611d6acb6488 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:23.695820 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:23.728717 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4aae8-c41e-4498-9b43-328056180414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:23.729370 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4aae8-c41e-4498-9b43-328056180414 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:23.729631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4aae8-c41e-4498-9b43-328056180414 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:23.729912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4aae8-c41e-4498-9b43-328056180414 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:23.730692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4aae8-c41e-4498-9b43-328056180414 None admin] RBAC: Adding query filter params (interface=public, service_id=6de2abc7a62c4f8caa9dad647ed6b3c8, region_id=RegionOne) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:23.731003 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4aae8-c41e-4498-9b43-328056180414 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:23.732372 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4aae8-c41e-4498-9b43-328056180414 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:23.737777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 465/901] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Jun 15 10:22:23 2022] GET /identity/v3/endpoints?service_id=6de2abc7a62c4f8caa9dad647ed6b3c8&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:23.743652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6580378-a694-4f65-b820-c73716348b08 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:23.848670 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6580378-a694-4f65-b820-c73716348b08 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:23.884636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23efc1-f3fb-4b3b-a282-ca8b1f98cefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:23.885309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23efc1-f3fb-4b3b-a282-ca8b1f98cefc None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:23.885587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23efc1-f3fb-4b3b-a282-ca8b1f98cefc None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:23.885835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23efc1-f3fb-4b3b-a282-ca8b1f98cefc None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:23.886537 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23efc1-f3fb-4b3b-a282-ca8b1f98cefc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:23.887953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23efc1-f3fb-4b3b-a282-ca8b1f98cefc None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:23.894849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 437/902] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Jun 15 10:22:23 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:22:23.989901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5204c7c-011a-4e32-baf7-61ce44151c6c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:23.990833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5204c7c-011a-4e32-baf7-61ce44151c6c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:23.991970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5204c7c-011a-4e32-baf7-61ce44151c6c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:23.995274 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 466/903] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:24.004364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4badd-ce43-49aa-ba81-e691d56f9f74 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:24.005317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4badd-ce43-49aa-ba81-e691d56f9f74 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:24.006083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4badd-ce43-49aa-ba81-e691d56f9f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:24.036056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-4da4badd-ce43-49aa-ba81-e691d56f9f74 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:24.038600 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4da4badd-ce43-49aa-ba81-e691d56f9f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:24.127213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:24.156510 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 438/904] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:24.180118 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5204c7c-011a-4e32-baf7-61ce44151c6c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:24.284046 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5204c7c-011a-4e32-baf7-61ce44151c6c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:24.319157 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78327274-45ee-45fc-98b3-127255e6e352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:24.320896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327274-45ee-45fc-98b3-127255e6e352 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:24.321457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327274-45ee-45fc-98b3-127255e6e352 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:24.321954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78327274-45ee-45fc-98b3-127255e6e352 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:24.322857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78327274-45ee-45fc-98b3-127255e6e352 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:24.324516 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78327274-45ee-45fc-98b3-127255e6e352 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-78327274-45ee-45fc-98b3-127255e6e352 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:24.337135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:24.338129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 10:22:24.339025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:24.342152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 467/905] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Jun 15 10:22:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:24.348243 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4badd-ce43-49aa-ba81-e691d56f9f74 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:24.450264 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4badd-ce43-49aa-ba81-e691d56f9f74 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:24.483853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216a328-d313-499e-bde4-cceb87733d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:24.484518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a328-d313-499e-bde4-cceb87733d3b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:24.484799 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a328-d313-499e-bde4-cceb87733d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:24.485075 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a328-d313-499e-bde4-cceb87733d3b None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:24.485780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216a328-d313-499e-bde4-cceb87733d3b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:24.486082 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216a328-d313-499e-bde4-cceb87733d3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:24.487453 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216a328-d313-499e-bde4-cceb87733d3b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:24.493384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 439/906] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Jun 15 10:22:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:24.499355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78327274-45ee-45fc-98b3-127255e6e352 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:24.531387 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:24.603000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78327274-45ee-45fc-98b3-127255e6e352 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:24.642143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d31b0-616a-4035-a1e6-f621088974b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:24.642896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d31b0-616a-4035-a1e6-f621088974b9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:24.643178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d31b0-616a-4035-a1e6-f621088974b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:24.643448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d31b0-616a-4035-a1e6-f621088974b9 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:24.644178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d31b0-616a-4035-a1e6-f621088974b9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:24.644482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d31b0-616a-4035-a1e6-f621088974b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:24.645836 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d31b0-616a-4035-a1e6-f621088974b9 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:24.651184 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 468/907] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Jun 15 10:22:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:24.662177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216a328-d313-499e-bde4-cceb87733d3b None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:24.672757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb540768-e5ca-4081-8ff5-8f988eae029c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:24.673462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb540768-e5ca-4081-8ff5-8f988eae029c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:24.673462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb540768-e5ca-4081-8ff5-8f988eae029c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:24.674779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 469/908] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:24.680152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321363-1ca3-4d16-8d36-ac1d317bdde2 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:24.680432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321363-1ca3-4d16-8d36-ac1d317bdde2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:24.680704 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321363-1ca3-4d16-8d36-ac1d317bdde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:24.697475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-29321363-1ca3-4d16-8d36-ac1d317bdde2 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:24.698653 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-29321363-1ca3-4d16-8d36-ac1d317bdde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:24.720409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:24.775718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 470/909] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:24.778535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216a328-d313-499e-bde4-cceb87733d3b None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:24.790904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29321363-1ca3-4d16-8d36-ac1d317bdde2 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:24.817303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51845fc3-01d1-49b9-a82e-4bfa82ee0d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:24.818442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51845fc3-01d1-49b9-a82e-4bfa82ee0d7a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:24.818942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51845fc3-01d1-49b9-a82e-4bfa82ee0d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:24.819482 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51845fc3-01d1-49b9-a82e-4bfa82ee0d7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:24.820818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:24.821149 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51845fc3-01d1-49b9-a82e-4bfa82ee0d7a None admin] RBAC: Adding query filter params (interface=public, service_id=5ce0cd22acde406b982bb4bbd1dd6022, region_id=RegionOne) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:24.822306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51845fc3-01d1-49b9-a82e-4bfa82ee0d7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:24.824147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51845fc3-01d1-49b9-a82e-4bfa82ee0d7a None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:24.833320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 440/910] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Jun 15 10:22:24 2022] GET /identity/v3/endpoints?service_id=5ce0cd22acde406b982bb4bbd1dd6022&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:24.839331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51845fc3-01d1-49b9-a82e-4bfa82ee0d7a None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:24.903816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29321363-1ca3-4d16-8d36-ac1d317bdde2 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:24.941336 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63e828-af77-4a98-bde4-1a4caf01501c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:24.942119 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63e828-af77-4a98-bde4-1a4caf01501c None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:24.942399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63e828-af77-4a98-bde4-1a4caf01501c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:24.942673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63e828-af77-4a98-bde4-1a4caf01501c None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:24.943384 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63e828-af77-4a98-bde4-1a4caf01501c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:24.944828 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63e828-af77-4a98-bde4-1a4caf01501c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:24.963505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 471/911] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Jun 15 10:22:24 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:22:24.983011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51845fc3-01d1-49b9-a82e-4bfa82ee0d7a None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:24.996135 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:25.031407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de980524-bb17-4dfc-af23-0703538f02ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:25.032121 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de980524-bb17-4dfc-af23-0703538f02ef None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:25.032398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de980524-bb17-4dfc-af23-0703538f02ef None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:25.032669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de980524-bb17-4dfc-af23-0703538f02ef None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:25.033358 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de980524-bb17-4dfc-af23-0703538f02ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:25.034733 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de980524-bb17-4dfc-af23-0703538f02ef None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:25.042309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 441/912] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Jun 15 10:22:24 2022] GET /identity/v3/services => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:22:25.224667 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f7d88-9cdf-4157-a1c2-8911748f5807 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:25.225022 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f7d88-9cdf-4157-a1c2-8911748f5807 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:25.225217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f7d88-9cdf-4157-a1c2-8911748f5807 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:25.227195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 472/913] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:25.232407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbee86-c230-4ce2-b605-091fe43f1c75 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:25.232941 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbee86-c230-4ce2-b605-091fe43f1c75 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:25.233438 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbee86-c230-4ce2-b605-091fe43f1c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:25.257579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-2cbbee86-c230-4ce2-b605-091fe43f1c75 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:25.259113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-2cbbee86-c230-4ce2-b605-091fe43f1c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:25.330847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 442/914] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:25.353414 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f7d88-9cdf-4157-a1c2-8911748f5807 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:25.442627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:25.460627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f7d88-9cdf-4157-a1c2-8911748f5807 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:25.496702 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac3cef-3a0d-48df-8c78-bc96fac7882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:25.497427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac3cef-3a0d-48df-8c78-bc96fac7882a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:25.497704 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac3cef-3a0d-48df-8c78-bc96fac7882a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:25.497973 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac3cef-3a0d-48df-8c78-bc96fac7882a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:25.508527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac3cef-3a0d-48df-8c78-bc96fac7882a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-93ac3cef-3a0d-48df-8c78-bc96fac7882a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:25.516716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:25.517735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:25.518637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:25.518637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:25.518637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:25.518637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:25.518637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:25.518637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:25.518637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:25.518637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:25.518637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:25.518637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:25.518637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 10:22:25.518637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:25.523088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 473/915] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Jun 15 10:22:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:25.524484 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbee86-c230-4ce2-b605-091fe43f1c75 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:25.631864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:25.635802 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbee86-c230-4ce2-b605-091fe43f1c75 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:25.683171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e824863-b1da-4e19-b322-a06c175a1c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:25.684200 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e824863-b1da-4e19-b322-a06c175a1c93 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:25.684711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e824863-b1da-4e19-b322-a06c175a1c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:25.685198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e824863-b1da-4e19-b322-a06c175a1c93 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:25.686166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e824863-b1da-4e19-b322-a06c175a1c93 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:25.686677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e824863-b1da-4e19-b322-a06c175a1c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:25.688272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e824863-b1da-4e19-b322-a06c175a1c93 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:25.697395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 443/916] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Jun 15 10:22:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:25.705447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac3cef-3a0d-48df-8c78-bc96fac7882a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:25.809269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac3cef-3a0d-48df-8c78-bc96fac7882a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:25.847610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc3d91-66d3-474b-9299-4d4ee3ff2eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:25.848771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc3d91-66d3-474b-9299-4d4ee3ff2eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:25.849281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc3d91-66d3-474b-9299-4d4ee3ff2eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:25.849753 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc3d91-66d3-474b-9299-4d4ee3ff2eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:25.862198 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc3d91-66d3-474b-9299-4d4ee3ff2eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:25.864038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc3d91-66d3-474b-9299-4d4ee3ff2eb4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:25.871305 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-c2dc3d91-66d3-474b-9299-4d4ee3ff2eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:25.883354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:25.884322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:25.885253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:25.885253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:25.885253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:25.885253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:25.887488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 474/917] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:25.892913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e824863-b1da-4e19-b322-a06c175a1c93 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:25.999481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e824863-b1da-4e19-b322-a06c175a1c93 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:26.033887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb706cee-9efa-4db9-95f1-caa7b987bd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:26.034553 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb706cee-9efa-4db9-95f1-caa7b987bd7f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:26.034836 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb706cee-9efa-4db9-95f1-caa7b987bd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:26.035112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb706cee-9efa-4db9-95f1-caa7b987bd7f None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:26.035867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb706cee-9efa-4db9-95f1-caa7b987bd7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:26.036176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb706cee-9efa-4db9-95f1-caa7b987bd7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:26.037590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb706cee-9efa-4db9-95f1-caa7b987bd7f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:26.051879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 444/918] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:26.060776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc3d91-66d3-474b-9299-4d4ee3ff2eb4 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:26.117786 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03ecbf-97e0-4792-b588-bacdcded5e8c None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:26.118117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03ecbf-97e0-4792-b588-bacdcded5e8c None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:26.118340 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03ecbf-97e0-4792-b588-bacdcded5e8c None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:26.120789 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 445/919] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:26.125679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51763a9e-dad9-4e5a-9c77-720a2be492eb None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:26.125970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51763a9e-dad9-4e5a-9c77-720a2be492eb None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:26.126246 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51763a9e-dad9-4e5a-9c77-720a2be492eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:26.143360 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-51763a9e-dad9-4e5a-9c77-720a2be492eb None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:26.144582 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-51763a9e-dad9-4e5a-9c77-720a2be492eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:26.163923 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:26.174107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc3d91-66d3-474b-9299-4d4ee3ff2eb4 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:26.212144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3f56c-fae6-4ba4-943a-6d098cce9cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:26.213063 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3f56c-fae6-4ba4-943a-6d098cce9cea None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:26.213348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3f56c-fae6-4ba4-943a-6d098cce9cea None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:26.213626 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3f56c-fae6-4ba4-943a-6d098cce9cea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:26.221582 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3f56c-fae6-4ba4-943a-6d098cce9cea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:26.223317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3f56c-fae6-4ba4-943a-6d098cce9cea None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:26.223875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 446/920] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-27e3f56c-fae6-4ba4-943a-6d098cce9cea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:26.238128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:26.239363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:26.240607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:26.240607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:26.240607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:26.240607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:26.240607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:26.240607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:26.240607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:26.240607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:26.240607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 10:22:26.240607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:26.242845 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 475/921] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Jun 15 10:22:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:26.244062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51763a9e-dad9-4e5a-9c77-720a2be492eb None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:26.245791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3f56c-fae6-4ba4-943a-6d098cce9cea None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:26.332056 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:26.351642 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51763a9e-dad9-4e5a-9c77-720a2be492eb None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:26.362988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3f56c-fae6-4ba4-943a-6d098cce9cea None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:26.390579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51f561-c75f-4317-9cfa-7de1ba30209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:26.391652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51f561-c75f-4317-9cfa-7de1ba30209b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:26.392087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51f561-c75f-4317-9cfa-7de1ba30209b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:26.392482 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51f561-c75f-4317-9cfa-7de1ba30209b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:26.393240 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51f561-c75f-4317-9cfa-7de1ba30209b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:26.394923 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51f561-c75f-4317-9cfa-7de1ba30209b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:26.406474 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63642e8d-bc22-46ee-959c-8b6f308087de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:26.407128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63642e8d-bc22-46ee-959c-8b6f308087de None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:26.407405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63642e8d-bc22-46ee-959c-8b6f308087de None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:26.407706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63642e8d-bc22-46ee-959c-8b6f308087de None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:26.408538 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63642e8d-bc22-46ee-959c-8b6f308087de None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-0f51f561-c75f-4317-9cfa-7de1ba30209b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:26.408759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:26.409951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:26.411595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:26.411595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:26.411595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:26.411595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:26.411595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:26.411595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:26.411595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:26.411595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:26.411595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:26.411595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:26.411595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:26.411595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:26.411595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 10:22:26.411595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:26.413355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63642e8d-bc22-46ee-959c-8b6f308087de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:26.413355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63642e8d-bc22-46ee-959c-8b6f308087de None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:26.419485 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 447/922] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:22:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:26.419485 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51f561-c75f-4317-9cfa-7de1ba30209b None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:26.430509 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 476/923] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Jun 15 10:22:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:26.437525 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63642e8d-bc22-46ee-959c-8b6f308087de None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:26.445163 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:26.558143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51f561-c75f-4317-9cfa-7de1ba30209b None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:26.559262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63642e8d-bc22-46ee-959c-8b6f308087de None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:26.576871 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:26.595509 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d14e63-d632-4c89-8492-ffff33b9a686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:26.596434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d14e63-d632-4c89-8492-ffff33b9a686 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:26.596721 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d14e63-d632-4c89-8492-ffff33b9a686 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:26.596997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d14e63-d632-4c89-8492-ffff33b9a686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:26.600558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b668f-ece4-4c05-bcc1-5785df743f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:26.602018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b668f-ece4-4c05-bcc1-5785df743f75 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:26.602564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b668f-ece4-4c05-bcc1-5785df743f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:26.603065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b668f-ece4-4c05-bcc1-5785df743f75 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:26.604011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b668f-ece4-4c05-bcc1-5785df743f75 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:26.604518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b668f-ece4-4c05-bcc1-5785df743f75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:26.606129 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b668f-ece4-4c05-bcc1-5785df743f75 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:26.608525 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d14e63-d632-4c89-8492-ffff33b9a686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:26.609979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d14e63-d632-4c89-8492-ffff33b9a686 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:26.612421 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 448/924] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:22:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:26.617942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b668f-ece4-4c05-bcc1-5785df743f75 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-80d14e63-d632-4c89-8492-ffff33b9a686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:26.637560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:26.638520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:26.639448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:26.639448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:26.639448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:26.639448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:26.645356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 477/925] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:26.647091 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d14e63-d632-4c89-8492-ffff33b9a686 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:26.744385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:26.768561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b668f-ece4-4c05-bcc1-5785df743f75 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:26.789941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d14e63-d632-4c89-8492-ffff33b9a686 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:26.811389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe65f19-2fd9-4b8a-93e5-3c1b314562ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:26.812198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe65f19-2fd9-4b8a-93e5-3c1b314562ef None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:26.812638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe65f19-2fd9-4b8a-93e5-3c1b314562ef None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:26.812934 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe65f19-2fd9-4b8a-93e5-3c1b314562ef None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:26.813652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe65f19-2fd9-4b8a-93e5-3c1b314562ef None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:26.814496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe65f19-2fd9-4b8a-93e5-3c1b314562ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:26.816859 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe65f19-2fd9-4b8a-93e5-3c1b314562ef None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:26.827585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 449/926] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Jun 15 10:22:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:26.831657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe65f19-2fd9-4b8a-93e5-3c1b314562ef None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:26.841409 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064918c4-d261-4b96-90ba-d4e5e68de20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:26.842085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064918c4-d261-4b96-90ba-d4e5e68de20a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:26.842372 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064918c4-d261-4b96-90ba-d4e5e68de20a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:26.842652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064918c4-d261-4b96-90ba-d4e5e68de20a None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:26.843730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064918c4-d261-4b96-90ba-d4e5e68de20a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:26.843730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064918c4-d261-4b96-90ba-d4e5e68de20a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:26.845088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064918c4-d261-4b96-90ba-d4e5e68de20a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:26.862389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 478/927] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:26.864864 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064918c4-d261-4b96-90ba-d4e5e68de20a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:26.904977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:26.962039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe65f19-2fd9-4b8a-93e5-3c1b314562ef None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:27.000952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60973d39-bad6-4e43-ac72-71ea5b215abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:27.001362 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60973d39-bad6-4e43-ac72-71ea5b215abe None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:27.001651 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60973d39-bad6-4e43-ac72-71ea5b215abe None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:27.001928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60973d39-bad6-4e43-ac72-71ea5b215abe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:27.002666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60973d39-bad6-4e43-ac72-71ea5b215abe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:27.004073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60973d39-bad6-4e43-ac72-71ea5b215abe None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:27.012774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064918c4-d261-4b96-90ba-d4e5e68de20a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:27.021797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:27.035806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 450/928] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Jun 15 10:22:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:22:27.063804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1539ba-4277-4d09-8c04-3c8e3ec0c8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:27.064987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1539ba-4277-4d09-8c04-3c8e3ec0c8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:27.065487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1539ba-4277-4d09-8c04-3c8e3ec0c8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:27.065956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1539ba-4277-4d09-8c04-3c8e3ec0c8a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:27.074511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1539ba-4277-4d09-8c04-3c8e3ec0c8a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:27.076605 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1539ba-4277-4d09-8c04-3c8e3ec0c8a3 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-6b1539ba-4277-4d09-8c04-3c8e3ec0c8a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:27.092811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:27.093848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:27.094825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:27.094825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:27.094825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:27.094825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:27.094825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:27.094825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:27.094825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:27.094825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:27.102592 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 479/929] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:27.104355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60973d39-bad6-4e43-ac72-71ea5b215abe None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:27.215983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2248f-5982-4ec1-b1e2-a3817be769f3 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:27.216583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2248f-5982-4ec1-b1e2-a3817be769f3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:27.217076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2248f-5982-4ec1-b1e2-a3817be769f3 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:27.218912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 480/930] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:22:27.225489 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475348d-2c5c-4730-9ad8-6e20d3a46a6b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:27.226332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475348d-2c5c-4730-9ad8-6e20d3a46a6b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:27.226598 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475348d-2c5c-4730-9ad8-6e20d3a46a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:27.226975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60973d39-bad6-4e43-ac72-71ea5b215abe None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:27.246150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3475348d-2c5c-4730-9ad8-6e20d3a46a6b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:27.247624 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3475348d-2c5c-4730-9ad8-6e20d3a46a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:27.281215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e89f6-cf7c-4fd0-8637-2453d2ef060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:27.281890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e89f6-cf7c-4fd0-8637-2453d2ef060b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:27.282436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e89f6-cf7c-4fd0-8637-2453d2ef060b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:27.282709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e89f6-cf7c-4fd0-8637-2453d2ef060b None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:27.283896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e89f6-cf7c-4fd0-8637-2453d2ef060b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:27.284216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e89f6-cf7c-4fd0-8637-2453d2ef060b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:27.286019 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e89f6-cf7c-4fd0-8637-2453d2ef060b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:27.310381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 451/931] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:27.311976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e89f6-cf7c-4fd0-8637-2453d2ef060b None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:27.348316 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 481/932] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:27.365125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af084-fa36-4c15-acc0-b9f25b0b442c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:27.365449 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af084-fa36-4c15-acc0-b9f25b0b442c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:27.365686 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af084-fa36-4c15-acc0-b9f25b0b442c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:27.371218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 482/933] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:22:27.372462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd92e4-a78a-4392-8a30-617afe12b28b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:27.372752 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd92e4-a78a-4392-8a30-617afe12b28b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:27.373030 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd92e4-a78a-4392-8a30-617afe12b28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:27.386777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:27.390048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-61fd92e4-a78a-4392-8a30-617afe12b28b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:27.391241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-61fd92e4-a78a-4392-8a30-617afe12b28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:27.402389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:27.429948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e89f6-cf7c-4fd0-8637-2453d2ef060b None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:27.467589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97595a9-c560-4079-9aae-76d43355df39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:27.467589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97595a9-c560-4079-9aae-76d43355df39 None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:27.467867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97595a9-c560-4079-9aae-76d43355df39 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:27.468099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97595a9-c560-4079-9aae-76d43355df39 None admin] PATH_INFO: `/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/d44268b4ab154bea8c958be5f3e30714/roles/1f99b201b09e4780ba9ff6d5a33eb75d` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:27.470262 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97595a9-c560-4079-9aae-76d43355df39 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2eb230241340229293ca1aa5585cdc, user_id=d44268b4ab154bea8c958be5f3e30714, role_id=1f99b201b09e4780ba9ff6d5a33eb75d)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:27.471715 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97595a9-c560-4079-9aae-76d43355df39 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:27.474119 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 483/934] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:27.476687 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd92e4-a78a-4392-8a30-617afe12b28b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:27.487869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 452/935] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:22:27 2022] PUT /identity/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/d44268b4ab154bea8c958be5f3e30714/roles/1f99b201b09e4780ba9ff6d5a33eb75d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:22:27.488757 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97595a9-c560-4079-9aae-76d43355df39 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:27.594829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd92e4-a78a-4392-8a30-617afe12b28b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:27.599212 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97595a9-c560-4079-9aae-76d43355df39 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:27.621336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:27.644247 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8df58f-8ab7-4449-8bbf-4a2ee510397a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:27.645092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8df58f-8ab7-4449-8bbf-4a2ee510397a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:27.645369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8df58f-8ab7-4449-8bbf-4a2ee510397a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:27.645638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8df58f-8ab7-4449-8bbf-4a2ee510397a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:27.646299 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8df58f-8ab7-4449-8bbf-4a2ee510397a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:27.648338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8df58f-8ab7-4449-8bbf-4a2ee510397a None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:27.652230 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310047c-71a7-480a-993d-ff6007853000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:27.653341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310047c-71a7-480a-993d-ff6007853000 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:27.653845 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310047c-71a7-480a-993d-ff6007853000 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:27.654342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310047c-71a7-480a-993d-ff6007853000 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:27.655191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310047c-71a7-480a-993d-ff6007853000 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:27.656804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310047c-71a7-480a-993d-ff6007853000 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-0a8df58f-8ab7-4449-8bbf-4a2ee510397a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:27.667914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:27.668940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:27.669842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 453/936] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Jun 15 10:22:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-1310047c-71a7-480a-993d-ff6007853000 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:27.674808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:27.675883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:27.676772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:27.676772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:27.676772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:27.676772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:27.676772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:27.676772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:27.676772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:27.676772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:27.676772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:27.676772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:27.676772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:27.676772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:27.676772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:27.676772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:27.679710 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8df58f-8ab7-4449-8bbf-4a2ee510397a None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:27.679864 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 484/937] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Jun 15 10:22:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:27.684791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310047c-71a7-480a-993d-ff6007853000 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:27.697560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:27.799444 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310047c-71a7-480a-993d-ff6007853000 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:27.831824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8df58f-8ab7-4449-8bbf-4a2ee510397a None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:27.835696 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9560cf3-c47c-4654-ac7d-46fd1b2c0d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:27.836526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9560cf3-c47c-4654-ac7d-46fd1b2c0d77 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:27.836892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9560cf3-c47c-4654-ac7d-46fd1b2c0d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:27.837231 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9560cf3-c47c-4654-ac7d-46fd1b2c0d77 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:27.838009 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9560cf3-c47c-4654-ac7d-46fd1b2c0d77 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:27.838378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9560cf3-c47c-4654-ac7d-46fd1b2c0d77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:27.839831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9560cf3-c47c-4654-ac7d-46fd1b2c0d77 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:27.846115 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 485/938] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Jun 15 10:22:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:27.851713 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9560cf3-c47c-4654-ac7d-46fd1b2c0d77 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:27.874410 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafeac86-ef0b-4111-a743-476ced601158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:27.875084 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeac86-ef0b-4111-a743-476ced601158 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:27.875720 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeac86-ef0b-4111-a743-476ced601158 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:27.876020 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafeac86-ef0b-4111-a743-476ced601158 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:27.876742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafeac86-ef0b-4111-a743-476ced601158 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:27.877047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafeac86-ef0b-4111-a743-476ced601158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:27.878428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafeac86-ef0b-4111-a743-476ced601158 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:27.886792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 454/939] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Jun 15 10:22:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:27.892328 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafeac86-ef0b-4111-a743-476ced601158 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:27.944281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:27.953896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:27.993973 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9560cf3-c47c-4654-ac7d-46fd1b2c0d77 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:28.014621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafeac86-ef0b-4111-a743-476ced601158 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:28.036098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d79139-126f-449a-809f-bf190842ea1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:28.037249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d79139-126f-449a-809f-bf190842ea1c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:28.037666 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d79139-126f-449a-809f-bf190842ea1c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:28.038040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d79139-126f-449a-809f-bf190842ea1c None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:28.039028 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d79139-126f-449a-809f-bf190842ea1c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:28.039433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d79139-126f-449a-809f-bf190842ea1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:28.041521 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d79139-126f-449a-809f-bf190842ea1c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:28.048563 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 486/940] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Jun 15 10:22:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:28.050964 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14af11-2169-4aa9-8acf-09155d1d52b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:28.051817 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14af11-2169-4aa9-8acf-09155d1d52b9 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:28.052237 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14af11-2169-4aa9-8acf-09155d1d52b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:28.052714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14af11-2169-4aa9-8acf-09155d1d52b9 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:28.054322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14af11-2169-4aa9-8acf-09155d1d52b9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:28.054445 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d79139-126f-449a-809f-bf190842ea1c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:28.054877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14af11-2169-4aa9-8acf-09155d1d52b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:28.056399 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14af11-2169-4aa9-8acf-09155d1d52b9 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:28.068364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 455/941] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Jun 15 10:22:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:28.074395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14af11-2169-4aa9-8acf-09155d1d52b9 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:28.173919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14af11-2169-4aa9-8acf-09155d1d52b9 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:28.189516 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d79139-126f-449a-809f-bf190842ea1c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:28.191811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:28.210373 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dae232-2016-4da8-b4a4-bfaf12b094d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:28.211123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dae232-2016-4da8-b4a4-bfaf12b094d4 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:28.211418 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dae232-2016-4da8-b4a4-bfaf12b094d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:28.211742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dae232-2016-4da8-b4a4-bfaf12b094d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:28.212699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dae232-2016-4da8-b4a4-bfaf12b094d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:28.213957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dae232-2016-4da8-b4a4-bfaf12b094d4 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:28.234996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593d95a-e61c-44f5-b01c-57c802eed136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:28.236469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593d95a-e61c-44f5-b01c-57c802eed136 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:28.236956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593d95a-e61c-44f5-b01c-57c802eed136 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:28.237439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593d95a-e61c-44f5-b01c-57c802eed136 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:28.238433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593d95a-e61c-44f5-b01c-57c802eed136 None admin] RBAC: Adding query filter params (interface=public, service_id=3f0f5bd2d6c14682ad91376610dcb074, region_id=RegionOne) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:28.238937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593d95a-e61c-44f5-b01c-57c802eed136 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:28.240655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593d95a-e61c-44f5-b01c-57c802eed136 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:28.247705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 456/942] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Jun 15 10:22:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:22:28.253008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 487/943] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Jun 15 10:22:28 2022] GET /identity/v3/endpoints?service_id=3f0f5bd2d6c14682ad91376610dcb074&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:28.254162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:28.259761 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dae232-2016-4da8-b4a4-bfaf12b094d4 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:28.383340 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dae232-2016-4da8-b4a4-bfaf12b094d4 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:28.421016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec24fa-b52f-4d25-923b-d2e3b95b4241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:28.421678 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec24fa-b52f-4d25-923b-d2e3b95b4241 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:28.421958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec24fa-b52f-4d25-923b-d2e3b95b4241 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:28.422227 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec24fa-b52f-4d25-923b-d2e3b95b4241 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:28.422902 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec24fa-b52f-4d25-923b-d2e3b95b4241 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:28.424298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec24fa-b52f-4d25-923b-d2e3b95b4241 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:28.430573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 457/944] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Jun 15 10:22:28 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:22:29.297415 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437272d-d804-4511-a1a9-6207b81c17c0 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:29.297941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437272d-d804-4511-a1a9-6207b81c17c0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:29.297941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437272d-d804-4511-a1a9-6207b81c17c0 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:29.299703 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 488/945] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:29.306830 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a04de6-7dd6-498f-80f5-e70c5c44a068 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:29.307427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a04de6-7dd6-498f-80f5-e70c5c44a068 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:29.307732 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a04de6-7dd6-498f-80f5-e70c5c44a068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:29.330787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-a4a04de6-7dd6-498f-80f5-e70c5c44a068 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:29.332025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a4a04de6-7dd6-498f-80f5-e70c5c44a068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:29.355279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:29.406142 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 458/946] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:29.429816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437272d-d804-4511-a1a9-6207b81c17c0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:29.537216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437272d-d804-4511-a1a9-6207b81c17c0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:29.574922 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a428b2d-488e-4b8b-b80a-4b7b0684a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:29.575937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a428b2d-488e-4b8b-b80a-4b7b0684a392 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:29.576419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a428b2d-488e-4b8b-b80a-4b7b0684a392 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:29.576889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a428b2d-488e-4b8b-b80a-4b7b0684a392 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:29.577794 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a428b2d-488e-4b8b-b80a-4b7b0684a392 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:29.579718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a428b2d-488e-4b8b-b80a-4b7b0684a392 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:29.581313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: WARNING keystone.server.flask.common [None req-2a428b2d-488e-4b8b-b80a-4b7b0684a392 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 15 10:22:29.601340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.sql.core [None req-2a428b2d-488e-4b8b-b80a-4b7b0684a392 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 10:22:29.601340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 15 10:22:29.601340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [parameters: {'id': 'e6b5861e2c7545b9ab64f084e33bba53', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 15 10:22:29.601340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80117) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 10:22:29.621562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-2a428b2d-488e-4b8b-b80a-4b7b0684a392 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e6b5861e2c7545b9ab64f084e33bba53.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e6b5861e2c7545b9ab64f084e33bba53. Jun 15 10:22:29.621562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:29.621562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 10:22:29.621562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 10:22:29.621562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 10:22:29.621562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 10:22:29.621562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 10:22:29.621562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 10:22:29.621562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 10:22:29.621562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application conn.query(q) Jun 15 10:22:29.621562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 10:22:29.621562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 10:22:29.621562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application result.read() Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 15 10:22:29.622468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application next(self.gen) Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application yield resource Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application next(self.gen) Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise self.value Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application session.commit() Jun 15 10:22:29.623447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self.session.flush() Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application compat.raise_( Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 10:22:29.624894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 10:22:29.625829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application conn.query(q) Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application result.read() Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 10:22:29.626652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [parameters: {'id': 'e6b5861e2c7545b9ab64f084e33bba53', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:29.629145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:29.631027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:29.633795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:29.633795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 15 10:22:29.633795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 15 10:22:29.633795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:29.633795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:29.633795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 15 10:22:29.633795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 15 10:22:29.633795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e6b5861e2c7545b9ab64f084e33bba53. Jun 15 10:22:29.633795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:29.641434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 489/947] 10.222.0.50 () {60 vars in 1140 bytes} [Wed Jun 15 10:22:29 2022] POST /identity/v3/projects => generated 262 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:29.643009 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a04de6-7dd6-498f-80f5-e70c5c44a068 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:29.666956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f927a6f-77b5-45e1-82e6-8793daa30e8c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:29.667299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f927a6f-77b5-45e1-82e6-8793daa30e8c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:29.667558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f927a6f-77b5-45e1-82e6-8793daa30e8c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:29.675841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 490/948] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:29.677098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1133bab-ba34-42a5-a8f1-d3f883f21cec None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:29.677343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1133bab-ba34-42a5-a8f1-d3f883f21cec None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:29.677618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1133bab-ba34-42a5-a8f1-d3f883f21cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:29.697013 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a1133bab-ba34-42a5-a8f1-d3f883f21cec None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:29.699617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a1133bab-ba34-42a5-a8f1-d3f883f21cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:29.762964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:29.768268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a04de6-7dd6-498f-80f5-e70c5c44a068 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:29.771634 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 491/949] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:29.791669 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1133bab-ba34-42a5-a8f1-d3f883f21cec None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:29.810123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3571c-aef6-435d-bbb1-b7f4e518d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:29.811439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3571c-aef6-435d-bbb1-b7f4e518d968 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:29.812116 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3571c-aef6-435d-bbb1-b7f4e518d968 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:29.812893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3571c-aef6-435d-bbb1-b7f4e518d968 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:29.821608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3571c-aef6-435d-bbb1-b7f4e518d968 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:29.823921 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a3571c-aef6-435d-bbb1-b7f4e518d968 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-47a3571c-aef6-435d-bbb1-b7f4e518d968 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:29.841570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:29.842549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:29.843500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:29.843500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:29.843500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:29.843500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:29.843500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:29.843500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:29.843500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:29.843500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:29.850027 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 459/950] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:29.852093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3571c-aef6-435d-bbb1-b7f4e518d968 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:29.872579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:29.901042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1133bab-ba34-42a5-a8f1-d3f883f21cec None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:29.937900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0e04-85bb-4a31-aa49-258042871b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:29.938914 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0e04-85bb-4a31-aa49-258042871b0b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:29.939296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0e04-85bb-4a31-aa49-258042871b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:29.939708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f0e04-85bb-4a31-aa49-258042871b0b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:29.951408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f0e04-85bb-4a31-aa49-258042871b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:29.959697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3571c-aef6-435d-bbb1-b7f4e518d968 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-252f0e04-85bb-4a31-aa49-258042871b0b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:29.959830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:29.961054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:29.961969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:29.961969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:29.961969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:29.961969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:29.961969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:29.961969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:29.961969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:29.961969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:29.961969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:29.961969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:29.961969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 10:22:29.961969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:29.967305 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 492/951] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Jun 15 10:22:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:29.968387 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0e04-85bb-4a31-aa49-258042871b0b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:30.000761 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e739458-73af-417c-9a29-7be64bf22939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:30.001755 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e739458-73af-417c-9a29-7be64bf22939 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:30.002316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e739458-73af-417c-9a29-7be64bf22939 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:30.002768 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e739458-73af-417c-9a29-7be64bf22939 None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:30.003821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e739458-73af-417c-9a29-7be64bf22939 None admin] RBAC: Adding query filter params (name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:30.004310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e739458-73af-417c-9a29-7be64bf22939 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:30.005916 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e739458-73af-417c-9a29-7be64bf22939 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:30.019486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:30.031609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 460/952] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Jun 15 10:22:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:30.084494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f0e04-85bb-4a31-aa49-258042871b0b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:30.125834 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020ace9-5a1f-4f32-9a09-bf05e1bbcc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:30.126428 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020ace9-5a1f-4f32-9a09-bf05e1bbcc3b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:30.126711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020ace9-5a1f-4f32-9a09-bf05e1bbcc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:30.126989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020ace9-5a1f-4f32-9a09-bf05e1bbcc3b None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:30.127780 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020ace9-5a1f-4f32-9a09-bf05e1bbcc3b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:30.128088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020ace9-5a1f-4f32-9a09-bf05e1bbcc3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:30.129660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020ace9-5a1f-4f32-9a09-bf05e1bbcc3b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:30.143907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 493/953] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Jun 15 10:22:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:30.145596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e739458-73af-417c-9a29-7be64bf22939 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:30.234113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:30.259002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e739458-73af-417c-9a29-7be64bf22939 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:30.294656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ea78c-1233-4dc7-a9b0-c101b091a4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:30.295597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ea78c-1233-4dc7-a9b0-c101b091a4ad None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:30.295883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ea78c-1233-4dc7-a9b0-c101b091a4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:30.296170 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ea78c-1233-4dc7-a9b0-c101b091a4ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:30.307380 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ea78c-1233-4dc7-a9b0-c101b091a4ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:30.309031 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ea78c-1233-4dc7-a9b0-c101b091a4ad None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-596ea78c-1233-4dc7-a9b0-c101b091a4ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:30.327669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:30.328698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:30.330280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:30.330280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:30.330280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:30.330280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:30.330280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 461/954] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:30.335083 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020ace9-5a1f-4f32-9a09-bf05e1bbcc3b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:30.453588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020ace9-5a1f-4f32-9a09-bf05e1bbcc3b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:30.463073 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:30.471604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f69e-ee2e-434d-b109-431321567a22 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:30.472032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f69e-ee2e-434d-b109-431321567a22 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:30.472316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f69e-ee2e-434d-b109-431321567a22 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:30.474454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 462/955] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:30.479398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947069eb-841e-4f08-85f2-ab74d6ac3486 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:30.479757 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947069eb-841e-4f08-85f2-ab74d6ac3486 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:30.480016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947069eb-841e-4f08-85f2-ab74d6ac3486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:30.494509 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8aa61-7149-4137-abb2-7e9985e0886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:30.495177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8aa61-7149-4137-abb2-7e9985e0886d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:30.495595 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8aa61-7149-4137-abb2-7e9985e0886d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:30.495876 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8aa61-7149-4137-abb2-7e9985e0886d None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:30.496662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8aa61-7149-4137-abb2-7e9985e0886d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:30.496970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8aa61-7149-4137-abb2-7e9985e0886d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:30.498390 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8aa61-7149-4137-abb2-7e9985e0886d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:30.500699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-947069eb-841e-4f08-85f2-ab74d6ac3486 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:30.502558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-947069eb-841e-4f08-85f2-ab74d6ac3486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:30.512213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 494/956] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:30.517696 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8aa61-7149-4137-abb2-7e9985e0886d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:30.586275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 463/957] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:30.608399 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947069eb-841e-4f08-85f2-ab74d6ac3486 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:30.634256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8aa61-7149-4137-abb2-7e9985e0886d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:30.681486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a72809-12cb-48c1-b4ea-0670c9dc55a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:30.682600 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a72809-12cb-48c1-b4ea-0670c9dc55a4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:30.682878 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a72809-12cb-48c1-b4ea-0670c9dc55a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:30.683155 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a72809-12cb-48c1-b4ea-0670c9dc55a4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:30.684438 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:30.691093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a72809-12cb-48c1-b4ea-0670c9dc55a4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:30.692642 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a72809-12cb-48c1-b4ea-0670c9dc55a4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-68a72809-12cb-48c1-b4ea-0670c9dc55a4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:30.707935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:30.708975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:30.710057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:30.710057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:30.710057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:30.710057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:30.710057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:30.710057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:30.710057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:30.710057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:30.710057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 10:22:30.710057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:30.710057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 495/958] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Jun 15 10:22:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:30.710723 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63bbbb-cd82-43d4-8795-cad044e3ed94 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:30.711407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63bbbb-cd82-43d4-8795-cad044e3ed94 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:30.711407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63bbbb-cd82-43d4-8795-cad044e3ed94 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:30.712638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 496/959] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:30.717369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63bbbb-cd82-43d4-8795-cad044e3ed94 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:30.734711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947069eb-841e-4f08-85f2-ab74d6ac3486 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:30.749251 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:30.772686 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5a926-1d97-4e92-b115-4019832e04b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:30.773540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5a926-1d97-4e92-b115-4019832e04b5 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:30.773823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5a926-1d97-4e92-b115-4019832e04b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:30.774156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5a926-1d97-4e92-b115-4019832e04b5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:30.774810 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5a926-1d97-4e92-b115-4019832e04b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:30.776279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5a926-1d97-4e92-b115-4019832e04b5 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-49c5a926-1d97-4e92-b115-4019832e04b5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:30.787929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:30.789741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:30.790756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 464/960] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:30.791822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7444d8-a127-4886-bdaf-c55366f37f25 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:30.791822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7444d8-a127-4886-bdaf-c55366f37f25 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:30.791822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7444d8-a127-4886-bdaf-c55366f37f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:30.808735 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-3d7444d8-a127-4886-bdaf-c55366f37f25 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:30.809934 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-3d7444d8-a127-4886-bdaf-c55366f37f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:30.834334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63bbbb-cd82-43d4-8795-cad044e3ed94 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:30.871413 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a93508-8a99-4c77-80fc-861496fd853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:30.872115 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a93508-8a99-4c77-80fc-861496fd853c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:30.872394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a93508-8a99-4c77-80fc-861496fd853c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:30.872673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a93508-8a99-4c77-80fc-861496fd853c None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:30.873528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a93508-8a99-4c77-80fc-861496fd853c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:30.873837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a93508-8a99-4c77-80fc-861496fd853c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:30.875260 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a93508-8a99-4c77-80fc-861496fd853c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:30.883521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 465/961] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:30.883521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7444d8-a127-4886-bdaf-c55366f37f25 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:30.909246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 497/962] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Jun 15 10:22:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:30.909246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a93508-8a99-4c77-80fc-861496fd853c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:30.952021 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:31.004388 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:31.005429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7444d8-a127-4886-bdaf-c55366f37f25 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:31.019569 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a93508-8a99-4c77-80fc-861496fd853c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:31.044038 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38ec84-2a97-424c-b22c-b3d19400bdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:31.044748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38ec84-2a97-424c-b22c-b3d19400bdb5 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:31.045033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38ec84-2a97-424c-b22c-b3d19400bdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:31.045318 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38ec84-2a97-424c-b22c-b3d19400bdb5 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:31.046008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38ec84-2a97-424c-b22c-b3d19400bdb5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:31.046316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38ec84-2a97-424c-b22c-b3d19400bdb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:31.047717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38ec84-2a97-424c-b22c-b3d19400bdb5 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:31.057074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 466/963] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Jun 15 10:22:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:31.057074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38ec84-2a97-424c-b22c-b3d19400bdb5 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:31.060080 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb93fa-74cd-4c2e-9d1b-cc9977ee128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:31.060884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb93fa-74cd-4c2e-9d1b-cc9977ee128f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:31.061168 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb93fa-74cd-4c2e-9d1b-cc9977ee128f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:31.061448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb93fa-74cd-4c2e-9d1b-cc9977ee128f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:31.062100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb93fa-74cd-4c2e-9d1b-cc9977ee128f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:31.063460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb93fa-74cd-4c2e-9d1b-cc9977ee128f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-74eb93fa-74cd-4c2e-9d1b-cc9977ee128f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:31.075851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:31.076929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:31.083130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 498/964] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Jun 15 10:22:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:31.084184 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb93fa-74cd-4c2e-9d1b-cc9977ee128f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:31.167140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38ec84-2a97-424c-b22c-b3d19400bdb5 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:31.185514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:31.188951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb93fa-74cd-4c2e-9d1b-cc9977ee128f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:31.202985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad59174-33b7-4598-bf21-bfb37c6d7210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:31.203671 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad59174-33b7-4598-bf21-bfb37c6d7210 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:31.203957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad59174-33b7-4598-bf21-bfb37c6d7210 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:31.204237 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad59174-33b7-4598-bf21-bfb37c6d7210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:31.227121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdcca2-0320-4dab-bf93-4c0d46aadb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:31.228130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdcca2-0320-4dab-bf93-4c0d46aadb61 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:31.228624 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdcca2-0320-4dab-bf93-4c0d46aadb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:31.229091 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdcca2-0320-4dab-bf93-4c0d46aadb61 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:31.230160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdcca2-0320-4dab-bf93-4c0d46aadb61 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:31.230798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdcca2-0320-4dab-bf93-4c0d46aadb61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:31.232232 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdcca2-0320-4dab-bf93-4c0d46aadb61 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:31.247495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 499/965] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Jun 15 10:22:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:31.247495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdcca2-0320-4dab-bf93-4c0d46aadb61 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:31.265084 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:31.300254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad59174-33b7-4598-bf21-bfb37c6d7210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:31.302824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad59174-33b7-4598-bf21-bfb37c6d7210 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:31.376519 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdcca2-0320-4dab-bf93-4c0d46aadb61 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:31.416920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea138e-3255-40da-857d-956e3efc33e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:31.417632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea138e-3255-40da-857d-956e3efc33e5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:31.417913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea138e-3255-40da-857d-956e3efc33e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:31.418191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea138e-3255-40da-857d-956e3efc33e5 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:31.418956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea138e-3255-40da-857d-956e3efc33e5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:31.419261 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea138e-3255-40da-857d-956e3efc33e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:31.420736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea138e-3255-40da-857d-956e3efc33e5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:31.430864 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 500/966] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Jun 15 10:22:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:31.432280 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea138e-3255-40da-857d-956e3efc33e5 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:31.434456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 467/967] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:22:31 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:22:31.439714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad59174-33b7-4598-bf21-bfb37c6d7210 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:31.461593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:31.526888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:31.554311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad59174-33b7-4598-bf21-bfb37c6d7210 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:31.559488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea138e-3255-40da-857d-956e3efc33e5 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:31.589645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea3e28-0933-4d0d-b0cd-4736b873e3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:31.590535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea3e28-0933-4d0d-b0cd-4736b873e3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:31.590891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea3e28-0933-4d0d-b0cd-4736b873e3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:31.591239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea3e28-0933-4d0d-b0cd-4736b873e3d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:31.602289 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea3e28-0933-4d0d-b0cd-4736b873e3d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:31.603865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea3e28-0933-4d0d-b0cd-4736b873e3d7 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:31.604640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68bd98-7d36-4446-8889-024ed13e7b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:31.606018 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68bd98-7d36-4446-8889-024ed13e7b29 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:31.606865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68bd98-7d36-4446-8889-024ed13e7b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:31.607321 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68bd98-7d36-4446-8889-024ed13e7b29 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:31.608210 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68bd98-7d36-4446-8889-024ed13e7b29 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:31.608691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68bd98-7d36-4446-8889-024ed13e7b29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:31.610224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68bd98-7d36-4446-8889-024ed13e7b29 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:31.622312 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 501/968] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Jun 15 10:22:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:31.623714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68bd98-7d36-4446-8889-024ed13e7b29 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-a9ea3e28-0933-4d0d-b0cd-4736b873e3d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:31.624585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:31.625563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:31.626751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:31.626751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:31.626751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:31.626751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:31.630664 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 468/969] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:31.631626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea3e28-0933-4d0d-b0cd-4736b873e3d7 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:31.715978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:31.749552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea3e28-0933-4d0d-b0cd-4736b873e3d7 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:31.774018 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68bd98-7d36-4446-8889-024ed13e7b29 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:31.795531 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279d5db-1e28-4c45-bf99-a30eb86ad7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:31.797008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279d5db-1e28-4c45-bf99-a30eb86ad7ed None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:31.797750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279d5db-1e28-4c45-bf99-a30eb86ad7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:31.798215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279d5db-1e28-4c45-bf99-a30eb86ad7ed None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:31.799420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279d5db-1e28-4c45-bf99-a30eb86ad7ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:31.800334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279d5db-1e28-4c45-bf99-a30eb86ad7ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:31.802408 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279d5db-1e28-4c45-bf99-a30eb86ad7ed None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:31.811170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176ab92-44f6-4cd5-8c02-f9677707edf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:31.811879 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176ab92-44f6-4cd5-8c02-f9677707edf4 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:31.812347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176ab92-44f6-4cd5-8c02-f9677707edf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:31.812633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176ab92-44f6-4cd5-8c02-f9677707edf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:31.813375 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176ab92-44f6-4cd5-8c02-f9677707edf4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:31.814742 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176ab92-44f6-4cd5-8c02-f9677707edf4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:31.817233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 469/970] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:31.822270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279d5db-1e28-4c45-bf99-a30eb86ad7ed None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:31.838993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:31.856123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 502/971] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Jun 15 10:22:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:22:31.951457 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279d5db-1e28-4c45-bf99-a30eb86ad7ed None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:31.983825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:31.996997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3baf-b260-4949-bc0a-ed8f7a224b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:31.997806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3baf-b260-4949-bc0a-ed8f7a224b1d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:31.998091 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3baf-b260-4949-bc0a-ed8f7a224b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:31.998370 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3baf-b260-4949-bc0a-ed8f7a224b1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:32.006165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc3baf-b260-4949-bc0a-ed8f7a224b1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:32.008220 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc3baf-b260-4949-bc0a-ed8f7a224b1d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-28bc3baf-b260-4949-bc0a-ed8f7a224b1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:32.025172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:32.026176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:32.027592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:32.027592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:32.027592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:32.027592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:32.027592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:32.027592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:32.027592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:32.027592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:32.027592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 470/972] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:32.032651 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176ab92-44f6-4cd5-8c02-f9677707edf4 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:32.145888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176ab92-44f6-4cd5-8c02-f9677707edf4 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:32.183823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07bb87-d2d1-4777-8214-e38e46bf2798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:32.184488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07bb87-d2d1-4777-8214-e38e46bf2798 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:32.184772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07bb87-d2d1-4777-8214-e38e46bf2798 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:32.185049 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07bb87-d2d1-4777-8214-e38e46bf2798 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:32.185839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07bb87-d2d1-4777-8214-e38e46bf2798 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:32.186150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07bb87-d2d1-4777-8214-e38e46bf2798 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:32.187621 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07bb87-d2d1-4777-8214-e38e46bf2798 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:32.201326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 503/973] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:32.207227 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3baf-b260-4949-bc0a-ed8f7a224b1d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:32.320224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3baf-b260-4949-bc0a-ed8f7a224b1d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:32.350414 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26183e81-3d9c-4003-83c7-036da6907e51 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:32.350744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26183e81-3d9c-4003-83c7-036da6907e51 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:32.350998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26183e81-3d9c-4003-83c7-036da6907e51 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:32.352651 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 504/974] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:22:32.356955 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1258495-a87e-4eae-8e90-531bf61eb0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:32.357458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c96c4-344c-4cb5-8e97-0dad0cb43cff None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:32.357590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1258495-a87e-4eae-8e90-531bf61eb0fe None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:32.357802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c96c4-344c-4cb5-8e97-0dad0cb43cff None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:32.357917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1258495-a87e-4eae-8e90-531bf61eb0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:32.357997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c96c4-344c-4cb5-8e97-0dad0cb43cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:32.358158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1258495-a87e-4eae-8e90-531bf61eb0fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:32.358981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1258495-a87e-4eae-8e90-531bf61eb0fe None admin] RBAC: Adding query filter params (role.id=1f99b201b09e4780ba9ff6d5a33eb75d, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=d44268b4ab154bea8c958be5f3e30714) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:32.359294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1258495-a87e-4eae-8e90-531bf61eb0fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:32.360769 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1258495-a87e-4eae-8e90-531bf61eb0fe None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:32.369274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 471/975] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:22:32 2022] GET /identity/v3/role_assignments?user.id=d44268b4ab154bea8c958be5f3e30714&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=1f99b201b09e4780ba9ff6d5a33eb75d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:32.377949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a33c96c4-344c-4cb5-8e97-0dad0cb43cff None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:32.379180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a33c96c4-344c-4cb5-8e97-0dad0cb43cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:32.444870 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:32.467896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 505/976] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:32.486540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1258495-a87e-4eae-8e90-531bf61eb0fe None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:32.540609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:32.592944 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1258495-a87e-4eae-8e90-531bf61eb0fe None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:32.629682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c10865-933f-42a1-bb2d-dc2437ea12eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:32.630350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c10865-933f-42a1-bb2d-dc2437ea12eb None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:32.630637 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c10865-933f-42a1-bb2d-dc2437ea12eb None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:32.630913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c10865-933f-42a1-bb2d-dc2437ea12eb None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:32.631663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c10865-933f-42a1-bb2d-dc2437ea12eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:32.633705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c10865-933f-42a1-bb2d-dc2437ea12eb None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:32.635033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: WARNING keystone.server.flask.common [None req-61c10865-933f-42a1-bb2d-dc2437ea12eb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 15 10:22:32.648954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.sql.core [None req-61c10865-933f-42a1-bb2d-dc2437ea12eb None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 10:22:32.648954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 15 10:22:32.648954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [parameters: {'user_id': '59c6cb3051724fe5b2158b541c9940d0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 15 10:22:32.648954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80118) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-61c10865-933f-42a1-bb2d-dc2437ea12eb None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application conn.query(q) Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application result.read() Jun 15 10:22:32.657191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 10:22:32.658216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application next(self.gen) Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application yield resource Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application next(self.gen) Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise self.value Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application session.commit() Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 10:22:32.664112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self.session.flush() Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application compat.raise_( Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 10:22:32.665086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 10:22:32.666117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application conn.query(q) Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application result.read() Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 10:22:32.667086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [parameters: {'user_id': '59c6cb3051724fe5b2158b541c9940d0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:32.673011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 15 10:22:32.675665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 15 10:22:32.677011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 15 10:22:32.677011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 15 10:22:32.677011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 10:22:32.677011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 10:22:32.677011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 15 10:22:32.677011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:32.677011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 472/977] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Jun 15 10:22:32 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:32.677537 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c96c4-344c-4cb5-8e97-0dad0cb43cff None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:32.768887 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c96c4-344c-4cb5-8e97-0dad0cb43cff None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:32.803648 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf3b5f-8d42-4524-b744-d0e5ba674b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:32.805004 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf3b5f-8d42-4524-b744-d0e5ba674b3e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:32.805285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf3b5f-8d42-4524-b744-d0e5ba674b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:32.805559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf3b5f-8d42-4524-b744-d0e5ba674b3e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:32.812870 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf3b5f-8d42-4524-b744-d0e5ba674b3e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:32.814307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf3b5f-8d42-4524-b744-d0e5ba674b3e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-eacf3b5f-8d42-4524-b744-d0e5ba674b3e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:32.828632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:32.830952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:32.833365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:32.833365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:32.833365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:32.833365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:32.833365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:32.833365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:32.833365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:32.833365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:32.833365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 10:22:32.833365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:32.833365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 506/978] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:22:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:32.839491 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c10865-933f-42a1-bb2d-dc2437ea12eb None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:32.939339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c10865-933f-42a1-bb2d-dc2437ea12eb None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:32.952640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:32.976902 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a638cdc-317f-413f-876c-7b1ec0a604d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:32.977771 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a638cdc-317f-413f-876c-7b1ec0a604d2 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:32.978337 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a638cdc-317f-413f-876c-7b1ec0a604d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:32.978615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a638cdc-317f-413f-876c-7b1ec0a604d2 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:32.979422 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a638cdc-317f-413f-876c-7b1ec0a604d2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:32.979768 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a638cdc-317f-413f-876c-7b1ec0a604d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:32.981406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a638cdc-317f-413f-876c-7b1ec0a604d2 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:33.021180 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 473/979] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Jun 15 10:22:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:33.572497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fca84-b308-48f6-a5af-d85c252ee93a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:33.573074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fca84-b308-48f6-a5af-d85c252ee93a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:33.573074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fca84-b308-48f6-a5af-d85c252ee93a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:33.574777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 507/980] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:33.580604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c29a6-7fa4-4c18-a831-f89315b96e49 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:33.581173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c29a6-7fa4-4c18-a831-f89315b96e49 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:33.581173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c29a6-7fa4-4c18-a831-f89315b96e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:33.598935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-3c1c29a6-7fa4-4c18-a831-f89315b96e49 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:33.600491 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-3c1c29a6-7fa4-4c18-a831-f89315b96e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:33.675938 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 474/981] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:33.698791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fca84-b308-48f6-a5af-d85c252ee93a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:33.751770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:33.804685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fca84-b308-48f6-a5af-d85c252ee93a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:33.838160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d63a0-f06f-41a1-aa56-35e3ea83282d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:33.838984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d63a0-f06f-41a1-aa56-35e3ea83282d None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:33.839267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d63a0-f06f-41a1-aa56-35e3ea83282d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:33.839566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d63a0-f06f-41a1-aa56-35e3ea83282d None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:33.840289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d63a0-f06f-41a1-aa56-35e3ea83282d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:33.841650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d63a0-f06f-41a1-aa56-35e3ea83282d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:33.856159 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 508/982] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Jun 15 10:22:33 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:22:34.133727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e149e3-2268-4625-a3ff-bfbc55522a06 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:34.134033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e149e3-2268-4625-a3ff-bfbc55522a06 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:34.134200 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e149e3-2268-4625-a3ff-bfbc55522a06 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:34.135651 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 475/983] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:34.140858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b71c6-1e68-4db3-86ec-39c390028c85 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:34.141156 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b71c6-1e68-4db3-86ec-39c390028c85 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:34.141435 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b71c6-1e68-4db3-86ec-39c390028c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:34.158065 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c75b71c6-1e68-4db3-86ec-39c390028c85 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:34.159252 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c75b71c6-1e68-4db3-86ec-39c390028c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:34.242870 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 509/984] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:34.265106 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e149e3-2268-4625-a3ff-bfbc55522a06 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:34.364093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:34.369978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e149e3-2268-4625-a3ff-bfbc55522a06 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:34.403976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bee35b-ec69-4acc-824c-be226c1f39fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:34.404713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bee35b-ec69-4acc-824c-be226c1f39fa None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:34.404997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bee35b-ec69-4acc-824c-be226c1f39fa None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:34.405278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bee35b-ec69-4acc-824c-be226c1f39fa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:34.406003 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bee35b-ec69-4acc-824c-be226c1f39fa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:34.407382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bee35b-ec69-4acc-824c-be226c1f39fa None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-97bee35b-ec69-4acc-824c-be226c1f39fa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:34.420210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:34.421216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:34.422107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:34.422107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:34.422107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:34.422107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:34.422107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:34.422107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:34.422107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:34.422107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:34.422107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:34.422107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:34.422107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:34.422107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:34.422107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:34.422107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:34.423687 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 476/985] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Jun 15 10:22:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:34.427389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b71c6-1e68-4db3-86ec-39c390028c85 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:34.461886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:34.530406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b71c6-1e68-4db3-86ec-39c390028c85 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:34.565386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e51f0-7633-470b-a600-1d5ff952b1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:34.566084 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e51f0-7633-470b-a600-1d5ff952b1ac None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:34.566368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e51f0-7633-470b-a600-1d5ff952b1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:34.566645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e51f0-7633-470b-a600-1d5ff952b1ac None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:34.567379 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e51f0-7633-470b-a600-1d5ff952b1ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:34.567723 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e51f0-7633-470b-a600-1d5ff952b1ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:34.569154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e51f0-7633-470b-a600-1d5ff952b1ac None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:34.579719 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 510/986] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Jun 15 10:22:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:34.581914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bee35b-ec69-4acc-824c-be226c1f39fa None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:34.635448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8685e92-fe90-4af1-af46-ff926517c293 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:34.635906 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8685e92-fe90-4af1-af46-ff926517c293 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:34.636279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8685e92-fe90-4af1-af46-ff926517c293 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:34.637883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 511/987] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:22:34.642641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969f18-857d-473a-b50c-5ebab41ff061 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:34.642950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969f18-857d-473a-b50c-5ebab41ff061 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:34.643216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969f18-857d-473a-b50c-5ebab41ff061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:34.664443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-90969f18-857d-473a-b50c-5ebab41ff061 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:34.665565 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-90969f18-857d-473a-b50c-5ebab41ff061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:34.693295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bee35b-ec69-4acc-824c-be226c1f39fa None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:34.732494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9007674-f381-4ff5-be38-cd4987950d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:34.733153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9007674-f381-4ff5-be38-cd4987950d14 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:34.733439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9007674-f381-4ff5-be38-cd4987950d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:34.733713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9007674-f381-4ff5-be38-cd4987950d14 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:34.734416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9007674-f381-4ff5-be38-cd4987950d14 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:34.734787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9007674-f381-4ff5-be38-cd4987950d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:34.736139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9007674-f381-4ff5-be38-cd4987950d14 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:34.737559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 512/988] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:34.748694 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 477/989] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Jun 15 10:22:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:34.749447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90969f18-857d-473a-b50c-5ebab41ff061 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:34.759168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9007674-f381-4ff5-be38-cd4987950d14 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:34.777337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:34.790763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:34.854967 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90969f18-857d-473a-b50c-5ebab41ff061 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:34.867819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9007674-f381-4ff5-be38-cd4987950d14 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:34.894196 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063170f-7ecc-489f-8340-63accdf09da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:34.894940 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063170f-7ecc-489f-8340-63accdf09da0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:34.895116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063170f-7ecc-489f-8340-63accdf09da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:34.895397 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063170f-7ecc-489f-8340-63accdf09da0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:34.896848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063170f-7ecc-489f-8340-63accdf09da0 None admin] RBAC: Adding query filter params (interface=admin, service_id=3f0f5bd2d6c14682ad91376610dcb074, region_id=RegionOne) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:34.897796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063170f-7ecc-489f-8340-63accdf09da0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:34.899050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063170f-7ecc-489f-8340-63accdf09da0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:34.909310 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 513/990] 10.222.0.50 () {56 vars in 1249 bytes} [Wed Jun 15 10:22:34 2022] GET /identity/v3/endpoints?service_id=3f0f5bd2d6c14682ad91376610dcb074&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:34.909474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085bd7f-a3cb-44bb-8b5e-193853065ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:34.909474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085bd7f-a3cb-44bb-8b5e-193853065ece None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:34.909669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085bd7f-a3cb-44bb-8b5e-193853065ece None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:34.909921 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085bd7f-a3cb-44bb-8b5e-193853065ece None admin] PATH_INFO: `/v3/services/image` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:34.910361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063170f-7ecc-489f-8340-63accdf09da0 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:34.910532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085bd7f-a3cb-44bb-8b5e-193853065ece None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:34.911905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085bd7f-a3cb-44bb-8b5e-193853065ece None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-6085bd7f-a3cb-44bb-8b5e-193853065ece None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:34.927943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:34.929014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:34.932233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 478/991] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Jun 15 10:22:34 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:34.936273 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085bd7f-a3cb-44bb-8b5e-193853065ece None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:35.028633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:35.041082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063170f-7ecc-489f-8340-63accdf09da0 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:35.054033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:35.065479 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085bd7f-a3cb-44bb-8b5e-193853065ece None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:35.086577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75431a50-7b0a-43a7-9a36-92466236ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:35.087237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75431a50-7b0a-43a7-9a36-92466236ff28 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:35.087541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75431a50-7b0a-43a7-9a36-92466236ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:35.087818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75431a50-7b0a-43a7-9a36-92466236ff28 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:35.088497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75431a50-7b0a-43a7-9a36-92466236ff28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:35.091722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75431a50-7b0a-43a7-9a36-92466236ff28 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:35.098434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 514/992] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Jun 15 10:22:34 2022] GET /identity/v3/services => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:22:35.114500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c01397-3673-44a5-bbd8-b2d7462d5d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:35.116112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c01397-3673-44a5-bbd8-b2d7462d5d2c None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:35.117081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c01397-3673-44a5-bbd8-b2d7462d5d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:35.118062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c01397-3673-44a5-bbd8-b2d7462d5d2c None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:35.119080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c01397-3673-44a5-bbd8-b2d7462d5d2c None admin] RBAC: Adding query filter params (name=image) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:35.119561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c01397-3673-44a5-bbd8-b2d7462d5d2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:35.121125 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c01397-3673-44a5-bbd8-b2d7462d5d2c None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:35.127085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 479/993] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:35.135218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75431a50-7b0a-43a7-9a36-92466236ff28 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:35.267991 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75431a50-7b0a-43a7-9a36-92466236ff28 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:35.308286 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e30da-ddb3-40f9-b5e8-f2357e6bbe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:35.308946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e30da-ddb3-40f9-b5e8-f2357e6bbe76 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:35.309238 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e30da-ddb3-40f9-b5e8-f2357e6bbe76 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:35.309497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e30da-ddb3-40f9-b5e8-f2357e6bbe76 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:35.310200 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e30da-ddb3-40f9-b5e8-f2357e6bbe76 None admin] RBAC: Adding query filter params (type=image) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:35.310503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e30da-ddb3-40f9-b5e8-f2357e6bbe76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:35.311887 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e30da-ddb3-40f9-b5e8-f2357e6bbe76 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:35.318048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 515/994] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:36.025759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea08fc-e917-4d48-9a4d-fcb967d606fe None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:36.026256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea08fc-e917-4d48-9a4d-fcb967d606fe None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:36.026256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea08fc-e917-4d48-9a4d-fcb967d606fe None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:36.027744 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 480/995] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:36.032868 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c5e46-f6f3-4514-99cd-36fe4823097c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:36.033290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c5e46-f6f3-4514-99cd-36fe4823097c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:36.033457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c5e46-f6f3-4514-99cd-36fe4823097c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:36.050434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e10c5e46-f6f3-4514-99cd-36fe4823097c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:36.051656 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e10c5e46-f6f3-4514-99cd-36fe4823097c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:36.066808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:36.122729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 516/996] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:36.144725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea08fc-e917-4d48-9a4d-fcb967d606fe None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:36.249906 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea08fc-e917-4d48-9a4d-fcb967d606fe None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:36.282870 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adaa1b-b5e2-4ac5-9b3c-93dc822adcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:36.283620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adaa1b-b5e2-4ac5-9b3c-93dc822adcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:36.283931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adaa1b-b5e2-4ac5-9b3c-93dc822adcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:36.284175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adaa1b-b5e2-4ac5-9b3c-93dc822adcf3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:36.284816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adaa1b-b5e2-4ac5-9b3c-93dc822adcf3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:36.286173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05adaa1b-b5e2-4ac5-9b3c-93dc822adcf3 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-05adaa1b-b5e2-4ac5-9b3c-93dc822adcf3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:36.304376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:36.305447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:36.306348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:36.306348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:36.306348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:36.306348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:36.306348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:36.306348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:36.306348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:36.306348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:36.306348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:36.306348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:36.306348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:36.306348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:36.306348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 10:22:36.306348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:36.310620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 481/997] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:36.311432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c5e46-f6f3-4514-99cd-36fe4823097c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:36.410481 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c5e46-f6f3-4514-99cd-36fe4823097c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:36.446322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27055874-7d8a-4185-8643-651182a40577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:36.446981 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27055874-7d8a-4185-8643-651182a40577 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:36.447264 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27055874-7d8a-4185-8643-651182a40577 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:36.447569 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27055874-7d8a-4185-8643-651182a40577 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:36.448272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27055874-7d8a-4185-8643-651182a40577 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:36.448575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27055874-7d8a-4185-8643-651182a40577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:36.449933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27055874-7d8a-4185-8643-651182a40577 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:36.459425 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 517/998] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Jun 15 10:22:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:36.461468 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adaa1b-b5e2-4ac5-9b3c-93dc822adcf3 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:36.484051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:36.563210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adaa1b-b5e2-4ac5-9b3c-93dc822adcf3 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:36.598766 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a859ee2-de6a-405e-b66a-eef852d9bec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:36.599434 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a859ee2-de6a-405e-b66a-eef852d9bec8 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:36.599740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a859ee2-de6a-405e-b66a-eef852d9bec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:36.600008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a859ee2-de6a-405e-b66a-eef852d9bec8 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:36.601238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a859ee2-de6a-405e-b66a-eef852d9bec8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:36.601541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a859ee2-de6a-405e-b66a-eef852d9bec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:36.602903 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a859ee2-de6a-405e-b66a-eef852d9bec8 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:36.608051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 482/999] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Jun 15 10:22:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:36.613701 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27055874-7d8a-4185-8643-651182a40577 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:36.630847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:36.721406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27055874-7d8a-4185-8643-651182a40577 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:36.758074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1201723-9771-43a5-ad0a-ae54fbb86cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:36.758729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201723-9771-43a5-ad0a-ae54fbb86cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:36.759011 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201723-9771-43a5-ad0a-ae54fbb86cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:36.759285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201723-9771-43a5-ad0a-ae54fbb86cd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:36.760171 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1201723-9771-43a5-ad0a-ae54fbb86cd4 None admin] RBAC: Adding query filter params (interface=public, service_id=98506b84759b420d9120e5b356160dbe, region_id=RegionOne) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:36.760483 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1201723-9771-43a5-ad0a-ae54fbb86cd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:36.761832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1201723-9771-43a5-ad0a-ae54fbb86cd4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:36.771375 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 518/1000] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Jun 15 10:22:36 2022] GET /identity/v3/endpoints?service_id=98506b84759b420d9120e5b356160dbe&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:36.772991 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a859ee2-de6a-405e-b66a-eef852d9bec8 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:36.860476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:36.878160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a859ee2-de6a-405e-b66a-eef852d9bec8 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:36.913649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4c1f9-845f-4df9-8bce-a563db014182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:36.914315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4c1f9-845f-4df9-8bce-a563db014182 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:36.914654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4c1f9-845f-4df9-8bce-a563db014182 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:36.914933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4c1f9-845f-4df9-8bce-a563db014182 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:36.915705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4c1f9-845f-4df9-8bce-a563db014182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:36.917161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4c1f9-845f-4df9-8bce-a563db014182 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:36.927643 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 483/1001] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Jun 15 10:22:36 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:22:37.250210 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9327-3610-4d76-b1c8-76e50682b6ca None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:37.250730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9327-3610-4d76-b1c8-76e50682b6ca None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:37.250730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9327-3610-4d76-b1c8-76e50682b6ca None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:37.252233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 519/1002] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:37.257704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c358c-6bc3-4682-a7c1-8a31de70cb20 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:37.258084 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c358c-6bc3-4682-a7c1-8a31de70cb20 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:37.258270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c358c-6bc3-4682-a7c1-8a31de70cb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:37.275448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-3c7c358c-6bc3-4682-a7c1-8a31de70cb20 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:37.276656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-3c7c358c-6bc3-4682-a7c1-8a31de70cb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:37.349078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 484/1003] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:37.371438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9327-3610-4d76-b1c8-76e50682b6ca None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:37.461225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:37.477624 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e750cdd-30db-4c27-8534-60fc756f439f None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:37.477917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e750cdd-30db-4c27-8534-60fc756f439f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:37.478198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e750cdd-30db-4c27-8534-60fc756f439f None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:37.479821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 485/1004] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:22:37.485141 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9821545-911f-4c80-8c84-fbc0f7e9acd5 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:37.485428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9821545-911f-4c80-8c84-fbc0f7e9acd5 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:37.485772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9821545-911f-4c80-8c84-fbc0f7e9acd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:37.487672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9327-3610-4d76-b1c8-76e50682b6ca None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:37.502814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-d9821545-911f-4c80-8c84-fbc0f7e9acd5 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:37.503748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d9821545-911f-4c80-8c84-fbc0f7e9acd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:37.525038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6efe5-de39-44f7-8695-b674f7a27580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:37.525845 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6efe5-de39-44f7-8695-b674f7a27580 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:37.526132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6efe5-de39-44f7-8695-b674f7a27580 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:37.526517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6efe5-de39-44f7-8695-b674f7a27580 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:37.527143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6efe5-de39-44f7-8695-b674f7a27580 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:37.528547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6efe5-de39-44f7-8695-b674f7a27580 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-7db6efe5-de39-44f7-8695-b674f7a27580 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:37.540692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:37.541736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:37.542623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 520/1005] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Jun 15 10:22:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:37.547587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6efe5-de39-44f7-8695-b674f7a27580 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:37.579540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 486/1006] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:37.602242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9821545-911f-4c80-8c84-fbc0f7e9acd5 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:37.612300 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:37.664140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6efe5-de39-44f7-8695-b674f7a27580 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:37.702647 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb89933-2314-4c27-8a0d-e7d95629e836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:37.703306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb89933-2314-4c27-8a0d-e7d95629e836 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:37.703618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb89933-2314-4c27-8a0d-e7d95629e836 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:37.703893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb89933-2314-4c27-8a0d-e7d95629e836 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:37.704588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb89933-2314-4c27-8a0d-e7d95629e836 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:37.704891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb89933-2314-4c27-8a0d-e7d95629e836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:37.706239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb89933-2314-4c27-8a0d-e7d95629e836 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:37.709152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9821545-911f-4c80-8c84-fbc0f7e9acd5 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:37.711406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 521/1007] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Jun 15 10:22:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:37.716720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb89933-2314-4c27-8a0d-e7d95629e836 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:37.726260 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:37.746388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b342a-06ed-4c96-b053-7d19be296604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:37.747054 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b342a-06ed-4c96-b053-7d19be296604 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:37.747340 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b342a-06ed-4c96-b053-7d19be296604 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:37.747653 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b342a-06ed-4c96-b053-7d19be296604 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:37.748366 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b342a-06ed-4c96-b053-7d19be296604 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:37.749736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b342a-06ed-4c96-b053-7d19be296604 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:37.775619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 487/1008] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Jun 15 10:22:37 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:22:37.829235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb89933-2314-4c27-8a0d-e7d95629e836 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:37.872510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4660b-50db-420b-92d7-0b5f7638d9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:37.873188 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4660b-50db-420b-92d7-0b5f7638d9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:37.873468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4660b-50db-420b-92d7-0b5f7638d9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:37.873740 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4660b-50db-420b-92d7-0b5f7638d9d4 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:37.874442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4660b-50db-420b-92d7-0b5f7638d9d4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:37.874744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4660b-50db-420b-92d7-0b5f7638d9d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:37.876170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4660b-50db-420b-92d7-0b5f7638d9d4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:37.883650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 522/1009] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Jun 15 10:22:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:37.888155 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b342a-06ed-4c96-b053-7d19be296604 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:37.959451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:37.997008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b342a-06ed-4c96-b053-7d19be296604 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:38.032243 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3753d-17e6-42cc-a4cf-3f647c3c7021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:38.032817 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3753d-17e6-42cc-a4cf-3f647c3c7021 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:38.033096 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3753d-17e6-42cc-a4cf-3f647c3c7021 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:38.033366 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3753d-17e6-42cc-a4cf-3f647c3c7021 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:38.034108 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3753d-17e6-42cc-a4cf-3f647c3c7021 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:38.035491 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3753d-17e6-42cc-a4cf-3f647c3c7021 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:38.051323 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 488/1010] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Jun 15 10:22:37 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:22:39.073011 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72ad47-80e7-47b4-a053-58943bf3ff0e None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:39.073523 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72ad47-80e7-47b4-a053-58943bf3ff0e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:39.073523 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72ad47-80e7-47b4-a053-58943bf3ff0e None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:39.074881 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 523/1011] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:39.079940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67899d4b-787f-449f-9112-14d6c106fc77 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:39.080315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67899d4b-787f-449f-9112-14d6c106fc77 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:39.080495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67899d4b-787f-449f-9112-14d6c106fc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:39.097356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-67899d4b-787f-449f-9112-14d6c106fc77 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:39.098531 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-67899d4b-787f-449f-9112-14d6c106fc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:39.171050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 489/1012] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:39 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:39.193789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72ad47-80e7-47b4-a053-58943bf3ff0e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:39.261139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:39.297522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72ad47-80e7-47b4-a053-58943bf3ff0e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:39.331915 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b1110-760d-4252-be98-10d90bbedfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:39.332627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b1110-760d-4252-be98-10d90bbedfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:39.332907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b1110-760d-4252-be98-10d90bbedfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:39.333180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b1110-760d-4252-be98-10d90bbedfd6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:39.333832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b1110-760d-4252-be98-10d90bbedfd6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:39.335214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b1110-760d-4252-be98-10d90bbedfd6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-718b1110-760d-4252-be98-10d90bbedfd6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:39.346796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:39.348067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:39.348948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:39.348948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:39.348948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:39.348948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:39.348948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:39.348948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:39.348948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:39.348948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:39.348948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:39.348948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:39.348948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:39.348948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:39.348948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 10:22:39.348948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:39.350240 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 524/1013] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:39.353964 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67899d4b-787f-449f-9112-14d6c106fc77 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:39.412177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:39.461040 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67899d4b-787f-449f-9112-14d6c106fc77 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:39.495444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b290d-c694-434a-ad9b-f7ce6649ad55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:39.496131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b290d-c694-434a-ad9b-f7ce6649ad55 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:39.496415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b290d-c694-434a-ad9b-f7ce6649ad55 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:39.496691 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b290d-c694-434a-ad9b-f7ce6649ad55 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:39.497395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b290d-c694-434a-ad9b-f7ce6649ad55 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:39.497702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b290d-c694-434a-ad9b-f7ce6649ad55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:39.499065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b290d-c694-434a-ad9b-f7ce6649ad55 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:39.504138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 490/1014] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Jun 15 10:22:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:39.509521 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b1110-760d-4252-be98-10d90bbedfd6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:39.608965 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b1110-760d-4252-be98-10d90bbedfd6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:39.639438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:39.645882 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdcf27-6add-4293-bad8-c88972c20d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:39.646543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdcf27-6add-4293-bad8-c88972c20d7d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:39.646826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdcf27-6add-4293-bad8-c88972c20d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:39.647098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdcf27-6add-4293-bad8-c88972c20d7d None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:39.647857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdcf27-6add-4293-bad8-c88972c20d7d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:39.648165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdcf27-6add-4293-bad8-c88972c20d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:39.649521 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdcf27-6add-4293-bad8-c88972c20d7d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:39.659059 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 525/1015] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Jun 15 10:22:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:39.665128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b290d-c694-434a-ad9b-f7ce6649ad55 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:39.768069 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b290d-c694-434a-ad9b-f7ce6649ad55 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:39.785466 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:39.803431 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0943169-0a4e-40b5-9fb1-291dd406fed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:39.804653 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0943169-0a4e-40b5-9fb1-291dd406fed7 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:39.804938 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0943169-0a4e-40b5-9fb1-291dd406fed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:39.805213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0943169-0a4e-40b5-9fb1-291dd406fed7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:39.805956 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0943169-0a4e-40b5-9fb1-291dd406fed7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:39.807316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0943169-0a4e-40b5-9fb1-291dd406fed7 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:39.835495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 491/1016] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Jun 15 10:22:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:22:39.976338 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abed1d-7540-4c47-9503-153b9f547ecb None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:39.976643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abed1d-7540-4c47-9503-153b9f547ecb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:39.976839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abed1d-7540-4c47-9503-153b9f547ecb None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:39.978225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 526/1017] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:39.984219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a516a-9f46-46bf-8df0-a554ebd7d96e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:39.984593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a516a-9f46-46bf-8df0-a554ebd7d96e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:39.984949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a516a-9f46-46bf-8df0-a554ebd7d96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:40.002646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-973a516a-9f46-46bf-8df0-a554ebd7d96e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:40.003910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-973a516a-9f46-46bf-8df0-a554ebd7d96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:40.083557 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 492/1018] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:40.103546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abed1d-7540-4c47-9503-153b9f547ecb None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:40.199255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3c166-70a7-49ae-af1b-60bb288f87c6 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:40.199575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3c166-70a7-49ae-af1b-60bb288f87c6 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:40.199856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3c166-70a7-49ae-af1b-60bb288f87c6 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:40.201381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 493/1019] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:40.206085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebde3b-8657-4885-a433-bf73dee6ca49 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:40.206373 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebde3b-8657-4885-a433-bf73dee6ca49 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:40.206656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebde3b-8657-4885-a433-bf73dee6ca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:40.220245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abed1d-7540-4c47-9503-153b9f547ecb None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:40.223363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ebebde3b-8657-4885-a433-bf73dee6ca49 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:40.224573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ebebde3b-8657-4885-a433-bf73dee6ca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:40.261435 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c377c60-10e4-44de-a4f9-12c50b6f1e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:40.262139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c377c60-10e4-44de-a4f9-12c50b6f1e7f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:40.262420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c377c60-10e4-44de-a4f9-12c50b6f1e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:40.262693 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c377c60-10e4-44de-a4f9-12c50b6f1e7f None admin] PATH_INFO: `/v3/services/image` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:40.263351 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c377c60-10e4-44de-a4f9-12c50b6f1e7f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:40.264822 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c377c60-10e4-44de-a4f9-12c50b6f1e7f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-4c377c60-10e4-44de-a4f9-12c50b6f1e7f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:40.277254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:40.278293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:40.279191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 527/1020] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Jun 15 10:22:40 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:40.284467 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c377c60-10e4-44de-a4f9-12c50b6f1e7f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:40.298578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 494/1021] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:40.322110 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebde3b-8657-4885-a433-bf73dee6ca49 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:40.348234 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:40.352566 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:40.398510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c377c60-10e4-44de-a4f9-12c50b6f1e7f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:40.433452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebde3b-8657-4885-a433-bf73dee6ca49 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:40.435829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e2ae9-b317-42bc-939f-143328dd87b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:40.436574 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e2ae9-b317-42bc-939f-143328dd87b6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:40.436865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e2ae9-b317-42bc-939f-143328dd87b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:40.437144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e2ae9-b317-42bc-939f-143328dd87b6 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:40.437913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e2ae9-b317-42bc-939f-143328dd87b6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:40.438220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e2ae9-b317-42bc-939f-143328dd87b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:40.439710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e2ae9-b317-42bc-939f-143328dd87b6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:40.446024 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 528/1022] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:40.451588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e2ae9-b317-42bc-939f-143328dd87b6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:40.475844 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c866aa-bd64-417a-8043-970ccb299482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:40.477026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c866aa-bd64-417a-8043-970ccb299482 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:40.477529 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c866aa-bd64-417a-8043-970ccb299482 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:40.478212 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c866aa-bd64-417a-8043-970ccb299482 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:40.479910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c866aa-bd64-417a-8043-970ccb299482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:40.482002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c866aa-bd64-417a-8043-970ccb299482 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:40.484217 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 495/1023] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:40.489847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c866aa-bd64-417a-8043-970ccb299482 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:40.559966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e2ae9-b317-42bc-939f-143328dd87b6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:40.584570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:40.593560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:40.597557 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c866aa-bd64-417a-8043-970ccb299482 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:40.598470 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e7a23-7029-4867-9d48-7e382149df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:40.599208 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e7a23-7029-4867-9d48-7e382149df20 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:40.599525 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e7a23-7029-4867-9d48-7e382149df20 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:40.599833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e7a23-7029-4867-9d48-7e382149df20 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:40.600581 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e7a23-7029-4867-9d48-7e382149df20 None admin] RBAC: Adding query filter params (type=image) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:40.600893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e7a23-7029-4867-9d48-7e382149df20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:40.602278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e7a23-7029-4867-9d48-7e382149df20 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:40.611785 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 529/1024] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:40.613568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e7a23-7029-4867-9d48-7e382149df20 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:40.635213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bca3b-96fc-46e7-8479-d34daac9af01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:40.635918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bca3b-96fc-46e7-8479-d34daac9af01 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:40.636197 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bca3b-96fc-46e7-8479-d34daac9af01 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:40.636468 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bca3b-96fc-46e7-8479-d34daac9af01 None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:40.637285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bca3b-96fc-46e7-8479-d34daac9af01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:40.638710 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bca3b-96fc-46e7-8479-d34daac9af01 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:40.679856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 496/1025] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Jun 15 10:22:40 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:22:40.739017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e7a23-7029-4867-9d48-7e382149df20 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:40.784535 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021d61e-b5ea-4dd4-a11b-4329f0d050b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:40.785558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021d61e-b5ea-4dd4-a11b-4329f0d050b5 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:40.786010 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021d61e-b5ea-4dd4-a11b-4329f0d050b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:40.786465 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021d61e-b5ea-4dd4-a11b-4329f0d050b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:40.787880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021d61e-b5ea-4dd4-a11b-4329f0d050b5 None admin] RBAC: Adding query filter params (interface=public, service_id=7b2ed4b6a0ec4298a4f21d26e41358ce, region_id=RegionOne) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:40.788399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021d61e-b5ea-4dd4-a11b-4329f0d050b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:40.790770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021d61e-b5ea-4dd4-a11b-4329f0d050b5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:40.804914 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 530/1026] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Jun 15 10:22:40 2022] GET /identity/v3/endpoints?service_id=7b2ed4b6a0ec4298a4f21d26e41358ce&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:40.806873 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bca3b-96fc-46e7-8479-d34daac9af01 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:40.912570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bca3b-96fc-46e7-8479-d34daac9af01 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:40.946329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65bc61-2b58-4e0f-9cc0-79d4aa736948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:40.946990 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65bc61-2b58-4e0f-9cc0-79d4aa736948 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:40.947268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65bc61-2b58-4e0f-9cc0-79d4aa736948 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:40.947563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65bc61-2b58-4e0f-9cc0-79d4aa736948 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:40.948241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65bc61-2b58-4e0f-9cc0-79d4aa736948 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:40.949592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65bc61-2b58-4e0f-9cc0-79d4aa736948 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:40.963567 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 497/1027] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Jun 15 10:22:40 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:22:42.074789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfd8ed-c3f9-40fe-8b3f-4da6de8b1e7c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:42.075300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfd8ed-c3f9-40fe-8b3f-4da6de8b1e7c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:42.075300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfd8ed-c3f9-40fe-8b3f-4da6de8b1e7c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:42.076689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 531/1028] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:42.081691 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af52ae-52ee-448d-ba9b-515e71247086 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:42.082072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af52ae-52ee-448d-ba9b-515e71247086 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:42.082258 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af52ae-52ee-448d-ba9b-515e71247086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:42.099359 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-a1af52ae-52ee-448d-ba9b-515e71247086 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:42.100597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a1af52ae-52ee-448d-ba9b-515e71247086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:42.109846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:42.169532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 498/1029] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:42.195303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfd8ed-c3f9-40fe-8b3f-4da6de8b1e7c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:42.246069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:42.297362 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfd8ed-c3f9-40fe-8b3f-4da6de8b1e7c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:42.331303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5299d5-a8e9-4afe-8a6b-d9b0407cb372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:42.332048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5299d5-a8e9-4afe-8a6b-d9b0407cb372 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:42.332329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5299d5-a8e9-4afe-8a6b-d9b0407cb372 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:42.332604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5299d5-a8e9-4afe-8a6b-d9b0407cb372 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:42.342722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5299d5-a8e9-4afe-8a6b-d9b0407cb372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-ff5299d5-a8e9-4afe-8a6b-d9b0407cb372 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:42.351239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:42.352389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:42.353306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:42.353306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:42.353306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:42.353306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:42.353306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:42.353306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:42.353306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:42.353306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:42.353306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:42.353306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:42.353306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 10:22:42.353306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:42.354724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 532/1030] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Jun 15 10:22:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:42.358516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af52ae-52ee-448d-ba9b-515e71247086 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:42.463558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af52ae-52ee-448d-ba9b-515e71247086 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:42.497644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c48973-0be8-4313-919b-576608d93b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:42.498308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c48973-0be8-4313-919b-576608d93b2e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:42.498588 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c48973-0be8-4313-919b-576608d93b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:42.498859 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c48973-0be8-4313-919b-576608d93b2e None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:42.499646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c48973-0be8-4313-919b-576608d93b2e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:42.499949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c48973-0be8-4313-919b-576608d93b2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:42.501305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c48973-0be8-4313-919b-576608d93b2e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:42.514022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 499/1031] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Jun 15 10:22:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:42.515323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5299d5-a8e9-4afe-8a6b-d9b0407cb372 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:42.619150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5299d5-a8e9-4afe-8a6b-d9b0407cb372 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:42.629472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:42.656570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb96ba4-a5a4-4d68-8ff2-48a24bc8cc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:42.657365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb96ba4-a5a4-4d68-8ff2-48a24bc8cc11 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:42.657647 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb96ba4-a5a4-4d68-8ff2-48a24bc8cc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:42.657925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb96ba4-a5a4-4d68-8ff2-48a24bc8cc11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:42.673391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb96ba4-a5a4-4d68-8ff2-48a24bc8cc11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:42.674238 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb96ba4-a5a4-4d68-8ff2-48a24bc8cc11 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-7fb96ba4-a5a4-4d68-8ff2-48a24bc8cc11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:42.693012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:42.694005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:42.694985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:42.694985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:42.694985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:42.694985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:42.696018 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 533/1032] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:42.700110 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c48973-0be8-4313-919b-576608d93b2e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:42.710101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:42.809032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c48973-0be8-4313-919b-576608d93b2e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:42.843798 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed02619-78e4-4b48-bec6-dc5c9f35e914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:42.844454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed02619-78e4-4b48-bec6-dc5c9f35e914 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:42.844736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed02619-78e4-4b48-bec6-dc5c9f35e914 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:42.845007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed02619-78e4-4b48-bec6-dc5c9f35e914 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:42.845720 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed02619-78e4-4b48-bec6-dc5c9f35e914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:42.846023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed02619-78e4-4b48-bec6-dc5c9f35e914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:42.847382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed02619-78e4-4b48-bec6-dc5c9f35e914 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:42.864965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 500/1033] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:42.865137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff512601-e63d-43fa-aa13-1e129c3efec1 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:42.865137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff512601-e63d-43fa-aa13-1e129c3efec1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:42.865137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff512601-e63d-43fa-aa13-1e129c3efec1 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:42.865137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 534/1034] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:42.866036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed02619-78e4-4b48-bec6-dc5c9f35e914 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:42.869789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221b47-5661-4e3a-803a-79602aecf396 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:42.870022 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221b47-5661-4e3a-803a-79602aecf396 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:42.870294 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221b47-5661-4e3a-803a-79602aecf396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:42.887127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f8221b47-5661-4e3a-803a-79602aecf396 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:42.888353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f8221b47-5661-4e3a-803a-79602aecf396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:42.933677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:42.963008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 535/1035] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:42.974260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed02619-78e4-4b48-bec6-dc5c9f35e914 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:42.987237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221b47-5661-4e3a-803a-79602aecf396 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:43.013025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337db300-0691-47e3-a6f6-9dd3d3bc584e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:43.013838 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337db300-0691-47e3-a6f6-9dd3d3bc584e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:43.014121 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337db300-0691-47e3-a6f6-9dd3d3bc584e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:43.014394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337db300-0691-47e3-a6f6-9dd3d3bc584e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:43.023821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337db300-0691-47e3-a6f6-9dd3d3bc584e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:43.025295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337db300-0691-47e3-a6f6-9dd3d3bc584e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-337db300-0691-47e3-a6f6-9dd3d3bc584e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:43.041476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:43.042595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:43.043641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:43.043641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:43.043641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:43.043641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:43.043641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:43.043641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:43.043641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:43.043641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:43.043641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:22:43.043641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:43.043641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 501/1036] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Jun 15 10:22:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:43.048881 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337db300-0691-47e3-a6f6-9dd3d3bc584e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:43.091779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:43.102174 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221b47-5661-4e3a-803a-79602aecf396 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:43.135986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354023c-3f13-46b1-8a88-87083b28bd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:43.136688 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354023c-3f13-46b1-8a88-87083b28bd54 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:43.136963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354023c-3f13-46b1-8a88-87083b28bd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:43.137232 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354023c-3f13-46b1-8a88-87083b28bd54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:43.138385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354023c-3f13-46b1-8a88-87083b28bd54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:43.139825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354023c-3f13-46b1-8a88-87083b28bd54 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:43.141418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 536/1037] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:43.142564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702a1ed-5caa-40bc-ade7-556c8fecf658 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:43.142843 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702a1ed-5caa-40bc-ade7-556c8fecf658 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:43.143113 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702a1ed-5caa-40bc-ade7-556c8fecf658 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:43.148607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 537/1038] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:43.148607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702a1ed-5caa-40bc-ade7-556c8fecf658 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:43.152942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337db300-0691-47e3-a6f6-9dd3d3bc584e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:43.179450 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:43.188053 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3847c-95b9-432e-97b3-002893af62b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:43.188724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3847c-95b9-432e-97b3-002893af62b9 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:43.189007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3847c-95b9-432e-97b3-002893af62b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:43.189278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3847c-95b9-432e-97b3-002893af62b9 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:43.190115 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3847c-95b9-432e-97b3-002893af62b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:43.190424 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3847c-95b9-432e-97b3-002893af62b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:43.191899 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3847c-95b9-432e-97b3-002893af62b9 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:43.215032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 502/1039] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Jun 15 10:22:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:43.215032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdc47e-d52a-4d9c-9316-4c871c15a747 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:43.215032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdc47e-d52a-4d9c-9316-4c871c15a747 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:43.215032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdc47e-d52a-4d9c-9316-4c871c15a747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:43.227692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-cbcdc47e-d52a-4d9c-9316-4c871c15a747 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:43.228887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-cbcdc47e-d52a-4d9c-9316-4c871c15a747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:43.253944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702a1ed-5caa-40bc-ade7-556c8fecf658 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:43.288318 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce50b1b-0c33-4192-acad-82099dfdf355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:43.288970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50b1b-0c33-4192-acad-82099dfdf355 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:43.289247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50b1b-0c33-4192-acad-82099dfdf355 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:43.289516 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50b1b-0c33-4192-acad-82099dfdf355 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:43.290198 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce50b1b-0c33-4192-acad-82099dfdf355 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:43.291633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce50b1b-0c33-4192-acad-82099dfdf355 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:43.293132 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 503/1040] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:43.293949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdc47e-d52a-4d9c-9316-4c871c15a747 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:43.312772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 538/1041] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:22:43 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:22:43.316909 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce50b1b-0c33-4192-acad-82099dfdf355 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:43.339215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:43.413181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdc47e-d52a-4d9c-9316-4c871c15a747 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:43.428420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:43.439894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce50b1b-0c33-4192-acad-82099dfdf355 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:43.454942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00594cb9-a590-48a2-938f-aab364cdf02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:43.455636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00594cb9-a590-48a2-938f-aab364cdf02c None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:43.455922 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00594cb9-a590-48a2-938f-aab364cdf02c None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:43.456202 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00594cb9-a590-48a2-938f-aab364cdf02c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:43.479572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ac208-da94-4469-89cc-e3b3c278fe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:43.480363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ac208-da94-4469-89cc-e3b3c278fe89 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:43.480640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ac208-da94-4469-89cc-e3b3c278fe89 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:43.480907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ac208-da94-4469-89cc-e3b3c278fe89 None admin] PATH_INFO: `/v3/services/image` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:43.481557 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ac208-da94-4469-89cc-e3b3c278fe89 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:43.482907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ac208-da94-4469-89cc-e3b3c278fe89 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-d52ac208-da94-4469-89cc-e3b3c278fe89 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:43.496468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:43.497697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:43.498767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 539/1042] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Jun 15 10:22:43 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:43.504297 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ac208-da94-4469-89cc-e3b3c278fe89 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:43.535201 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00594cb9-a590-48a2-938f-aab364cdf02c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:43.536696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00594cb9-a590-48a2-938f-aab364cdf02c None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:43.597645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:43.620227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ac208-da94-4469-89cc-e3b3c278fe89 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:43.654095 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 504/1043] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:22:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:22:43.656098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00594cb9-a590-48a2-938f-aab364cdf02c None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:43.664937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f762b-0ee7-4b99-a167-46e21b5daad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:43.665610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f762b-0ee7-4b99-a167-46e21b5daad9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:43.665890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f762b-0ee7-4b99-a167-46e21b5daad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:43.666563 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f762b-0ee7-4b99-a167-46e21b5daad9 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:43.667369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f762b-0ee7-4b99-a167-46e21b5daad9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:43.670976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f762b-0ee7-4b99-a167-46e21b5daad9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:43.670976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f762b-0ee7-4b99-a167-46e21b5daad9 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:43.671732 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:43.680881 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 540/1044] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:43.682825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f762b-0ee7-4b99-a167-46e21b5daad9 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:43.768566 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00594cb9-a590-48a2-938f-aab364cdf02c None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:43.790926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f762b-0ee7-4b99-a167-46e21b5daad9 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:43.805508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9aba-6e06-4a59-aa37-75b1f0793034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:43.806300 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9aba-6e06-4a59-aa37-75b1f0793034 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:43.806581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9aba-6e06-4a59-aa37-75b1f0793034 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:43.806851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e9aba-6e06-4a59-aa37-75b1f0793034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:43.817036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e9aba-6e06-4a59-aa37-75b1f0793034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:43.818474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e9aba-6e06-4a59-aa37-75b1f0793034 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:43.827746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f5734-4b82-41a0-8c0b-ffb4d6a1a9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:43.828404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f5734-4b82-41a0-8c0b-ffb4d6a1a9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:43.828684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f5734-4b82-41a0-8c0b-ffb4d6a1a9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:43.828956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f5734-4b82-41a0-8c0b-ffb4d6a1a9e6 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:43.829675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f5734-4b82-41a0-8c0b-ffb4d6a1a9e6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:43.829980 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f5734-4b82-41a0-8c0b-ffb4d6a1a9e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:43.831332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f5734-4b82-41a0-8c0b-ffb4d6a1a9e6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:43.837121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 541/1045] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-812e9aba-6e06-4a59-aa37-75b1f0793034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:43.837238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:43.843988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:43.844975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:43.844975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:43.844975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:43.844975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:43.844975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 505/1046] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:43.845263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f5734-4b82-41a0-8c0b-ffb4d6a1a9e6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:43.846319 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9aba-6e06-4a59-aa37-75b1f0793034 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:43.854772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:43.915161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:43.950672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e9aba-6e06-4a59-aa37-75b1f0793034 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:43.953584 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f5734-4b82-41a0-8c0b-ffb4d6a1a9e6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:43.987126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec34b5-4f82-4d05-b847-f98dfde6d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:43.987819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec34b5-4f82-4d05-b847-f98dfde6d54f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:43.988098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec34b5-4f82-4d05-b847-f98dfde6d54f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:43.988367 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec34b5-4f82-4d05-b847-f98dfde6d54f None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:43.989047 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27c00d-5ce1-4368-9e6e-b3fe6a36570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:43.989166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec34b5-4f82-4d05-b847-f98dfde6d54f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:43.989398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec34b5-4f82-4d05-b847-f98dfde6d54f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:43.989697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27c00d-5ce1-4368-9e6e-b3fe6a36570b None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:43.989974 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27c00d-5ce1-4368-9e6e-b3fe6a36570b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:43.990244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27c00d-5ce1-4368-9e6e-b3fe6a36570b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:43.990761 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec34b5-4f82-4d05-b847-f98dfde6d54f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:43.991034 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27c00d-5ce1-4368-9e6e-b3fe6a36570b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:43.992674 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27c00d-5ce1-4368-9e6e-b3fe6a36570b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:44.008601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 506/1047] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:44.010305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec34b5-4f82-4d05-b847-f98dfde6d54f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:44.023951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 542/1048] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Jun 15 10:22:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:22:44.122483 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec34b5-4f82-4d05-b847-f98dfde6d54f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:44.151129 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:44.168167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ed7ba-08a1-4350-8bee-fe72b13eb924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:44.168905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ed7ba-08a1-4350-8bee-fe72b13eb924 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:44.169143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ed7ba-08a1-4350-8bee-fe72b13eb924 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:44.169413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ed7ba-08a1-4350-8bee-fe72b13eb924 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:44.177401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ed7ba-08a1-4350-8bee-fe72b13eb924 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:44.179128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ed7ba-08a1-4350-8bee-fe72b13eb924 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-6d4ed7ba-08a1-4350-8bee-fe72b13eb924 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:44.193456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:44.195100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:44.196293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:44.196293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:44.196293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:44.196293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:44.196293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:44.196293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:44.196293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:44.196293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:44.196293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 507/1049] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:44.201482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27c00d-5ce1-4368-9e6e-b3fe6a36570b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:44.271905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:44.314012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27c00d-5ce1-4368-9e6e-b3fe6a36570b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:44.347981 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f152e-7a74-468e-8dfb-b245fef79fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:44.348631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f152e-7a74-468e-8dfb-b245fef79fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:44.348911 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f152e-7a74-468e-8dfb-b245fef79fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:44.349183 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f152e-7a74-468e-8dfb-b245fef79fc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:44.349960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f152e-7a74-468e-8dfb-b245fef79fc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:44.350798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f152e-7a74-468e-8dfb-b245fef79fc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:44.352249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f152e-7a74-468e-8dfb-b245fef79fc4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:44.364623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 543/1050] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:44.371583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ed7ba-08a1-4350-8bee-fe72b13eb924 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:44.475947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ed7ba-08a1-4350-8bee-fe72b13eb924 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:44.509744 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617f7b9-7207-4b05-bcaf-11951ce26855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:44.510404 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f7b9-7207-4b05-bcaf-11951ce26855 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:44.510686 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f7b9-7207-4b05-bcaf-11951ce26855 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:44.510963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f7b9-7207-4b05-bcaf-11951ce26855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:44.513379 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617f7b9-7207-4b05-bcaf-11951ce26855 None admin] RBAC: Adding query filter params (role.id=1f99b201b09e4780ba9ff6d5a33eb75d, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=81e9805ec4c44cedb658b7becf768369) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:44.513379 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617f7b9-7207-4b05-bcaf-11951ce26855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:44.513634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617f7b9-7207-4b05-bcaf-11951ce26855 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:44.523506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 508/1051] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:22:44 2022] GET /identity/v3/role_assignments?user.id=81e9805ec4c44cedb658b7becf768369&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=1f99b201b09e4780ba9ff6d5a33eb75d => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:45.512873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3bd5-e82e-4d9a-b032-add0667f7c37 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:45.513493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3bd5-e82e-4d9a-b032-add0667f7c37 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:45.513493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3bd5-e82e-4d9a-b032-add0667f7c37 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:45.514951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 544/1052] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:45.519892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cc7d2-f52e-4db9-a4e0-0a2afd5f40e9 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:45.520269 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cc7d2-f52e-4db9-a4e0-0a2afd5f40e9 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:45.520450 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cc7d2-f52e-4db9-a4e0-0a2afd5f40e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:45.536805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-9b5cc7d2-f52e-4db9-a4e0-0a2afd5f40e9 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:45.538508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-9b5cc7d2-f52e-4db9-a4e0-0a2afd5f40e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:45.582191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:45.609305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 509/1053] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:45.632767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b3bd5-e82e-4d9a-b032-add0667f7c37 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:45.745946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b3bd5-e82e-4d9a-b032-add0667f7c37 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:45.769327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:45.781041 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54a842-ecf1-4077-bec8-5544cc3d6296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:45.781828 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54a842-ecf1-4077-bec8-5544cc3d6296 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:45.782110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54a842-ecf1-4077-bec8-5544cc3d6296 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:45.782382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54a842-ecf1-4077-bec8-5544cc3d6296 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:45.793204 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54a842-ecf1-4077-bec8-5544cc3d6296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-ed54a842-ecf1-4077-bec8-5544cc3d6296 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:45.800729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:45.801710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:45.802608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:45.802608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:45.802608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:45.802608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:45.802608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:45.802608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:45.802608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:45.802608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:45.802608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:45.802608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:45.802608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:45.802608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:45.807533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 545/1054] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:22:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:45.808342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cc7d2-f52e-4db9-a4e0-0a2afd5f40e9 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:45.905904 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cc7d2-f52e-4db9-a4e0-0a2afd5f40e9 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:45.938910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb8ec0-f916-4312-b648-07b5c905dba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:45.939594 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb8ec0-f916-4312-b648-07b5c905dba5 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:45.939883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb8ec0-f916-4312-b648-07b5c905dba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:45.940157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb8ec0-f916-4312-b648-07b5c905dba5 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:45.940896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb8ec0-f916-4312-b648-07b5c905dba5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:45.941199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb8ec0-f916-4312-b648-07b5c905dba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:45.942589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb8ec0-f916-4312-b648-07b5c905dba5 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:45.955148 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 510/1055] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:22:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:45.956856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54a842-ecf1-4077-bec8-5544cc3d6296 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:46.057708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54a842-ecf1-4077-bec8-5544cc3d6296 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:46.091189 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb62c88-9afe-4583-a9d3-f03962f5038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:46.092124 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb62c88-9afe-4583-a9d3-f03962f5038d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:46.092409 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb62c88-9afe-4583-a9d3-f03962f5038d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:46.092685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb62c88-9afe-4583-a9d3-f03962f5038d None admin] PATH_INFO: `/v3/users/6b4bf59339bd4222ac984d26a7bcb7bb` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:46.109055 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb62c88-9afe-4583-a9d3-f03962f5038d None admin] RBAC: Authorizing `identity:get_user(user_id=6b4bf59339bd4222ac984d26a7bcb7bb)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:46.110528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb62c88-9afe-4583-a9d3-f03962f5038d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:46.112609 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 546/1056] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:22:45 2022] GET /identity/v3/users/6b4bf59339bd4222ac984d26a7bcb7bb => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:46.118559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb8ec0-f916-4312-b648-07b5c905dba5 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:46.159859 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:46.165774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f091f-cb88-470c-a8d3-fd145c0f6606 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:46.166060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f091f-cb88-470c-a8d3-fd145c0f6606 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:46.166338 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f091f-cb88-470c-a8d3-fd145c0f6606 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:46.167885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 547/1057] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:46.172608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c574-0d5a-4cfd-9894-b975e79985ea None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:46.172892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c574-0d5a-4cfd-9894-b975e79985ea None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:46.173171 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c574-0d5a-4cfd-9894-b975e79985ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:46.190322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-91b8c574-0d5a-4cfd-9894-b975e79985ea None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:46.191520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-91b8c574-0d5a-4cfd-9894-b975e79985ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:46.224026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb8ec0-f916-4312-b648-07b5c905dba5 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:46.228910 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:46.261135 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7628150-183e-4b76-8f9b-9516246dfbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:46.261782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7628150-183e-4b76-8f9b-9516246dfbae None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:46.262062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7628150-183e-4b76-8f9b-9516246dfbae None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:46.262332 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7628150-183e-4b76-8f9b-9516246dfbae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:46.267514 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 548/1058] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:46.286792 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8c574-0d5a-4cfd-9894-b975e79985ea None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:46.333336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7628150-183e-4b76-8f9b-9516246dfbae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:46.335833 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7628150-183e-4b76-8f9b-9516246dfbae None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:46.374820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:46.398229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8c574-0d5a-4cfd-9894-b975e79985ea None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:46.439123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a627293-684e-41ef-8a73-b0b2210d037b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:46.439791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a627293-684e-41ef-8a73-b0b2210d037b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:46.440070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a627293-684e-41ef-8a73-b0b2210d037b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:46.440346 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a627293-684e-41ef-8a73-b0b2210d037b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:46.451058 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 511/1059] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:22:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:22:46.452120 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7628150-183e-4b76-8f9b-9516246dfbae None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:46.488766 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:46.519987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a627293-684e-41ef-8a73-b0b2210d037b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:46.521445 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a627293-684e-41ef-8a73-b0b2210d037b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:46.554147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7628150-183e-4b76-8f9b-9516246dfbae None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:46.595977 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d15a7-23d6-4d57-ad24-077874be4da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:46.596846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d15a7-23d6-4d57-ad24-077874be4da7 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:46.597127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d15a7-23d6-4d57-ad24-077874be4da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:46.597403 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d15a7-23d6-4d57-ad24-077874be4da7 None admin] PATH_INFO: `/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:46.598606 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d15a7-23d6-4d57-ad24-077874be4da7 None admin] RBAC: Authorizing `identity:get_project(project_id=16c4b05b4b574dc89b953f5ef5022bc2)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:46.600099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d15a7-23d6-4d57-ad24-077874be4da7 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:46.602652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 512/1060] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:22:46 2022] GET /identity/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:46.608526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d15a7-23d6-4d57-ad24-077874be4da7 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:46.617768 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:46.642400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 549/1061] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:22:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 10:22:46.642400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668f66b-a359-4895-8262-4d62db1a271c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:46.642400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668f66b-a359-4895-8262-4d62db1a271c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:46.642400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668f66b-a359-4895-8262-4d62db1a271c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:46.642400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 550/1062] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:46.644309 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668f66b-a359-4895-8262-4d62db1a271c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:46.711425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d15a7-23d6-4d57-ad24-077874be4da7 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:46.719439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:46.745495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9e37c-56dc-480c-8faf-ed4b7c101438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:46.746154 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9e37c-56dc-480c-8faf-ed4b7c101438 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:46.746434 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9e37c-56dc-480c-8faf-ed4b7c101438 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:46.746707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9e37c-56dc-480c-8faf-ed4b7c101438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:46.747570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9e37c-56dc-480c-8faf-ed4b7c101438 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=16c4b05b4b574dc89b953f5ef5022bc2, user.id=6b4bf59339bd4222ac984d26a7bcb7bb) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:46.747884 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9e37c-56dc-480c-8faf-ed4b7c101438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:46.749316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9e37c-56dc-480c-8faf-ed4b7c101438 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:46.752291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668f66b-a359-4895-8262-4d62db1a271c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:46.754762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 513/1063] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:22:46 2022] GET /identity/v3/role_assignments?user.id=6b4bf59339bd4222ac984d26a7bcb7bb&scope.project.id=16c4b05b4b574dc89b953f5ef5022bc2&role.id=e1a2021d08e14daa969362b3d23face3 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:46.756569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eedfc-d1dc-4309-9e8c-348954e4b962 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:46.756905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eedfc-d1dc-4309-9e8c-348954e4b962 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:46.757189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eedfc-d1dc-4309-9e8c-348954e4b962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:46.777782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-1a7eedfc-d1dc-4309-9e8c-348954e4b962 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:46.779748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1a7eedfc-d1dc-4309-9e8c-348954e4b962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:46.790957 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e1a09-316c-424e-8897-72fed66576aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:46.791804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e1a09-316c-424e-8897-72fed66576aa None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:46.792087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e1a09-316c-424e-8897-72fed66576aa None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:46.792361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e1a09-316c-424e-8897-72fed66576aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:46.807502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e1a09-316c-424e-8897-72fed66576aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:46.810019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e1a09-316c-424e-8897-72fed66576aa None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-3d4e1a09-316c-424e-8897-72fed66576aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:46.830404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:46.831457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:46.833599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:46.833599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:46.833599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:46.833599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:46.835851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 551/1064] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:46.838214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e1a09-316c-424e-8897-72fed66576aa None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:46.863047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:46.869798 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 514/1065] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:46.893585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eedfc-d1dc-4309-9e8c-348954e4b962 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:46.950711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e1a09-316c-424e-8897-72fed66576aa None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:46.976378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:46.988741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607231c-da72-4cb8-83eb-f97e7f3148c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:46.989404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607231c-da72-4cb8-83eb-f97e7f3148c7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:46.989685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607231c-da72-4cb8-83eb-f97e7f3148c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:46.990197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607231c-da72-4cb8-83eb-f97e7f3148c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:46.990678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607231c-da72-4cb8-83eb-f97e7f3148c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:46.991018 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607231c-da72-4cb8-83eb-f97e7f3148c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:46.992703 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607231c-da72-4cb8-83eb-f97e7f3148c7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:46.999250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eedfc-d1dc-4309-9e8c-348954e4b962 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:47.005020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 552/1066] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:47.035971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2db43f-12fb-4789-914a-886f008da35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:47.036799 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db43f-12fb-4789-914a-886f008da35d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:47.037082 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db43f-12fb-4789-914a-886f008da35d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:47.037351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2db43f-12fb-4789-914a-886f008da35d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:47.049106 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2db43f-12fb-4789-914a-886f008da35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-ed2db43f-12fb-4789-914a-886f008da35d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:47.057592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:47.058655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:47.059621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:47.059621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:47.059621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:47.059621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:47.059621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:47.059621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:47.059621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:47.059621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:47.059621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:47.059621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:47.059621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 10:22:47.059621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:47.059621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 515/1067] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Jun 15 10:22:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:47.065553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607231c-da72-4cb8-83eb-f97e7f3148c7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:47.177894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607231c-da72-4cb8-83eb-f97e7f3148c7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:47.213382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97839337-613c-412f-8618-023d7605311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:47.214050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97839337-613c-412f-8618-023d7605311e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:47.214331 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97839337-613c-412f-8618-023d7605311e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:47.214603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97839337-613c-412f-8618-023d7605311e None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:47.215353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97839337-613c-412f-8618-023d7605311e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:47.215692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97839337-613c-412f-8618-023d7605311e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:47.217074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97839337-613c-412f-8618-023d7605311e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:47.225992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 553/1068] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Jun 15 10:22:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:47.231385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2db43f-12fb-4789-914a-886f008da35d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:47.295985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:47.338974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2db43f-12fb-4789-914a-886f008da35d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:47.371723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5dfc5-4262-4d81-aeea-5c160f04e923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:47.372446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5dfc5-4262-4d81-aeea-5c160f04e923 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:47.372729 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5dfc5-4262-4d81-aeea-5c160f04e923 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:47.373006 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5dfc5-4262-4d81-aeea-5c160f04e923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:47.384037 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5dfc5-4262-4d81-aeea-5c160f04e923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:47.385633 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5dfc5-4262-4d81-aeea-5c160f04e923 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-ebe5dfc5-4262-4d81-aeea-5c160f04e923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:47.402541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:47.403552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:47.404898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:47.404898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:47.404898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:47.404898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:47.404898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 516/1069] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:47.409426 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97839337-613c-412f-8618-023d7605311e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:47.456767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:47.515265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97839337-613c-412f-8618-023d7605311e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:47.548937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b7977-0b8b-45ad-ad49-d64d598471f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:47.549581 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b7977-0b8b-45ad-ad49-d64d598471f7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:47.549866 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b7977-0b8b-45ad-ad49-d64d598471f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:47.550142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b7977-0b8b-45ad-ad49-d64d598471f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:47.550862 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b7977-0b8b-45ad-ad49-d64d598471f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:47.551172 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b7977-0b8b-45ad-ad49-d64d598471f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:47.552579 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b7977-0b8b-45ad-ad49-d64d598471f7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:47.565351 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 554/1070] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:47.571555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5dfc5-4262-4d81-aeea-5c160f04e923 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:47.667173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5dfc5-4262-4d81-aeea-5c160f04e923 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:47.682483 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:47.703908 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef81a5-8942-46ca-9bfd-f7686c32e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:47.704681 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef81a5-8942-46ca-9bfd-f7686c32e25d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:47.704962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef81a5-8942-46ca-9bfd-f7686c32e25d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:47.705231 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef81a5-8942-46ca-9bfd-f7686c32e25d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:47.712495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef81a5-8942-46ca-9bfd-f7686c32e25d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:47.713870 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef81a5-8942-46ca-9bfd-f7686c32e25d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-71ef81a5-8942-46ca-9bfd-f7686c32e25d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:47.729612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:47.730634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:47.731688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:47.731688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:47.731688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:47.731688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:47.731688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:47.731688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:47.731688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:47.731688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:47.731688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:22:47.731688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:47.731688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 517/1071] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Jun 15 10:22:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:47.736659 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b7977-0b8b-45ad-ad49-d64d598471f7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:47.833539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b7977-0b8b-45ad-ad49-d64d598471f7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:47.842067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:47.871275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e87d64-82e5-4a96-b5d8-40d456835922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:47.871975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e87d64-82e5-4a96-b5d8-40d456835922 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:47.872258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e87d64-82e5-4a96-b5d8-40d456835922 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:47.872532 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e87d64-82e5-4a96-b5d8-40d456835922 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:47.873371 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e87d64-82e5-4a96-b5d8-40d456835922 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:47.873680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e87d64-82e5-4a96-b5d8-40d456835922 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:47.875097 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e87d64-82e5-4a96-b5d8-40d456835922 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:47.892103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 555/1072] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Jun 15 10:22:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:47.897715 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef81a5-8942-46ca-9bfd-f7686c32e25d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:47.995147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef81a5-8942-46ca-9bfd-f7686c32e25d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:48.026539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28214b11-5396-4455-86cf-4965cd0a3614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:48.027312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28214b11-5396-4455-86cf-4965cd0a3614 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:48.027619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28214b11-5396-4455-86cf-4965cd0a3614 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:48.027894 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28214b11-5396-4455-86cf-4965cd0a3614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:48.039057 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28214b11-5396-4455-86cf-4965cd0a3614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:48.040524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28214b11-5396-4455-86cf-4965cd0a3614 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-28214b11-5396-4455-86cf-4965cd0a3614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:48.057564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:48.058515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:48.059493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:48.059493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:48.059493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:48.059493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:48.059493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 518/1073] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:48.064358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e87d64-82e5-4a96-b5d8-40d456835922 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:48.161957 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e87d64-82e5-4a96-b5d8-40d456835922 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:48.196662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbd6a7-e3fa-4725-8dac-6af1a038a3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:48.197327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbd6a7-e3fa-4725-8dac-6af1a038a3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:48.197610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbd6a7-e3fa-4725-8dac-6af1a038a3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:48.197957 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbd6a7-e3fa-4725-8dac-6af1a038a3c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:48.198611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbd6a7-e3fa-4725-8dac-6af1a038a3c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:48.198914 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbd6a7-e3fa-4725-8dac-6af1a038a3c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:48.200298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbd6a7-e3fa-4725-8dac-6af1a038a3c9 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:48.217520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 556/1074] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:48.220991 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28214b11-5396-4455-86cf-4965cd0a3614 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:48.248275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:48.327310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28214b11-5396-4455-86cf-4965cd0a3614 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:48.363960 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de427d30-4993-4cbe-9d46-229ae9bdcf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:48.364761 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de427d30-4993-4cbe-9d46-229ae9bdcf3a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:48.365048 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de427d30-4993-4cbe-9d46-229ae9bdcf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:48.365325 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de427d30-4993-4cbe-9d46-229ae9bdcf3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:48.372299 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de427d30-4993-4cbe-9d46-229ae9bdcf3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:48.373748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de427d30-4993-4cbe-9d46-229ae9bdcf3a None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-de427d30-4993-4cbe-9d46-229ae9bdcf3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:48.388179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:48.389278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:48.390232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:48.390232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:48.390232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:48.390232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:48.390232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:48.390232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:48.390232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:48.390232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:48.390232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 519/1075] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:48.395304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbd6a7-e3fa-4725-8dac-6af1a038a3c9 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:48.422633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:48.505192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbd6a7-e3fa-4725-8dac-6af1a038a3c9 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:48.538353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45ada0-e535-4cef-b449-4c04a1bc9db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:48.539001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45ada0-e535-4cef-b449-4c04a1bc9db4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:48.539278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45ada0-e535-4cef-b449-4c04a1bc9db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:48.539575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45ada0-e535-4cef-b449-4c04a1bc9db4 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:48.540353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45ada0-e535-4cef-b449-4c04a1bc9db4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:48.540654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45ada0-e535-4cef-b449-4c04a1bc9db4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:48.542097 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45ada0-e535-4cef-b449-4c04a1bc9db4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:48.553928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 557/1076] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:48.559898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de427d30-4993-4cbe-9d46-229ae9bdcf3a None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:48.640779 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:48.657165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de427d30-4993-4cbe-9d46-229ae9bdcf3a None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:48.690920 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1e85e-f151-4ae7-8bc5-82178a3638ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:48.691835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1e85e-f151-4ae7-8bc5-82178a3638ec None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:48.692117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1e85e-f151-4ae7-8bc5-82178a3638ec None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:48.692387 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1e85e-f151-4ae7-8bc5-82178a3638ec None admin] PATH_INFO: `/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/81e9805ec4c44cedb658b7becf768369/roles/1f99b201b09e4780ba9ff6d5a33eb75d` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:48.695090 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1e85e-f151-4ae7-8bc5-82178a3638ec None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2eb230241340229293ca1aa5585cdc, user_id=81e9805ec4c44cedb658b7becf768369, role_id=1f99b201b09e4780ba9ff6d5a33eb75d)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:48.696544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1e85e-f151-4ae7-8bc5-82178a3638ec None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:48.709310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 520/1077] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:22:48 2022] PUT /identity/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/81e9805ec4c44cedb658b7becf768369/roles/1f99b201b09e4780ba9ff6d5a33eb75d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:22:48.893102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71881fa4-acb2-4ad8-90c3-82cb5326ea71 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:48.893393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71881fa4-acb2-4ad8-90c3-82cb5326ea71 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:48.893672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71881fa4-acb2-4ad8-90c3-82cb5326ea71 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:48.895047 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 558/1078] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:48.900873 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab100400-6044-4733-86ce-3fa655589c5a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:48.901167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab100400-6044-4733-86ce-3fa655589c5a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:48.901441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab100400-6044-4733-86ce-3fa655589c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:48.918387 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ab100400-6044-4733-86ce-3fa655589c5a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:48.919596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ab100400-6044-4733-86ce-3fa655589c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:48.984782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 521/1079] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:49.007377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71881fa4-acb2-4ad8-90c3-82cb5326ea71 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:49.089699 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:49.106971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71881fa4-acb2-4ad8-90c3-82cb5326ea71 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:49.139894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f1de8-1f63-42ee-959f-e45b07f85e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:49.140674 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f1de8-1f63-42ee-959f-e45b07f85e3f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:49.140955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f1de8-1f63-42ee-959f-e45b07f85e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:49.141225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f1de8-1f63-42ee-959f-e45b07f85e3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:49.151962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f1de8-1f63-42ee-959f-e45b07f85e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-7a8f1de8-1f63-42ee-959f-e45b07f85e3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:49.159393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:49.160361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:49.161248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:49.161248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:49.161248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:49.161248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:49.161248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:49.161248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:49.161248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:49.161248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:49.161248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:49.161248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:49.161248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:49.161248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:49.163793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 559/1080] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:22:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:49.167307 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab100400-6044-4733-86ce-3fa655589c5a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:49.238827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:49.264369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab100400-6044-4733-86ce-3fa655589c5a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:49.298114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31376fc9-778a-4f7d-9166-3992796555a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:49.298772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31376fc9-778a-4f7d-9166-3992796555a2 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:49.299052 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31376fc9-778a-4f7d-9166-3992796555a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:49.299323 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31376fc9-778a-4f7d-9166-3992796555a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:49.300095 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31376fc9-778a-4f7d-9166-3992796555a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:49.300394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31376fc9-778a-4f7d-9166-3992796555a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:49.301751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31376fc9-778a-4f7d-9166-3992796555a2 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:49.309727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 522/1081] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:22:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:49.315413 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f1de8-1f63-42ee-959f-e45b07f85e3f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:49.422670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f1de8-1f63-42ee-959f-e45b07f85e3f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:49.455682 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74315db-f1b4-4626-9b78-bde53fc2737c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:49.456543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74315db-f1b4-4626-9b78-bde53fc2737c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:49.456828 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74315db-f1b4-4626-9b78-bde53fc2737c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:49.457110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74315db-f1b4-4626-9b78-bde53fc2737c None admin] PATH_INFO: `/v3/users/6b4bf59339bd4222ac984d26a7bcb7bb` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:49.458281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74315db-f1b4-4626-9b78-bde53fc2737c None admin] RBAC: Authorizing `identity:get_user(user_id=6b4bf59339bd4222ac984d26a7bcb7bb)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:49.459786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74315db-f1b4-4626-9b78-bde53fc2737c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:49.461445 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 560/1082] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:22:49 2022] GET /identity/v3/users/6b4bf59339bd4222ac984d26a7bcb7bb => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:49.467158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31376fc9-778a-4f7d-9166-3992796555a2 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:49.567977 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31376fc9-778a-4f7d-9166-3992796555a2 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:49.599304 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc295-a0e1-4fdb-a1dd-85ef6eea5990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:49.600712 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc295-a0e1-4fdb-a1dd-85ef6eea5990 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:49.600994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc295-a0e1-4fdb-a1dd-85ef6eea5990 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:49.601266 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc295-a0e1-4fdb-a1dd-85ef6eea5990 None admin] PATH_INFO: `/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:49.602433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc295-a0e1-4fdb-a1dd-85ef6eea5990 None admin] RBAC: Authorizing `identity:get_project(project_id=16c4b05b4b574dc89b953f5ef5022bc2)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:49.603893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc295-a0e1-4fdb-a1dd-85ef6eea5990 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:49.605583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 523/1083] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:22:49 2022] GET /identity/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:49.611604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74315db-f1b4-4626-9b78-bde53fc2737c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:49.627498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:49.713438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74315db-f1b4-4626-9b78-bde53fc2737c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:49.745753 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0b291-493a-4866-8f5b-a9830081afbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:49.746621 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0b291-493a-4866-8f5b-a9830081afbd None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:49.746902 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0b291-493a-4866-8f5b-a9830081afbd None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:49.747170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0b291-493a-4866-8f5b-a9830081afbd None admin] PATH_INFO: `/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2/users/6b4bf59339bd4222ac984d26a7bcb7bb/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:49.749109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0b291-493a-4866-8f5b-a9830081afbd None admin] RBAC: Authorizing `identity:create_grant(project_id=16c4b05b4b574dc89b953f5ef5022bc2, user_id=6b4bf59339bd4222ac984d26a7bcb7bb, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:49.750520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0b291-493a-4866-8f5b-a9830081afbd None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:49.762840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 561/1084] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:22:49 2022] PUT /identity/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2/users/6b4bf59339bd4222ac984d26a7bcb7bb/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:22:50.815391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771b17-8112-4af6-9f77-645744f2c57a None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:50.815984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771b17-8112-4af6-9f77-645744f2c57a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:50.815984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771b17-8112-4af6-9f77-645744f2c57a None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:50.817390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 524/1085] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:50.823214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ba41b-4465-47e9-8285-8738ea5da98a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:50.823771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ba41b-4465-47e9-8285-8738ea5da98a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:50.823771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ba41b-4465-47e9-8285-8738ea5da98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:50.841264 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f43ba41b-4465-47e9-8285-8738ea5da98a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:50.842039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f43ba41b-4465-47e9-8285-8738ea5da98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:50.908640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 562/1086] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:50.932777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c771b17-8112-4af6-9f77-645744f2c57a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:50.936556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:51.033602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c771b17-8112-4af6-9f77-645744f2c57a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:51.065570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25899354-c577-4731-bb95-c80f08947098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:51.066364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25899354-c577-4731-bb95-c80f08947098 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:51.066655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25899354-c577-4731-bb95-c80f08947098 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:51.066931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25899354-c577-4731-bb95-c80f08947098 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:51.077754 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25899354-c577-4731-bb95-c80f08947098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-25899354-c577-4731-bb95-c80f08947098 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:51.086455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:51.087436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:51.088461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:51.088461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:51.088461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:51.088461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:51.088461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:51.088461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:51.088461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:51.088461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:51.088461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:51.088461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:51.088461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 10:22:51.088461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:51.088461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 525/1087] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Jun 15 10:22:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:51.093549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ba41b-4465-47e9-8285-8738ea5da98a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:51.095802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:51.193534 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ba41b-4465-47e9-8285-8738ea5da98a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:51.228127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424589b6-dd37-47ff-9fee-6142b13916b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:51.228779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424589b6-dd37-47ff-9fee-6142b13916b6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:51.229065 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424589b6-dd37-47ff-9fee-6142b13916b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:51.229422 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424589b6-dd37-47ff-9fee-6142b13916b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:51.230160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424589b6-dd37-47ff-9fee-6142b13916b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:51.230467 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424589b6-dd37-47ff-9fee-6142b13916b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:51.231856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424589b6-dd37-47ff-9fee-6142b13916b6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:51.239932 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 563/1088] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Jun 15 10:22:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:51.246407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25899354-c577-4731-bb95-c80f08947098 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:51.306757 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:51.346098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25899354-c577-4731-bb95-c80f08947098 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:51.379352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da503da-34b6-4c15-87d6-fc33f02aeafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:51.380161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da503da-34b6-4c15-87d6-fc33f02aeafa None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:51.380446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da503da-34b6-4c15-87d6-fc33f02aeafa None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:51.380722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da503da-34b6-4c15-87d6-fc33f02aeafa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:51.391488 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da503da-34b6-4c15-87d6-fc33f02aeafa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:51.392941 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da503da-34b6-4c15-87d6-fc33f02aeafa None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-9da503da-34b6-4c15-87d6-fc33f02aeafa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:51.410022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:51.411145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:51.417677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:51.417677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:51.417677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:51.417677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:51.417677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 526/1089] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:51.417977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424589b6-dd37-47ff-9fee-6142b13916b6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:51.479809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:51.519954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424589b6-dd37-47ff-9fee-6142b13916b6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:51.556382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474b732-6fd1-4941-b3b8-3dafe42e3418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:51.557043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474b732-6fd1-4941-b3b8-3dafe42e3418 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:51.557326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474b732-6fd1-4941-b3b8-3dafe42e3418 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:51.557602 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474b732-6fd1-4941-b3b8-3dafe42e3418 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:51.558325 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474b732-6fd1-4941-b3b8-3dafe42e3418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:51.558635 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474b732-6fd1-4941-b3b8-3dafe42e3418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:51.560132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474b732-6fd1-4941-b3b8-3dafe42e3418 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:51.571915 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 564/1090] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:51.577617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da503da-34b6-4c15-87d6-fc33f02aeafa None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:51.676656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da503da-34b6-4c15-87d6-fc33f02aeafa None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:51.693148 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:51.710969 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63febc-a18b-41c5-84d0-4f14e3a280fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:51.711807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63febc-a18b-41c5-84d0-4f14e3a280fe None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:51.712093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63febc-a18b-41c5-84d0-4f14e3a280fe None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:51.712370 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63febc-a18b-41c5-84d0-4f14e3a280fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:51.719794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63febc-a18b-41c5-84d0-4f14e3a280fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:51.721226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c63febc-a18b-41c5-84d0-4f14e3a280fe None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-6c63febc-a18b-41c5-84d0-4f14e3a280fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:22:51.737842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:51.739028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:51.740152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:51.740152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:51.740152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:22:51.740152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:22:51.740152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:22:51.740152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:22:51.740152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:22:51.740152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:22:51.740152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 10:22:51.740152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:51.740152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 527/1091] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Jun 15 10:22:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:51.745602 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474b732-6fd1-4941-b3b8-3dafe42e3418 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:51.847606 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474b732-6fd1-4941-b3b8-3dafe42e3418 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:51.872330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:51.880413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746c0b1-f5fb-4050-95bd-3e7a931103ef None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:51.880890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746c0b1-f5fb-4050-95bd-3e7a931103ef None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:51.881004 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746c0b1-f5fb-4050-95bd-3e7a931103ef None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:51.882367 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 528/1092] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:22:51.883758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5a7f1-abe0-4984-907d-e86525e6ece8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:51.884418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a7f1-abe0-4984-907d-e86525e6ece8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:51.884703 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a7f1-abe0-4984-907d-e86525e6ece8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:51.884983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5a7f1-abe0-4984-907d-e86525e6ece8 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:51.886080 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5a7f1-abe0-4984-907d-e86525e6ece8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:51.886213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5a7f1-abe0-4984-907d-e86525e6ece8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:51.887141 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381ba2c-da36-42ef-84aa-bfd5bed77401 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:51.887426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381ba2c-da36-42ef-84aa-bfd5bed77401 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:51.887659 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5a7f1-abe0-4984-907d-e86525e6ece8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:51.887769 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381ba2c-da36-42ef-84aa-bfd5bed77401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:51.904610 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-6381ba2c-da36-42ef-84aa-bfd5bed77401 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:51.905457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 565/1093] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Jun 15 10:22:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:51.905806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6381ba2c-da36-42ef-84aa-bfd5bed77401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:51.910964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5a7f1-abe0-4984-907d-e86525e6ece8 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:51.977089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 529/1094] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:22:52.000123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381ba2c-da36-42ef-84aa-bfd5bed77401 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:52.009571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5a7f1-abe0-4984-907d-e86525e6ece8 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:52.047408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537be75-8c3d-41dc-8fc8-74d5ca7044c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:52.048069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537be75-8c3d-41dc-8fc8-74d5ca7044c9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:52.048346 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537be75-8c3d-41dc-8fc8-74d5ca7044c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:52.048615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537be75-8c3d-41dc-8fc8-74d5ca7044c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:52.095437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:52.097790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381ba2c-da36-42ef-84aa-bfd5bed77401 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:52.106898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:52.114381 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537be75-8c3d-41dc-8fc8-74d5ca7044c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:52.115879 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537be75-8c3d-41dc-8fc8-74d5ca7044c9 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:52.133877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7f5da-5193-45fd-b3f5-ee24df8d37e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:52.134720 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7f5da-5193-45fd-b3f5-ee24df8d37e2 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:52.135005 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7f5da-5193-45fd-b3f5-ee24df8d37e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:52.135279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7f5da-5193-45fd-b3f5-ee24df8d37e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:52.145329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7f5da-5193-45fd-b3f5-ee24df8d37e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-bbd7f5da-5193-45fd-b3f5-ee24df8d37e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:22:52.153578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:52.154730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:52.155688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:52.155688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:52.155688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:52.155688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:52.155688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:22:52.155688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:22:52.155688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:22:52.155688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:22:52.155688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:22:52.155688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:22:52.155688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:22:52.155688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:22:52.155688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 530/1095] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:22:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:52.160736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7f5da-5193-45fd-b3f5-ee24df8d37e2 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:52.219727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 566/1096] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:22:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 10:22:52.220765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537be75-8c3d-41dc-8fc8-74d5ca7044c9 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:52.258099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7f5da-5193-45fd-b3f5-ee24df8d37e2 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:52.291889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19067e71-217e-47b9-a35a-d9de834d179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:52.292546 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19067e71-217e-47b9-a35a-d9de834d179d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:52.292823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19067e71-217e-47b9-a35a-d9de834d179d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:52.293106 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19067e71-217e-47b9-a35a-d9de834d179d None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:52.293849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19067e71-217e-47b9-a35a-d9de834d179d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:52.294155 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19067e71-217e-47b9-a35a-d9de834d179d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:52.295540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19067e71-217e-47b9-a35a-d9de834d179d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:52.299455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:52.303836 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 531/1097] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:22:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:52.309983 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19067e71-217e-47b9-a35a-d9de834d179d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:52.319480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537be75-8c3d-41dc-8fc8-74d5ca7044c9 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:52.337800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:52.356295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030c57f-b355-4425-8f74-5cb75d71e2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:52.357066 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030c57f-b355-4425-8f74-5cb75d71e2bd None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:52.357340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030c57f-b355-4425-8f74-5cb75d71e2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:52.357611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030c57f-b355-4425-8f74-5cb75d71e2bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:52.367784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030c57f-b355-4425-8f74-5cb75d71e2bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:52.369242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030c57f-b355-4425-8f74-5cb75d71e2bd None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-c030c57f-b355-4425-8f74-5cb75d71e2bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:22:52.390529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:52.391790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:52.392880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:22:52.392880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:22:52.392880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:22:52.392880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:52.393116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 567/1098] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:22:52.398893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030c57f-b355-4425-8f74-5cb75d71e2bd None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:52.414989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19067e71-217e-47b9-a35a-d9de834d179d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:52.448409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633215f-5fe6-4669-8952-66bc93bdfbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:52.449263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633215f-5fe6-4669-8952-66bc93bdfbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:52.449550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633215f-5fe6-4669-8952-66bc93bdfbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:52.449821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633215f-5fe6-4669-8952-66bc93bdfbc0 None admin] PATH_INFO: `/v3/users/6b4bf59339bd4222ac984d26a7bcb7bb` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:52.451001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633215f-5fe6-4669-8952-66bc93bdfbc0 None admin] RBAC: Authorizing `identity:get_user(user_id=6b4bf59339bd4222ac984d26a7bcb7bb)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:52.452462 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633215f-5fe6-4669-8952-66bc93bdfbc0 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:52.454112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 532/1099] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:22:52 2022] GET /identity/v3/users/6b4bf59339bd4222ac984d26a7bcb7bb => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:52.460176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633215f-5fe6-4669-8952-66bc93bdfbc0 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:52.499610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030c57f-b355-4425-8f74-5cb75d71e2bd None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:52.533872 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498bc9f-5189-4b2d-b884-d8cce61f5fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:52.534453 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498bc9f-5189-4b2d-b884-d8cce61f5fdf None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:52.534732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498bc9f-5189-4b2d-b884-d8cce61f5fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:52.535000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498bc9f-5189-4b2d-b884-d8cce61f5fdf None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:52.535732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498bc9f-5189-4b2d-b884-d8cce61f5fdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:52.536032 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498bc9f-5189-4b2d-b884-d8cce61f5fdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:52.537375 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498bc9f-5189-4b2d-b884-d8cce61f5fdf None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:52.538831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:52.550076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:52.550677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 568/1100] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:52.556087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498bc9f-5189-4b2d-b884-d8cce61f5fdf None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:52.556419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633215f-5fe6-4669-8952-66bc93bdfbc0 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:52.590603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef21fb-0a68-4a85-aba8-1f4700ebfc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:52.591252 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef21fb-0a68-4a85-aba8-1f4700ebfc27 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:52.591570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef21fb-0a68-4a85-aba8-1f4700ebfc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:52.591849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef21fb-0a68-4a85-aba8-1f4700ebfc27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:52.654773 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498bc9f-5189-4b2d-b884-d8cce61f5fdf None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:52.658279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef21fb-0a68-4a85-aba8-1f4700ebfc27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:52.659747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef21fb-0a68-4a85-aba8-1f4700ebfc27 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:52.690420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e29f59-7b53-49bc-b9e8-ce2fc1ec6889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:52.691214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e29f59-7b53-49bc-b9e8-ce2fc1ec6889 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:52.691523 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e29f59-7b53-49bc-b9e8-ce2fc1ec6889 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:52.691799 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e29f59-7b53-49bc-b9e8-ce2fc1ec6889 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:52.699213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e29f59-7b53-49bc-b9e8-ce2fc1ec6889 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:52.700695 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e29f59-7b53-49bc-b9e8-ce2fc1ec6889 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-b0e29f59-7b53-49bc-b9e8-ce2fc1ec6889 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:22:52.718886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:22:52.720070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:22:52.721027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:22:52.721027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:22:52.721027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:22:52.721027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:22:52.721027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:22:52.721027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:22:52.721027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:22:52.721027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:22:52.721027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 569/1101] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:22:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:22:52.725791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e29f59-7b53-49bc-b9e8-ce2fc1ec6889 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:52.755451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:52.763243 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 533/1102] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:22:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 10:22:52.768965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef21fb-0a68-4a85-aba8-1f4700ebfc27 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:52.781689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:52.826075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e29f59-7b53-49bc-b9e8-ce2fc1ec6889 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:52.860268 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf6c99-49eb-4566-b43e-0a2f66e5e113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:52.860921 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf6c99-49eb-4566-b43e-0a2f66e5e113 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:52.861199 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf6c99-49eb-4566-b43e-0a2f66e5e113 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:52.861473 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf6c99-49eb-4566-b43e-0a2f66e5e113 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:52.862254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf6c99-49eb-4566-b43e-0a2f66e5e113 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:52.862562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf6c99-49eb-4566-b43e-0a2f66e5e113 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:52.864007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf6c99-49eb-4566-b43e-0a2f66e5e113 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:52.865447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef21fb-0a68-4a85-aba8-1f4700ebfc27 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:52.876113 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 570/1103] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:22:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:52.882718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf6c99-49eb-4566-b43e-0a2f66e5e113 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:52.899414 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ee8e9-e381-479f-852f-22371b84c430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:52.900288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ee8e9-e381-479f-852f-22371b84c430 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:52.900575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ee8e9-e381-479f-852f-22371b84c430 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:52.900847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ee8e9-e381-479f-852f-22371b84c430 None admin] PATH_INFO: `/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:52.902203 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ee8e9-e381-479f-852f-22371b84c430 None admin] RBAC: Authorizing `identity:get_project(project_id=16c4b05b4b574dc89b953f5ef5022bc2)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:52.903656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ee8e9-e381-479f-852f-22371b84c430 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:52.905360 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 534/1104] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:22:52 2022] GET /identity/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:52.911145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ee8e9-e381-479f-852f-22371b84c430 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:52.972390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:52.981371 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf6c99-49eb-4566-b43e-0a2f66e5e113 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:52.996343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:53.011793 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ee8e9-e381-479f-852f-22371b84c430 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:53.020293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9c977-f8be-4365-a6d9-ad39dca08fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:53.020945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c977-f8be-4365-a6d9-ad39dca08fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:53.021229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c977-f8be-4365-a6d9-ad39dca08fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:53.021501 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c977-f8be-4365-a6d9-ad39dca08fd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:53.022367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9c977-f8be-4365-a6d9-ad39dca08fd1 None admin] RBAC: Adding query filter params (role.id=1f99b201b09e4780ba9ff6d5a33eb75d, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=81e9805ec4c44cedb658b7becf768369) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:53.022679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9c977-f8be-4365-a6d9-ad39dca08fd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:53.024157 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9c977-f8be-4365-a6d9-ad39dca08fd1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:53.029935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 571/1105] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:22:52 2022] GET /identity/v3/role_assignments?user.id=81e9805ec4c44cedb658b7becf768369&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=1f99b201b09e4780ba9ff6d5a33eb75d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:53.046407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991358f6-0d36-45f4-87c9-7ce6f313bb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:53.047116 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991358f6-0d36-45f4-87c9-7ce6f313bb03 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:53.047395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991358f6-0d36-45f4-87c9-7ce6f313bb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:53.047698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991358f6-0d36-45f4-87c9-7ce6f313bb03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:53.048549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991358f6-0d36-45f4-87c9-7ce6f313bb03 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=16c4b05b4b574dc89b953f5ef5022bc2, user.id=6b4bf59339bd4222ac984d26a7bcb7bb) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:53.048859 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991358f6-0d36-45f4-87c9-7ce6f313bb03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:53.050328 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991358f6-0d36-45f4-87c9-7ce6f313bb03 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:53.057812 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 535/1106] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:22:52 2022] GET /identity/v3/role_assignments?user.id=6b4bf59339bd4222ac984d26a7bcb7bb&scope.project.id=16c4b05b4b574dc89b953f5ef5022bc2&role.id=e1a2021d08e14daa969362b3d23face3 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:22:55.224929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4337-732e-4faa-b5d7-795cd7ed515d None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:55.226027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4337-732e-4faa-b5d7-795cd7ed515d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:55.226027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae4337-732e-4faa-b5d7-795cd7ed515d None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:55.227329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 572/1107] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:55.232439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1a41d-925b-499d-baf3-1ae025204efb None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:55.232838 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1a41d-925b-499d-baf3-1ae025204efb None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:55.232999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1a41d-925b-499d-baf3-1ae025204efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:55.250067 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-f7c1a41d-925b-499d-baf3-1ae025204efb None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:55.251252 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f7c1a41d-925b-499d-baf3-1ae025204efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:55.315173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 536/1108] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:55.339599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae4337-732e-4faa-b5d7-795cd7ed515d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:55.440995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae4337-732e-4faa-b5d7-795cd7ed515d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:55.473183 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909d9d6-67ad-4a18-bae8-42671d4faa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:55.473956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909d9d6-67ad-4a18-bae8-42671d4faa09 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:55.474237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909d9d6-67ad-4a18-bae8-42671d4faa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:55.474511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909d9d6-67ad-4a18-bae8-42671d4faa09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:55.476259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909d9d6-67ad-4a18-bae8-42671d4faa09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:55.477633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909d9d6-67ad-4a18-bae8-42671d4faa09 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:55.479308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 573/1109] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:22:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:55.485051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1a41d-925b-499d-baf3-1ae025204efb None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:55.540915 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:55.581944 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1a41d-925b-499d-baf3-1ae025204efb None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:55.615283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d57d0b-d5a8-4803-af0e-55ed7b164397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:55.616550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d57d0b-d5a8-4803-af0e-55ed7b164397 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:55.616826 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d57d0b-d5a8-4803-af0e-55ed7b164397 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:55.617353 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d57d0b-d5a8-4803-af0e-55ed7b164397 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:55.618052 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d57d0b-d5a8-4803-af0e-55ed7b164397 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:55.619494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d57d0b-d5a8-4803-af0e-55ed7b164397 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:55.638636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 537/1110] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:22:55 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:22:57.748657 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f727e1d-652a-4cf2-b1cf-f9e88e78baef None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:57.749205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f727e1d-652a-4cf2-b1cf-f9e88e78baef None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:57.749205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f727e1d-652a-4cf2-b1cf-f9e88e78baef None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:57.750539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 574/1111] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:22:57.757072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f2d55-f235-48ad-b56e-8729e7143de2 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:57.757743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f2d55-f235-48ad-b56e-8729e7143de2 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:57.757743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f2d55-f235-48ad-b56e-8729e7143de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:57.774674 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-769f2d55-f235-48ad-b56e-8729e7143de2 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:22:57.775897 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-769f2d55-f235-48ad-b56e-8729e7143de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:22:57.839292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 538/1112] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:22:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:22:57.863325 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f727e1d-652a-4cf2-b1cf-f9e88e78baef None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:57.909931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:57.961902 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f727e1d-652a-4cf2-b1cf-f9e88e78baef None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:57.995129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a4760-9e41-4d93-b5de-cf7fdc7f710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:57.995982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a4760-9e41-4d93-b5de-cf7fdc7f710f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:57.996264 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a4760-9e41-4d93-b5de-cf7fdc7f710f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:57.996536 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a4760-9e41-4d93-b5de-cf7fdc7f710f None admin] PATH_INFO: `/v3/roles/9c6db94ddc204b7e860aa2a9d622e14b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:57.997971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a4760-9e41-4d93-b5de-cf7fdc7f710f None admin] RBAC: Authorizing `identity:get_role(role_id=9c6db94ddc204b7e860aa2a9d622e14b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:57.999327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a4760-9e41-4d93-b5de-cf7fdc7f710f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:58.000833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 575/1113] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:22:57 2022] GET /identity/v3/roles/9c6db94ddc204b7e860aa2a9d622e14b => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:58.006502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f2d55-f235-48ad-b56e-8729e7143de2 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:58.049810 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:58.103181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f2d55-f235-48ad-b56e-8729e7143de2 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:58.135561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1742f-663b-40f5-8ee8-6c7ce0b439af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:58.136426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1742f-663b-40f5-8ee8-6c7ce0b439af None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:58.136708 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1742f-663b-40f5-8ee8-6c7ce0b439af None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:58.136981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1742f-663b-40f5-8ee8-6c7ce0b439af None admin] PATH_INFO: `/v3/users/df5b3c8c100249b382696a307d1071b4` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:58.149941 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1742f-663b-40f5-8ee8-6c7ce0b439af None admin] RBAC: Authorizing `identity:get_user(user_id=df5b3c8c100249b382696a307d1071b4)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:58.151459 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1742f-663b-40f5-8ee8-6c7ce0b439af None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:58.153107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 539/1114] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:22:58 2022] GET /identity/v3/users/df5b3c8c100249b382696a307d1071b4 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:58.158796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a4760-9e41-4d93-b5de-cf7fdc7f710f None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:58.253533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a4760-9e41-4d93-b5de-cf7fdc7f710f None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:58.267480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:58.287346 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42544078-7295-472b-930a-b6b52d3fb84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:58.288025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42544078-7295-472b-930a-b6b52d3fb84a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:58.288306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42544078-7295-472b-930a-b6b52d3fb84a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:58.288576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42544078-7295-472b-930a-b6b52d3fb84a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:58.352580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42544078-7295-472b-930a-b6b52d3fb84a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:58.353990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42544078-7295-472b-930a-b6b52d3fb84a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:58.448607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 576/1115] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:22:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:22:58.454670 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1742f-663b-40f5-8ee8-6c7ce0b439af None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:58.550390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1742f-663b-40f5-8ee8-6c7ce0b439af None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:58.551831 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:58.585216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b312b82-83b2-4c12-88e2-a5e7abdf2d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:58.586057 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b312b82-83b2-4c12-88e2-a5e7abdf2d6b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:58.586339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b312b82-83b2-4c12-88e2-a5e7abdf2d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:58.586606 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b312b82-83b2-4c12-88e2-a5e7abdf2d6b None admin] PATH_INFO: `/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:58.587804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b312b82-83b2-4c12-88e2-a5e7abdf2d6b None admin] RBAC: Authorizing `identity:get_project(project_id=16c4b05b4b574dc89b953f5ef5022bc2)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:58.589221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b312b82-83b2-4c12-88e2-a5e7abdf2d6b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:58.590874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 540/1116] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:22:58 2022] GET /identity/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:22:58.596902 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42544078-7295-472b-930a-b6b52d3fb84a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:22:58.611451 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:22:58.694546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42544078-7295-472b-930a-b6b52d3fb84a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:22:58.726978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02629000-1478-46ee-bf2b-44b6af683e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:22:58.727548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02629000-1478-46ee-bf2b-44b6af683e5a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:22:58.727833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02629000-1478-46ee-bf2b-44b6af683e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:22:58.728107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02629000-1478-46ee-bf2b-44b6af683e5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:22:58.728924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02629000-1478-46ee-bf2b-44b6af683e5a None admin] RBAC: Adding query filter params (role.id=9c6db94ddc204b7e860aa2a9d622e14b, scope.project.id=16c4b05b4b574dc89b953f5ef5022bc2, user.id=df5b3c8c100249b382696a307d1071b4) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:22:58.729232 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02629000-1478-46ee-bf2b-44b6af683e5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:22:58.730640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02629000-1478-46ee-bf2b-44b6af683e5a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:22:58.736069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 577/1117] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:22:58 2022] GET /identity/v3/role_assignments?user.id=df5b3c8c100249b382696a307d1071b4&scope.project.id=16c4b05b4b574dc89b953f5ef5022bc2&role.id=9c6db94ddc204b7e860aa2a9d622e14b => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:00.806792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5b22b-150c-410d-809e-0ae707e0e89d None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:00.807354 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5b22b-150c-410d-809e-0ae707e0e89d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:00.807354 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5b22b-150c-410d-809e-0ae707e0e89d None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:00.808743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 541/1118] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:23:00.813937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e449063-0939-43ac-8827-c5cb82aae897 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:00.814359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e449063-0939-43ac-8827-c5cb82aae897 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:00.814484 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e449063-0939-43ac-8827-c5cb82aae897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:00.831048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4e449063-0939-43ac-8827-c5cb82aae897 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:23:00.832253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4e449063-0939-43ac-8827-c5cb82aae897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:23:00.896228 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 578/1119] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:23:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:23:00.919301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5b22b-150c-410d-809e-0ae707e0e89d None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:01.016211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5b22b-150c-410d-809e-0ae707e0e89d None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:01.050001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce067f-1aaf-4ddb-ad45-2e9e451cd82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:01.050845 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce067f-1aaf-4ddb-ad45-2e9e451cd82f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:01.051127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce067f-1aaf-4ddb-ad45-2e9e451cd82f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:01.051401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce067f-1aaf-4ddb-ad45-2e9e451cd82f None admin] PATH_INFO: `/v3/roles/9c6db94ddc204b7e860aa2a9d622e14b` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:01.052880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce067f-1aaf-4ddb-ad45-2e9e451cd82f None admin] RBAC: Authorizing `identity:get_role(role_id=9c6db94ddc204b7e860aa2a9d622e14b)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:01.054283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce067f-1aaf-4ddb-ad45-2e9e451cd82f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:01.055668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 542/1120] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:23:00 2022] GET /identity/v3/roles/9c6db94ddc204b7e860aa2a9d622e14b => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:01.061461 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e449063-0939-43ac-8827-c5cb82aae897 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:01.071425 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:01.158899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e449063-0939-43ac-8827-c5cb82aae897 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:01.191740 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4bc47-de22-40d0-a048-d21e233c2061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:01.192591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4bc47-de22-40d0-a048-d21e233c2061 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:01.192872 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4bc47-de22-40d0-a048-d21e233c2061 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:01.193144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4bc47-de22-40d0-a048-d21e233c2061 None admin] PATH_INFO: `/v3/users/df5b3c8c100249b382696a307d1071b4` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:01.194281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4bc47-de22-40d0-a048-d21e233c2061 None admin] RBAC: Authorizing `identity:get_user(user_id=df5b3c8c100249b382696a307d1071b4)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:01.195729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4bc47-de22-40d0-a048-d21e233c2061 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:01.197329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 579/1121] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:23:01 2022] GET /identity/v3/users/df5b3c8c100249b382696a307d1071b4 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:01.202873 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce067f-1aaf-4ddb-ad45-2e9e451cd82f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:01.241490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:01.298686 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce067f-1aaf-4ddb-ad45-2e9e451cd82f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:01.330622 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba3b2b-f774-4aa4-b0a7-7585707eff64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:01.331453 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba3b2b-f774-4aa4-b0a7-7585707eff64 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:01.331752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba3b2b-f774-4aa4-b0a7-7585707eff64 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:01.332022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba3b2b-f774-4aa4-b0a7-7585707eff64 None admin] PATH_INFO: `/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:01.333173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba3b2b-f774-4aa4-b0a7-7585707eff64 None admin] RBAC: Authorizing `identity:get_project(project_id=16c4b05b4b574dc89b953f5ef5022bc2)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:01.335186 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba3b2b-f774-4aa4-b0a7-7585707eff64 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:01.336871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 543/1122] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:23:01 2022] GET /identity/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:01.342545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4bc47-de22-40d0-a048-d21e233c2061 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:01.420204 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:01.442904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4bc47-de22-40d0-a048-d21e233c2061 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:01.476630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b75263-9949-4ac7-bd15-3ee2d1bc13dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:01.477500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b75263-9949-4ac7-bd15-3ee2d1bc13dd None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:01.477784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b75263-9949-4ac7-bd15-3ee2d1bc13dd None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:01.478061 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b75263-9949-4ac7-bd15-3ee2d1bc13dd None admin] PATH_INFO: `/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2/users/df5b3c8c100249b382696a307d1071b4/roles/9c6db94ddc204b7e860aa2a9d622e14b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:01.480251 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b75263-9949-4ac7-bd15-3ee2d1bc13dd None admin] RBAC: Authorizing `identity:create_grant(project_id=16c4b05b4b574dc89b953f5ef5022bc2, user_id=df5b3c8c100249b382696a307d1071b4, role_id=9c6db94ddc204b7e860aa2a9d622e14b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:01.481691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b75263-9949-4ac7-bd15-3ee2d1bc13dd None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:01.494930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 580/1123] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:23:01 2022] PUT /identity/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2/users/df5b3c8c100249b382696a307d1071b4/roles/9c6db94ddc204b7e860aa2a9d622e14b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:23:03.578451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415f6f-c33a-4a68-9458-dad79935ae55 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:03.579007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415f6f-c33a-4a68-9458-dad79935ae55 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:03.579007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415f6f-c33a-4a68-9458-dad79935ae55 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:03.580370 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 544/1124] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:23:03.585962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea97beb-0123-45d4-befc-ce91cd6a0cea None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:03.586340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea97beb-0123-45d4-befc-ce91cd6a0cea None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:03.586508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea97beb-0123-45d4-befc-ce91cd6a0cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:03.602551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-dea97beb-0123-45d4-befc-ce91cd6a0cea None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:23:03.603760 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dea97beb-0123-45d4-befc-ce91cd6a0cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:23:03.674270 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 581/1125] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:23:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:23:03.697598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49415f6f-c33a-4a68-9458-dad79935ae55 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:03.795124 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49415f6f-c33a-4a68-9458-dad79935ae55 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:03.802042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:03.828338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1407d3-7e9a-4c34-88af-bf2af324e538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:03.829231 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1407d3-7e9a-4c34-88af-bf2af324e538 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:03.829461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1407d3-7e9a-4c34-88af-bf2af324e538 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:03.829737 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1407d3-7e9a-4c34-88af-bf2af324e538 None admin] PATH_INFO: `/v3/roles/9c6db94ddc204b7e860aa2a9d622e14b` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:03.831194 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1407d3-7e9a-4c34-88af-bf2af324e538 None admin] RBAC: Authorizing `identity:get_role(role_id=9c6db94ddc204b7e860aa2a9d622e14b)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:03.832588 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1407d3-7e9a-4c34-88af-bf2af324e538 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:03.833942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 545/1126] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:23:03 2022] GET /identity/v3/roles/9c6db94ddc204b7e860aa2a9d622e14b => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:03.840259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea97beb-0123-45d4-befc-ce91cd6a0cea None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:03.902339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:03.936677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea97beb-0123-45d4-befc-ce91cd6a0cea None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:03.969279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6558f5-0fb7-41f9-a7d4-e0735a33276a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:03.970121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6558f5-0fb7-41f9-a7d4-e0735a33276a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:03.970399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6558f5-0fb7-41f9-a7d4-e0735a33276a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:03.970668 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6558f5-0fb7-41f9-a7d4-e0735a33276a None admin] PATH_INFO: `/v3/users/df5b3c8c100249b382696a307d1071b4` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:03.971846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6558f5-0fb7-41f9-a7d4-e0735a33276a None admin] RBAC: Authorizing `identity:get_user(user_id=df5b3c8c100249b382696a307d1071b4)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:03.973246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6558f5-0fb7-41f9-a7d4-e0735a33276a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:03.974829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 582/1127] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:23:03 2022] GET /identity/v3/users/df5b3c8c100249b382696a307d1071b4 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:03.980442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1407d3-7e9a-4c34-88af-bf2af324e538 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:04.075305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1407d3-7e9a-4c34-88af-bf2af324e538 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:04.107065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e9c3f-e92f-4387-9b6f-0defa8becd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:04.107723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9c3f-e92f-4387-9b6f-0defa8becd5d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:04.108007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9c3f-e92f-4387-9b6f-0defa8becd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:04.108281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9c3f-e92f-4387-9b6f-0defa8becd5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:04.149530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:04.173605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e9c3f-e92f-4387-9b6f-0defa8becd5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:04.175056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e9c3f-e92f-4387-9b6f-0defa8becd5d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:04.269730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 546/1128] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:23:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:23:04.275668 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6558f5-0fb7-41f9-a7d4-e0735a33276a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:04.371191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6558f5-0fb7-41f9-a7d4-e0735a33276a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:04.402933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e24623-21b2-4991-99f5-4bdd26842b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:04.403782 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e24623-21b2-4991-99f5-4bdd26842b26 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:04.404058 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e24623-21b2-4991-99f5-4bdd26842b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:04.404324 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e24623-21b2-4991-99f5-4bdd26842b26 None admin] PATH_INFO: `/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:04.405464 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e24623-21b2-4991-99f5-4bdd26842b26 None admin] RBAC: Authorizing `identity:get_project(project_id=16c4b05b4b574dc89b953f5ef5022bc2)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:04.406864 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e24623-21b2-4991-99f5-4bdd26842b26 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:04.408582 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 583/1129] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:23:04 2022] GET /identity/v3/projects/16c4b05b4b574dc89b953f5ef5022bc2 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:04.415214 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e9c3f-e92f-4387-9b6f-0defa8becd5d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:04.487420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:04.512453 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e9c3f-e92f-4387-9b6f-0defa8becd5d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:04.545317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff7c93-2335-46f0-93b9-487ab100a00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:04.545955 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff7c93-2335-46f0-93b9-487ab100a00c None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:04.546230 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff7c93-2335-46f0-93b9-487ab100a00c None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:04.546499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff7c93-2335-46f0-93b9-487ab100a00c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:04.547314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff7c93-2335-46f0-93b9-487ab100a00c None admin] RBAC: Adding query filter params (role.id=9c6db94ddc204b7e860aa2a9d622e14b, scope.project.id=16c4b05b4b574dc89b953f5ef5022bc2, user.id=df5b3c8c100249b382696a307d1071b4) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:23:04.547647 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff7c93-2335-46f0-93b9-487ab100a00c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:04.549058 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff7c93-2335-46f0-93b9-487ab100a00c None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:04.554654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 547/1130] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:23:04 2022] GET /identity/v3/role_assignments?user.id=df5b3c8c100249b382696a307d1071b4&scope.project.id=16c4b05b4b574dc89b953f5ef5022bc2&role.id=9c6db94ddc204b7e860aa2a9d622e14b => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:06.677699 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9e78d-9fd7-4e50-961c-58789865eb53 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:06.678766 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9e78d-9fd7-4e50-961c-58789865eb53 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:06.678866 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9e78d-9fd7-4e50-961c-58789865eb53 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:06.680216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 584/1131] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:23:06.685336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435c07d-5007-46c5-ba78-cf102fe1ee10 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:06.685790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435c07d-5007-46c5-ba78-cf102fe1ee10 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:06.685896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435c07d-5007-46c5-ba78-cf102fe1ee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:06.702002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-6435c07d-5007-46c5-ba78-cf102fe1ee10 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:23:06.703174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6435c07d-5007-46c5-ba78-cf102fe1ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:23:06.767721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 548/1132] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:23:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:23:06.790890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9e78d-9fd7-4e50-961c-58789865eb53 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:06.793769 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:06.890301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9e78d-9fd7-4e50-961c-58789865eb53 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:06.923664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e2ee5-ca58-4341-8d4e-d52a1ce6a96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:06.924377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e2ee5-ca58-4341-8d4e-d52a1ce6a96c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:06.924659 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e2ee5-ca58-4341-8d4e-d52a1ce6a96c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:06.924931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e2ee5-ca58-4341-8d4e-d52a1ce6a96c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:06.926089 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e2ee5-ca58-4341-8d4e-d52a1ce6a96c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:06.927535 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e2ee5-ca58-4341-8d4e-d52a1ce6a96c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:06.929155 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 585/1133] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:23:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:06.934892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435c07d-5007-46c5-ba78-cf102fe1ee10 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:06.999478 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:07.031211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435c07d-5007-46c5-ba78-cf102fe1ee10 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:07.063847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e36815-0946-4294-b462-fb0f782c38c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:07.064493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e36815-0946-4294-b462-fb0f782c38c4 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:07.064777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e36815-0946-4294-b462-fb0f782c38c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:07.065054 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e36815-0946-4294-b462-fb0f782c38c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:07.065744 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e36815-0946-4294-b462-fb0f782c38c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:07.067160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e36815-0946-4294-b462-fb0f782c38c4 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:07.091471 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 549/1134] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Jun 15 10:23:06 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:23:09.227879 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42038462-cf0a-4099-beaa-0ce62725c26b None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:09.228432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42038462-cf0a-4099-beaa-0ce62725c26b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:09.228432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42038462-cf0a-4099-beaa-0ce62725c26b None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:09.229781 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 586/1135] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:23:09.234985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0bf83-27ac-4128-9ec9-57f0d2aed6a4 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:09.235380 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0bf83-27ac-4128-9ec9-57f0d2aed6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:09.235578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0bf83-27ac-4128-9ec9-57f0d2aed6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:09.252718 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-28f0bf83-27ac-4128-9ec9-57f0d2aed6a4 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:23:09.253894 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-28f0bf83-27ac-4128-9ec9-57f0d2aed6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:23:09.317765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 550/1136] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:23:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:23:09.342482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42038462-cf0a-4099-beaa-0ce62725c26b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:09.412810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:09.443490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42038462-cf0a-4099-beaa-0ce62725c26b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:09.476736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef412dc2-d7b9-4e9b-8738-4044e676f0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:09.477503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef412dc2-d7b9-4e9b-8738-4044e676f0aa None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:09.477784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef412dc2-d7b9-4e9b-8738-4044e676f0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:09.478104 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef412dc2-d7b9-4e9b-8738-4044e676f0aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:09.479326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef412dc2-d7b9-4e9b-8738-4044e676f0aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:09.480766 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef412dc2-d7b9-4e9b-8738-4044e676f0aa None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:09.482362 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 587/1137] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:23:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:09.488094 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0bf83-27ac-4128-9ec9-57f0d2aed6a4 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:09.535127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:09.583006 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0bf83-27ac-4128-9ec9-57f0d2aed6a4 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:09.616046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92a42c-c283-451e-bdde-ca966ed35fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:09.616712 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92a42c-c283-451e-bdde-ca966ed35fed None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:09.616995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92a42c-c283-451e-bdde-ca966ed35fed None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:09.617522 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92a42c-c283-451e-bdde-ca966ed35fed None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:09.618221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92a42c-c283-451e-bdde-ca966ed35fed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:09.619713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92a42c-c283-451e-bdde-ca966ed35fed None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:09.641011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 551/1138] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:23:09 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:23:11.760648 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c213f-97e1-4ef5-b856-c22b124ad48e None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:11.761191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c213f-97e1-4ef5-b856-c22b124ad48e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:11.761191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c213f-97e1-4ef5-b856-c22b124ad48e None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:11.762559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 588/1139] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:23:11.767861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0aaf5-f64b-466a-b168-1c7a7c1611b7 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:11.768272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0aaf5-f64b-466a-b168-1c7a7c1611b7 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:11.768415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0aaf5-f64b-466a-b168-1c7a7c1611b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:11.784723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-66f0aaf5-f64b-466a-b168-1c7a7c1611b7 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:23:11.785867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-66f0aaf5-f64b-466a-b168-1c7a7c1611b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:23:11.849339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 552/1140] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:23:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:23:11.873729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c213f-97e1-4ef5-b856-c22b124ad48e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:11.972764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c213f-97e1-4ef5-b856-c22b124ad48e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:12.005470 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecb347-4782-4cac-8a66-9686e0e9b3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:12.006746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecb347-4782-4cac-8a66-9686e0e9b3be None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:12.007026 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecb347-4782-4cac-8a66-9686e0e9b3be None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:12.007296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecb347-4782-4cac-8a66-9686e0e9b3be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:12.014076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:12.018104 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecb347-4782-4cac-8a66-9686e0e9b3be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-4aecb347-4782-4cac-8a66-9686e0e9b3be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:23:12.026954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:23:12.028216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:23:12.029495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:23:12.029495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:23:12.029495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:23:12.029495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:23:12.029495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:23:12.029495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:23:12.029495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:23:12.029495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:23:12.029495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:23:12.029495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:23:12.029495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:23:12.029495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:23:12.029495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 589/1141] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:23:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:23:12.033989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0aaf5-f64b-466a-b168-1c7a7c1611b7 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:12.066153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:12.129153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0aaf5-f64b-466a-b168-1c7a7c1611b7 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:12.161104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa712e3-6ba5-411d-a610-9507109095f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:12.161749 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa712e3-6ba5-411d-a610-9507109095f6 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:12.162025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa712e3-6ba5-411d-a610-9507109095f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:12.162317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa712e3-6ba5-411d-a610-9507109095f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:12.163051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa712e3-6ba5-411d-a610-9507109095f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:23:12.163350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa712e3-6ba5-411d-a610-9507109095f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:12.164728 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa712e3-6ba5-411d-a610-9507109095f6 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:12.172427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 553/1142] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:23:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:12.178617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecb347-4782-4cac-8a66-9686e0e9b3be None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:12.275631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecb347-4782-4cac-8a66-9686e0e9b3be None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:12.307963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7c380-8f5a-43d9-882e-1ab46f98032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:12.308798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c380-8f5a-43d9-882e-1ab46f98032c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:12.309081 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c380-8f5a-43d9-882e-1ab46f98032c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:12.309356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c380-8f5a-43d9-882e-1ab46f98032c None admin] PATH_INFO: `/v3/users/f350d5a0256f4ea18e189bcfd41b704a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:12.322692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7c380-8f5a-43d9-882e-1ab46f98032c None admin] RBAC: Authorizing `identity:get_user(user_id=f350d5a0256f4ea18e189bcfd41b704a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:12.324169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7c380-8f5a-43d9-882e-1ab46f98032c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:12.325810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 590/1143] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:23:12 2022] GET /identity/v3/users/f350d5a0256f4ea18e189bcfd41b704a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:12.331385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa712e3-6ba5-411d-a610-9507109095f6 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:12.425177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:12.429824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa712e3-6ba5-411d-a610-9507109095f6 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:12.462253 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a912f64-19d7-40da-b4c9-26508a7bca66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:12.462888 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a912f64-19d7-40da-b4c9-26508a7bca66 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:12.463208 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a912f64-19d7-40da-b4c9-26508a7bca66 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:12.463553 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a912f64-19d7-40da-b4c9-26508a7bca66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:12.528343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a912f64-19d7-40da-b4c9-26508a7bca66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:12.529717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a912f64-19d7-40da-b4c9-26508a7bca66 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:12.619985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:12.624751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 554/1144] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:23:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:23:12.630411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7c380-8f5a-43d9-882e-1ab46f98032c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:12.686888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:12.728877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7c380-8f5a-43d9-882e-1ab46f98032c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:12.761505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69edc9b-0c18-49e7-a2e6-22f04795ad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:12.762342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69edc9b-0c18-49e7-a2e6-22f04795ad1c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:12.762622 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69edc9b-0c18-49e7-a2e6-22f04795ad1c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:12.762895 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69edc9b-0c18-49e7-a2e6-22f04795ad1c None admin] PATH_INFO: `/v3/projects/9cd2d8980178404bb8f400514185599f` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:12.764068 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69edc9b-0c18-49e7-a2e6-22f04795ad1c None admin] RBAC: Authorizing `identity:get_project(project_id=9cd2d8980178404bb8f400514185599f)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:12.765472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69edc9b-0c18-49e7-a2e6-22f04795ad1c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:12.767142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 591/1145] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:23:12 2022] GET /identity/v3/projects/9cd2d8980178404bb8f400514185599f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:12.773492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a912f64-19d7-40da-b4c9-26508a7bca66 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:12.874222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a912f64-19d7-40da-b4c9-26508a7bca66 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:12.906760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e270947-92e8-4057-86ea-5ead378c2f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:12.907402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e270947-92e8-4057-86ea-5ead378c2f83 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:12.907708 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e270947-92e8-4057-86ea-5ead378c2f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:12.907982 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e270947-92e8-4057-86ea-5ead378c2f83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:12.908805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e270947-92e8-4057-86ea-5ead378c2f83 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=9cd2d8980178404bb8f400514185599f, user.id=f350d5a0256f4ea18e189bcfd41b704a) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:23:12.909114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e270947-92e8-4057-86ea-5ead378c2f83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:12.910541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e270947-92e8-4057-86ea-5ead378c2f83 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:12.916499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 555/1146] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:23:12 2022] GET /identity/v3/role_assignments?user.id=f350d5a0256f4ea18e189bcfd41b704a&scope.project.id=9cd2d8980178404bb8f400514185599f&role.id=e1a2021d08e14daa969362b3d23face3 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:14.985244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c17e5d-384c-42d5-b375-95ff57fc52c4 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:14.985777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c17e5d-384c-42d5-b375-95ff57fc52c4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:14.985777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c17e5d-384c-42d5-b375-95ff57fc52c4 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:14.987059 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 592/1147] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:23:14.992546 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a14974-7c3d-4805-92a8-2f475053bf0a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:14.992930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a14974-7c3d-4805-92a8-2f475053bf0a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:14.993110 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a14974-7c3d-4805-92a8-2f475053bf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:15.010060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-49a14974-7c3d-4805-92a8-2f475053bf0a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:23:15.011223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-49a14974-7c3d-4805-92a8-2f475053bf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:23:15.064963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:15.075874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 556/1148] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:23:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:23:15.098991 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c17e5d-384c-42d5-b375-95ff57fc52c4 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:15.196543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c17e5d-384c-42d5-b375-95ff57fc52c4 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:15.218413 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:15.228780 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ff613-7e34-4e16-b861-1ef78544749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:15.229535 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ff613-7e34-4e16-b861-1ef78544749a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:15.229813 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ff613-7e34-4e16-b861-1ef78544749a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:15.230084 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ff613-7e34-4e16-b861-1ef78544749a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:15.239867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ff613-7e34-4e16-b861-1ef78544749a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-d36ff613-7e34-4e16-b861-1ef78544749a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:23:15.248106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:23:15.249235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:23:15.250365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:23:15.250365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:23:15.250365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:23:15.250365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:23:15.250365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:23:15.250365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:23:15.250365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:23:15.250365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:23:15.250365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:23:15.250365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:23:15.250365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:23:15.250365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:23:15.250365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 593/1149] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:23:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:23:15.255348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a14974-7c3d-4805-92a8-2f475053bf0a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:15.348729 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a14974-7c3d-4805-92a8-2f475053bf0a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:15.382008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2949a3a-595d-4b1d-b67d-c97c711fc22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:15.382652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949a3a-595d-4b1d-b67d-c97c711fc22c None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:15.382927 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949a3a-595d-4b1d-b67d-c97c711fc22c None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:15.383197 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2949a3a-595d-4b1d-b67d-c97c711fc22c None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:15.383959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2949a3a-595d-4b1d-b67d-c97c711fc22c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:23:15.384259 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2949a3a-595d-4b1d-b67d-c97c711fc22c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:15.385606 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2949a3a-595d-4b1d-b67d-c97c711fc22c None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:15.393235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 557/1150] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:23:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:15.398850 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ff613-7e34-4e16-b861-1ef78544749a None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:15.495282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ff613-7e34-4e16-b861-1ef78544749a None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:15.532048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59a2ee-86e7-4e91-9f67-eed9bfc5d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:15.532907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59a2ee-86e7-4e91-9f67-eed9bfc5d4ad None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:15.533185 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59a2ee-86e7-4e91-9f67-eed9bfc5d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:15.533458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59a2ee-86e7-4e91-9f67-eed9bfc5d4ad None admin] PATH_INFO: `/v3/users/f350d5a0256f4ea18e189bcfd41b704a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:15.534615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59a2ee-86e7-4e91-9f67-eed9bfc5d4ad None admin] RBAC: Authorizing `identity:get_user(user_id=f350d5a0256f4ea18e189bcfd41b704a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:15.536052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59a2ee-86e7-4e91-9f67-eed9bfc5d4ad None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:15.538195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 594/1151] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:23:15 2022] GET /identity/v3/users/f350d5a0256f4ea18e189bcfd41b704a => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:15.544048 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2949a3a-595d-4b1d-b67d-c97c711fc22c None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:15.596837 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:15.640990 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2949a3a-595d-4b1d-b67d-c97c711fc22c None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:15.675228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff4264-3384-48d3-8768-300aebbacf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:15.676120 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff4264-3384-48d3-8768-300aebbacf9b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:15.676416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff4264-3384-48d3-8768-300aebbacf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:15.676685 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff4264-3384-48d3-8768-300aebbacf9b None admin] PATH_INFO: `/v3/projects/9cd2d8980178404bb8f400514185599f` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:15.678552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff4264-3384-48d3-8768-300aebbacf9b None admin] RBAC: Authorizing `identity:get_project(project_id=9cd2d8980178404bb8f400514185599f)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:15.680035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff4264-3384-48d3-8768-300aebbacf9b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:15.681731 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 558/1152] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:23:15 2022] GET /identity/v3/projects/9cd2d8980178404bb8f400514185599f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:15.692195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59a2ee-86e7-4e91-9f67-eed9bfc5d4ad None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:15.744012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:15.789174 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59a2ee-86e7-4e91-9f67-eed9bfc5d4ad None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:15.820918 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fba88-7883-46dd-8bb5-30dfa1f45d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:15.821778 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fba88-7883-46dd-8bb5-30dfa1f45d07 None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:15.822057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fba88-7883-46dd-8bb5-30dfa1f45d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:15.822327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fba88-7883-46dd-8bb5-30dfa1f45d07 None admin] PATH_INFO: `/v3/projects/9cd2d8980178404bb8f400514185599f/users/f350d5a0256f4ea18e189bcfd41b704a/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:15.824250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fba88-7883-46dd-8bb5-30dfa1f45d07 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cd2d8980178404bb8f400514185599f, user_id=f350d5a0256f4ea18e189bcfd41b704a, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:15.825650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fba88-7883-46dd-8bb5-30dfa1f45d07 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:15.837753 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 595/1153] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:23:15 2022] PUT /identity/v3/projects/9cd2d8980178404bb8f400514185599f/users/f350d5a0256f4ea18e189bcfd41b704a/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:23:17.917818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed382b-7a71-4427-a19f-91e45362628a None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:17.918365 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed382b-7a71-4427-a19f-91e45362628a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:17.918365 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed382b-7a71-4427-a19f-91e45362628a None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:17.919772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 559/1154] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:23:17.924836 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d1e87-80d4-4ab2-8a86-cfa2d2ed627b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:17.925210 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d1e87-80d4-4ab2-8a86-cfa2d2ed627b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:17.925342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d1e87-80d4-4ab2-8a86-cfa2d2ed627b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:17.942123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3e6d1e87-80d4-4ab2-8a86-cfa2d2ed627b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:23:17.943322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3e6d1e87-80d4-4ab2-8a86-cfa2d2ed627b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:23:18.007640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 596/1155] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:23:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:23:18.030279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed382b-7a71-4427-a19f-91e45362628a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:18.128866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed382b-7a71-4427-a19f-91e45362628a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:18.150205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:18.161554 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11319a8d-115f-4b92-8794-daa795ed97a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:18.162965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11319a8d-115f-4b92-8794-daa795ed97a8 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:18.163247 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11319a8d-115f-4b92-8794-daa795ed97a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:18.163548 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11319a8d-115f-4b92-8794-daa795ed97a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:18.173696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11319a8d-115f-4b92-8794-daa795ed97a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-11319a8d-115f-4b92-8794-daa795ed97a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:23:18.181846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:23:18.182993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:23:18.184278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:23:18.184278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:23:18.184278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:23:18.184278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:23:18.184278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:23:18.184278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:23:18.184278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:23:18.184278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:23:18.184278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:23:18.184278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:23:18.184278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:23:18.184278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:23:18.184278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 560/1156] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:23:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:23:18.188884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d1e87-80d4-4ab2-8a86-cfa2d2ed627b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:18.229981 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:18.285592 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d1e87-80d4-4ab2-8a86-cfa2d2ed627b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:18.318063 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7e5d6-740d-4a51-b8d3-9d752f5d8056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:18.319277 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7e5d6-740d-4a51-b8d3-9d752f5d8056 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:18.319585 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7e5d6-740d-4a51-b8d3-9d752f5d8056 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:18.319865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7e5d6-740d-4a51-b8d3-9d752f5d8056 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:18.320599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7e5d6-740d-4a51-b8d3-9d752f5d8056 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:23:18.320905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7e5d6-740d-4a51-b8d3-9d752f5d8056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:18.322256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7e5d6-740d-4a51-b8d3-9d752f5d8056 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:18.330017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 597/1157] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:23:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:18.335837 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11319a8d-115f-4b92-8794-daa795ed97a8 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:18.433187 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11319a8d-115f-4b92-8794-daa795ed97a8 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:18.465291 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6430ed-ee14-42f9-be36-75fd3c8d1f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:18.466141 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6430ed-ee14-42f9-be36-75fd3c8d1f39 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:18.466421 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6430ed-ee14-42f9-be36-75fd3c8d1f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:18.466693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6430ed-ee14-42f9-be36-75fd3c8d1f39 None admin] PATH_INFO: `/v3/users/f350d5a0256f4ea18e189bcfd41b704a` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:18.467882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6430ed-ee14-42f9-be36-75fd3c8d1f39 None admin] RBAC: Authorizing `identity:get_user(user_id=f350d5a0256f4ea18e189bcfd41b704a)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:18.469313 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6430ed-ee14-42f9-be36-75fd3c8d1f39 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:18.470899 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 561/1158] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:23:18 2022] GET /identity/v3/users/f350d5a0256f4ea18e189bcfd41b704a => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:18.477101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7e5d6-740d-4a51-b8d3-9d752f5d8056 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:18.574221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7e5d6-740d-4a51-b8d3-9d752f5d8056 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:18.576606 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:18.607430 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e50201-4c3a-416d-8538-3d0baefe507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:18.608103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e50201-4c3a-416d-8538-3d0baefe507d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:18.608382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e50201-4c3a-416d-8538-3d0baefe507d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:18.608652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e50201-4c3a-416d-8538-3d0baefe507d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:18.673420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e50201-4c3a-416d-8538-3d0baefe507d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:18.674858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e50201-4c3a-416d-8538-3d0baefe507d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:18.772460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 598/1159] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:23:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:23:18.778182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6430ed-ee14-42f9-be36-75fd3c8d1f39 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:18.825765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:18.877406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6430ed-ee14-42f9-be36-75fd3c8d1f39 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:18.911374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68ea85-0701-42ce-a151-87009c6a9367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:18.912294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68ea85-0701-42ce-a151-87009c6a9367 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:18.912569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68ea85-0701-42ce-a151-87009c6a9367 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:18.912838 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68ea85-0701-42ce-a151-87009c6a9367 None admin] PATH_INFO: `/v3/projects/9cd2d8980178404bb8f400514185599f` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:18.913998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68ea85-0701-42ce-a151-87009c6a9367 None admin] RBAC: Authorizing `identity:get_project(project_id=9cd2d8980178404bb8f400514185599f)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:18.915419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68ea85-0701-42ce-a151-87009c6a9367 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:18.917118 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 562/1160] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:23:18 2022] GET /identity/v3/projects/9cd2d8980178404bb8f400514185599f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:18.923238 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e50201-4c3a-416d-8538-3d0baefe507d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:18.926316 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:19.019316 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e50201-4c3a-416d-8538-3d0baefe507d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:19.051380 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18274856-eda7-40e2-a7fb-2af753f9e2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:19.051976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18274856-eda7-40e2-a7fb-2af753f9e2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:19.052252 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18274856-eda7-40e2-a7fb-2af753f9e2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:19.052521 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18274856-eda7-40e2-a7fb-2af753f9e2e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:19.053866 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18274856-eda7-40e2-a7fb-2af753f9e2e1 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=9cd2d8980178404bb8f400514185599f, user.id=f350d5a0256f4ea18e189bcfd41b704a) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:23:19.054176 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18274856-eda7-40e2-a7fb-2af753f9e2e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:19.055621 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18274856-eda7-40e2-a7fb-2af753f9e2e1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:19.061226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 599/1161] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:23:18 2022] GET /identity/v3/role_assignments?user.id=f350d5a0256f4ea18e189bcfd41b704a&scope.project.id=9cd2d8980178404bb8f400514185599f&role.id=e1a2021d08e14daa969362b3d23face3 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:21.209978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d858597-6d7b-4174-90ef-31492af9756c None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:21.210539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d858597-6d7b-4174-90ef-31492af9756c None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:21.210539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d858597-6d7b-4174-90ef-31492af9756c None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:21.211944 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 563/1162] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:23:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:23:21.217207 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc003f-133b-4616-a8f1-e9f45e12167d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:21.217616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc003f-133b-4616-a8f1-e9f45e12167d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:21.217762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc003f-133b-4616-a8f1-e9f45e12167d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:21.235280 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-88dc003f-133b-4616-a8f1-e9f45e12167d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:23:21.236505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-88dc003f-133b-4616-a8f1-e9f45e12167d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:23:21.296744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:21.302614 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 600/1163] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:23:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:23:21.325017 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d858597-6d7b-4174-90ef-31492af9756c None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:21.422754 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d858597-6d7b-4174-90ef-31492af9756c None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:21.439036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:21.455015 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537f1f1-31c4-45e2-b055-ff1d1564c582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:21.455681 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537f1f1-31c4-45e2-b055-ff1d1564c582 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:21.455966 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537f1f1-31c4-45e2-b055-ff1d1564c582 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:21.456242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537f1f1-31c4-45e2-b055-ff1d1564c582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:21.521267 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537f1f1-31c4-45e2-b055-ff1d1564c582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:21.523206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537f1f1-31c4-45e2-b055-ff1d1564c582 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:21.615237 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 564/1164] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:23:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:23:21.621328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc003f-133b-4616-a8f1-e9f45e12167d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:21.716604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc003f-133b-4616-a8f1-e9f45e12167d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:21.750690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3975673-0621-4fc3-95bb-c35f78f5a61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:21.751494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3975673-0621-4fc3-95bb-c35f78f5a61b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:21.751781 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3975673-0621-4fc3-95bb-c35f78f5a61b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:21.752051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3975673-0621-4fc3-95bb-c35f78f5a61b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:21.759074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3975673-0621-4fc3-95bb-c35f78f5a61b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:21.760692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3975673-0621-4fc3-95bb-c35f78f5a61b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-f3975673-0621-4fc3-95bb-c35f78f5a61b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:23:21.775060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:23:21.776368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:23:21.777490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 601/1165] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Jun 15 10:23:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:23:21.782252 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537f1f1-31c4-45e2-b055-ff1d1564c582 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:21.799915 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:21.879230 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537f1f1-31c4-45e2-b055-ff1d1564c582 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:21.912127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb689a-f494-4173-ab11-59f716ffcd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:21.913275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb689a-f494-4173-ab11-59f716ffcd77 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:21.913554 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb689a-f494-4173-ab11-59f716ffcd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:21.913828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb689a-f494-4173-ab11-59f716ffcd77 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:21.914543 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb689a-f494-4173-ab11-59f716ffcd77 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:23:21.914847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb689a-f494-4173-ab11-59f716ffcd77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:21.916233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb689a-f494-4173-ab11-59f716ffcd77 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:21.923143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 565/1166] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Jun 15 10:23:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:24.017107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf43547-635f-44af-818c-8f00f7a62ad3 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:24.017630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf43547-635f-44af-818c-8f00f7a62ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:24.017630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf43547-635f-44af-818c-8f00f7a62ad3 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:24.018977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 602/1167] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:23:24.024064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699725c2-361d-4de2-96bc-2eeebc5779d1 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:24.024489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699725c2-361d-4de2-96bc-2eeebc5779d1 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:24.024631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699725c2-361d-4de2-96bc-2eeebc5779d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:24.041448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-699725c2-361d-4de2-96bc-2eeebc5779d1 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:23:24.042664 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-699725c2-361d-4de2-96bc-2eeebc5779d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:23:24.106546 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 566/1168] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:23:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:23:24.129210 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf43547-635f-44af-818c-8f00f7a62ad3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:24.186822 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:24.229301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf43547-635f-44af-818c-8f00f7a62ad3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:24.261703 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e580d-6ef5-4580-8dbb-f80ce6d353e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:24.262341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e580d-6ef5-4580-8dbb-f80ce6d353e5 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:24.262625 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e580d-6ef5-4580-8dbb-f80ce6d353e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:24.262901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e580d-6ef5-4580-8dbb-f80ce6d353e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:24.263650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e580d-6ef5-4580-8dbb-f80ce6d353e5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:24.264998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e580d-6ef5-4580-8dbb-f80ce6d353e5 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:24.279209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 603/1169] 10.222.0.50 () {60 vars in 1138 bytes} [Wed Jun 15 10:23:24 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:23:26.396435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8c4a0-9c80-439d-ba68-a2c01be62ac5 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:26.397024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8c4a0-9c80-439d-ba68-a2c01be62ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:26.397024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8c4a0-9c80-439d-ba68-a2c01be62ac5 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:26.398388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 567/1170] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:23:26.403480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33446d5-d06d-4dbe-b7da-10eb1f948c16 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:26.403915 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33446d5-d06d-4dbe-b7da-10eb1f948c16 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:26.404048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33446d5-d06d-4dbe-b7da-10eb1f948c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:26.420535 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d33446d5-d06d-4dbe-b7da-10eb1f948c16 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:23:26.421710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d33446d5-d06d-4dbe-b7da-10eb1f948c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:23:26.486626 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 604/1171] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:23:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:23:26.511121 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8c4a0-9c80-439d-ba68-a2c01be62ac5 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:26.525942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:26.609822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8c4a0-9c80-439d-ba68-a2c01be62ac5 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:26.641863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93585f85-54f6-4fac-b674-5e7ca30a07fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:26.642708 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93585f85-54f6-4fac-b674-5e7ca30a07fd None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:26.642989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93585f85-54f6-4fac-b674-5e7ca30a07fd None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:26.643263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93585f85-54f6-4fac-b674-5e7ca30a07fd None admin] PATH_INFO: `/v3/domains/e24a82e1ef304a4590e2d3bb364053ec` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:26.653864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93585f85-54f6-4fac-b674-5e7ca30a07fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=e24a82e1ef304a4590e2d3bb364053ec)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:26.655246 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93585f85-54f6-4fac-b674-5e7ca30a07fd None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:26.656911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 568/1172] 10.222.0.50 () {56 vars in 1183 bytes} [Wed Jun 15 10:23:26 2022] GET /identity/v3/domains/e24a82e1ef304a4590e2d3bb364053ec => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:26.663337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33446d5-d06d-4dbe-b7da-10eb1f948c16 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:26.710586 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:26.761346 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33446d5-d06d-4dbe-b7da-10eb1f948c16 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:26.794250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0aa75e-2546-4dc5-a370-fa3205ca44e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:26.794895 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0aa75e-2546-4dc5-a370-fa3205ca44e0 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:26.795184 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0aa75e-2546-4dc5-a370-fa3205ca44e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:26.795484 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0aa75e-2546-4dc5-a370-fa3205ca44e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:26.796204 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0aa75e-2546-4dc5-a370-fa3205ca44e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:26.797627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0aa75e-2546-4dc5-a370-fa3205ca44e0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:26.822266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 605/1173] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Jun 15 10:23:26 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:23:28.956864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc396e6a-2492-4ca2-a447-8011fdd4b6e9 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:28.957376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc396e6a-2492-4ca2-a447-8011fdd4b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:28.957376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc396e6a-2492-4ca2-a447-8011fdd4b6e9 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:28.958677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 569/1174] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:23:28.963908 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f324a-b587-405b-a355-40164872b546 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:28.964302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f324a-b587-405b-a355-40164872b546 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:28.964458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f324a-b587-405b-a355-40164872b546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:28.981265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c72f324a-b587-405b-a355-40164872b546 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:23:28.982439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c72f324a-b587-405b-a355-40164872b546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:23:29.046912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 606/1175] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:23:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:23:29.071330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc396e6a-2492-4ca2-a447-8011fdd4b6e9 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:29.139281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:29.169742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc396e6a-2492-4ca2-a447-8011fdd4b6e9 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:29.201492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecdc7f9-14ff-4b79-8d2b-277e81a4510c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:29.202335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdc7f9-14ff-4b79-8d2b-277e81a4510c None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:29.202618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdc7f9-14ff-4b79-8d2b-277e81a4510c None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:29.202890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecdc7f9-14ff-4b79-8d2b-277e81a4510c None admin] PATH_INFO: `/v3/domains/e24a82e1ef304a4590e2d3bb364053ec` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:29.204075 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdc7f9-14ff-4b79-8d2b-277e81a4510c None admin] RBAC: Authorizing `identity:get_domain(domain_id=e24a82e1ef304a4590e2d3bb364053ec)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:29.205500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecdc7f9-14ff-4b79-8d2b-277e81a4510c None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:29.207145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 570/1176] 10.222.0.50 () {56 vars in 1183 bytes} [Wed Jun 15 10:23:29 2022] GET /identity/v3/domains/e24a82e1ef304a4590e2d3bb364053ec => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:29.212749 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f324a-b587-405b-a355-40164872b546 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:29.242045 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:29.309021 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f324a-b587-405b-a355-40164872b546 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:29.340906 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc79cc-8fa3-4cb4-aa98-2fe359bfe649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:29.341547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc79cc-8fa3-4cb4-aa98-2fe359bfe649 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:29.341827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc79cc-8fa3-4cb4-aa98-2fe359bfe649 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:29.342095 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc79cc-8fa3-4cb4-aa98-2fe359bfe649 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:29.342775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc79cc-8fa3-4cb4-aa98-2fe359bfe649 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:29.344221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc79cc-8fa3-4cb4-aa98-2fe359bfe649 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:29.363247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 607/1177] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:23:29 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:23:31.498186 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48af8-10b7-43d3-a85d-ce662cdf9aaa None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:31.498779 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48af8-10b7-43d3-a85d-ce662cdf9aaa None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:31.498779 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb48af8-10b7-43d3-a85d-ce662cdf9aaa None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:31.500132 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 571/1178] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:23:31.505118 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442dfe1-48b1-475d-9c19-a9344c02284a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:31.505541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442dfe1-48b1-475d-9c19-a9344c02284a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:31.505666 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442dfe1-48b1-475d-9c19-a9344c02284a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:31.521946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c442dfe1-48b1-475d-9c19-a9344c02284a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:23:31.523119 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c442dfe1-48b1-475d-9c19-a9344c02284a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:23:31.588919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 608/1179] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:23:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:23:31.612639 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48af8-10b7-43d3-a85d-ce662cdf9aaa None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:31.712867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb48af8-10b7-43d3-a85d-ce662cdf9aaa None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:31.745056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe887d-37c0-4dfd-b5bc-5c01e8590a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:31.745830 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe887d-37c0-4dfd-b5bc-5c01e8590a8f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:31.746113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe887d-37c0-4dfd-b5bc-5c01e8590a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:31.746385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe887d-37c0-4dfd-b5bc-5c01e8590a8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:31.753739 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:31.757522 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe887d-37c0-4dfd-b5bc-5c01e8590a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-77fe887d-37c0-4dfd-b5bc-5c01e8590a8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:23:31.771420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:23:31.773211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:23:31.774388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:23:31.774388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:23:31.774388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:23:31.774388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:23:31.774388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:23:31.774388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:23:31.774388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:23:31.774388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:23:31.774388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:23:31.774388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:23:31.774388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:23:31.774388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:23:31.774388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 572/1180] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:23:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:23:31.779987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442dfe1-48b1-475d-9c19-a9344c02284a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:31.797664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:31.877658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442dfe1-48b1-475d-9c19-a9344c02284a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:31.909760 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178db9c-166a-41c1-bc85-26cda26d7324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:31.910398 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178db9c-166a-41c1-bc85-26cda26d7324 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:31.910679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178db9c-166a-41c1-bc85-26cda26d7324 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:31.910952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178db9c-166a-41c1-bc85-26cda26d7324 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:31.911716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178db9c-166a-41c1-bc85-26cda26d7324 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:23:31.912023 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178db9c-166a-41c1-bc85-26cda26d7324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:31.913950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178db9c-166a-41c1-bc85-26cda26d7324 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:31.921746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 609/1181] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:23:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:31.927404 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe887d-37c0-4dfd-b5bc-5c01e8590a8f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:32.024507 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe887d-37c0-4dfd-b5bc-5c01e8590a8f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:32.055866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d503263-706a-411c-920b-556fc71c152d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:32.056712 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d503263-706a-411c-920b-556fc71c152d None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:32.056992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d503263-706a-411c-920b-556fc71c152d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:32.057262 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d503263-706a-411c-920b-556fc71c152d None admin] PATH_INFO: `/v3/users/3a1c0c4a3c3b4fb685718c4b901be4c9` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:32.070040 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d503263-706a-411c-920b-556fc71c152d None admin] RBAC: Authorizing `identity:get_user(user_id=3a1c0c4a3c3b4fb685718c4b901be4c9)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:32.071476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d503263-706a-411c-920b-556fc71c152d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:32.073099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 573/1182] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:23:31 2022] GET /identity/v3/users/3a1c0c4a3c3b4fb685718c4b901be4c9 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:32.078824 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178db9c-166a-41c1-bc85-26cda26d7324 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:32.155960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:32.177340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178db9c-166a-41c1-bc85-26cda26d7324 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:32.210102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b961f-e5e5-431e-806c-8294f0f38e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:32.210725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b961f-e5e5-431e-806c-8294f0f38e03 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:32.211001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b961f-e5e5-431e-806c-8294f0f38e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:32.211272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b961f-e5e5-431e-806c-8294f0f38e03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:32.275340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b961f-e5e5-431e-806c-8294f0f38e03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:32.276727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b961f-e5e5-431e-806c-8294f0f38e03 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:32.348672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:32.370853 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 610/1183] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:23:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:23:32.376881 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d503263-706a-411c-920b-556fc71c152d None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:32.432706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:32.472535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d503263-706a-411c-920b-556fc71c152d None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:32.504652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de02a3-8500-4d62-a5a1-c0810547a33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:32.505493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de02a3-8500-4d62-a5a1-c0810547a33f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:32.505768 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de02a3-8500-4d62-a5a1-c0810547a33f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:32.506593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de02a3-8500-4d62-a5a1-c0810547a33f None admin] PATH_INFO: `/v3/projects/b2da54154c0847339dc5eb99336320d3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:32.507770 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de02a3-8500-4d62-a5a1-c0810547a33f None admin] RBAC: Authorizing `identity:get_project(project_id=b2da54154c0847339dc5eb99336320d3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:32.509176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de02a3-8500-4d62-a5a1-c0810547a33f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:32.510826 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 574/1184] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:23:32 2022] GET /identity/v3/projects/b2da54154c0847339dc5eb99336320d3 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:32.516735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b961f-e5e5-431e-806c-8294f0f38e03 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:32.618055 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b961f-e5e5-431e-806c-8294f0f38e03 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:32.650435 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08747370-ecce-41e1-a63a-18f2b619cd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:32.651064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08747370-ecce-41e1-a63a-18f2b619cd2d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:32.651340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08747370-ecce-41e1-a63a-18f2b619cd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:32.651654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08747370-ecce-41e1-a63a-18f2b619cd2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:32.652472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08747370-ecce-41e1-a63a-18f2b619cd2d None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=b2da54154c0847339dc5eb99336320d3, user.id=3a1c0c4a3c3b4fb685718c4b901be4c9) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:23:32.652774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08747370-ecce-41e1-a63a-18f2b619cd2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:32.654194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08747370-ecce-41e1-a63a-18f2b619cd2d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:32.659768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 611/1185] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:23:32 2022] GET /identity/v3/role_assignments?user.id=3a1c0c4a3c3b4fb685718c4b901be4c9&scope.project.id=b2da54154c0847339dc5eb99336320d3&role.id=e1a2021d08e14daa969362b3d23face3 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:34.729064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d30531-ba2d-454d-abf1-9bd63035cf7c None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:34.729609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d30531-ba2d-454d-abf1-9bd63035cf7c None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:34.729609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d30531-ba2d-454d-abf1-9bd63035cf7c None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:34.730959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 575/1186] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:23:34.736020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8227466-5cd1-4ecb-b72f-93d1226402ac None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:34.736413 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8227466-5cd1-4ecb-b72f-93d1226402ac None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:34.736567 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8227466-5cd1-4ecb-b72f-93d1226402ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:34.753163 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e8227466-5cd1-4ecb-b72f-93d1226402ac None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:23:34.754344 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e8227466-5cd1-4ecb-b72f-93d1226402ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:23:34.788559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:34.820432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 612/1187] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:23:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 10:23:34.842721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d30531-ba2d-454d-abf1-9bd63035cf7c None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:34.940596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d30531-ba2d-454d-abf1-9bd63035cf7c None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:34.967047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:34.976389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a671c9-81b7-4108-a75b-f4c46f1f8a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:34.977169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a671c9-81b7-4108-a75b-f4c46f1f8a65 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:34.977451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a671c9-81b7-4108-a75b-f4c46f1f8a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:34.977724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a671c9-81b7-4108-a75b-f4c46f1f8a65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:34.987394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a671c9-81b7-4108-a75b-f4c46f1f8a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-a6a671c9-81b7-4108-a75b-f4c46f1f8a65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:23:34.995297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:23:34.996477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:23:34.997416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:23:34.997416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:23:34.997416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:23:34.997416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:23:34.997416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:23:34.997416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:23:34.997416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:23:34.997416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:23:34.997416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:23:34.997416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:23:34.997416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:23:34.997416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:23:34.997416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 576/1188] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:23:35.002677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8227466-5cd1-4ecb-b72f-93d1226402ac None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:35.101321 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8227466-5cd1-4ecb-b72f-93d1226402ac None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:35.136368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa74ea-6f13-4ad6-a3bb-c03540be82a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:35.137023 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa74ea-6f13-4ad6-a3bb-c03540be82a7 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:35.137305 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa74ea-6f13-4ad6-a3bb-c03540be82a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:35.137578 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa74ea-6f13-4ad6-a3bb-c03540be82a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:35.139061 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa74ea-6f13-4ad6-a3bb-c03540be82a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:23:35.139367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa74ea-6f13-4ad6-a3bb-c03540be82a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:35.140757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa74ea-6f13-4ad6-a3bb-c03540be82a7 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:35.149597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 613/1189] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:23:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:35.155371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a671c9-81b7-4108-a75b-f4c46f1f8a65 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:35.257211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a671c9-81b7-4108-a75b-f4c46f1f8a65 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:35.290453 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15e345-e4f2-4a78-8835-76d2f6ec0e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:35.291310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e345-e4f2-4a78-8835-76d2f6ec0e6f None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:35.291620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e345-e4f2-4a78-8835-76d2f6ec0e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:35.291894 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e345-e4f2-4a78-8835-76d2f6ec0e6f None admin] PATH_INFO: `/v3/users/3a1c0c4a3c3b4fb685718c4b901be4c9` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:35.293099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15e345-e4f2-4a78-8835-76d2f6ec0e6f None admin] RBAC: Authorizing `identity:get_user(user_id=3a1c0c4a3c3b4fb685718c4b901be4c9)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:35.294540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15e345-e4f2-4a78-8835-76d2f6ec0e6f None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:35.296199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 577/1190] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:23:35 2022] GET /identity/v3/users/3a1c0c4a3c3b4fb685718c4b901be4c9 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:35.302033 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa74ea-6f13-4ad6-a3bb-c03540be82a7 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:35.338175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:35.406029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa74ea-6f13-4ad6-a3bb-c03540be82a7 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:35.445054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ca5e3-fe08-48d2-9932-4c62b8a2da25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:35.445896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ca5e3-fe08-48d2-9932-4c62b8a2da25 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:35.446176 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ca5e3-fe08-48d2-9932-4c62b8a2da25 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:35.446450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ca5e3-fe08-48d2-9932-4c62b8a2da25 None admin] PATH_INFO: `/v3/projects/b2da54154c0847339dc5eb99336320d3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:35.447773 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ca5e3-fe08-48d2-9932-4c62b8a2da25 None admin] RBAC: Authorizing `identity:get_project(project_id=b2da54154c0847339dc5eb99336320d3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:35.449144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ca5e3-fe08-48d2-9932-4c62b8a2da25 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:35.450879 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 614/1191] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:23:35 2022] GET /identity/v3/projects/b2da54154c0847339dc5eb99336320d3 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:35.458648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15e345-e4f2-4a78-8835-76d2f6ec0e6f None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:35.514753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:35.566257 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15e345-e4f2-4a78-8835-76d2f6ec0e6f None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:35.599082 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb12d11-160a-47fd-bc93-e83fd2285e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:35.600567 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb12d11-160a-47fd-bc93-e83fd2285e7d None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:35.600847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb12d11-160a-47fd-bc93-e83fd2285e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:35.601118 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb12d11-160a-47fd-bc93-e83fd2285e7d None admin] PATH_INFO: `/v3/projects/b2da54154c0847339dc5eb99336320d3/users/3a1c0c4a3c3b4fb685718c4b901be4c9/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:35.603392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb12d11-160a-47fd-bc93-e83fd2285e7d None admin] RBAC: Authorizing `identity:create_grant(project_id=b2da54154c0847339dc5eb99336320d3, user_id=3a1c0c4a3c3b4fb685718c4b901be4c9, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:35.604839 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb12d11-160a-47fd-bc93-e83fd2285e7d None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:35.617193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 578/1192] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:23:35 2022] PUT /identity/v3/projects/b2da54154c0847339dc5eb99336320d3/users/3a1c0c4a3c3b4fb685718c4b901be4c9/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:23:37.704197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6a9cb-9c78-458c-ab9d-5fce7a9bb3f8 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:37.704630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6a9cb-9c78-458c-ab9d-5fce7a9bb3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:37.704740 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6a9cb-9c78-458c-ab9d-5fce7a9bb3f8 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:37.706109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 615/1193] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:23:37.711258 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7489b0-cb5f-4919-9bda-1aac445425e6 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:37.711726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7489b0-cb5f-4919-9bda-1aac445425e6 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:37.711828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7489b0-cb5f-4919-9bda-1aac445425e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:37.727847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-1f7489b0-cb5f-4919-9bda-1aac445425e6 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:23:37.729009 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1f7489b0-cb5f-4919-9bda-1aac445425e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:23:37.793384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 579/1194] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:23:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:23:37.818200 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6a9cb-9c78-458c-ab9d-5fce7a9bb3f8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:37.919030 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6a9cb-9c78-458c-ab9d-5fce7a9bb3f8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:37.920535 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:37.953633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb812895-4aed-4656-bfa2-29ffbe090728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:37.954342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812895-4aed-4656-bfa2-29ffbe090728 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:37.954620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812895-4aed-4656-bfa2-29ffbe090728 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:37.954889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812895-4aed-4656-bfa2-29ffbe090728 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:37.965092 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb812895-4aed-4656-bfa2-29ffbe090728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-bb812895-4aed-4656-bfa2-29ffbe090728 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:23:37.972556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:23:37.973640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:23:37.975229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:23:37.975229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:23:37.975229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:23:37.975229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:23:37.975229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:23:37.975229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:23:37.975229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:23:37.975229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:23:37.975229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:23:37.975229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:23:37.975229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:23:37.975229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:23:37.975229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 616/1195] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:23:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:23:37.980380 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7489b0-cb5f-4919-9bda-1aac445425e6 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:38.023741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:38.076122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7489b0-cb5f-4919-9bda-1aac445425e6 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:38.108294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f686ce-c9b2-4c99-b152-6e69c83bb674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:38.108947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f686ce-c9b2-4c99-b152-6e69c83bb674 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:38.109229 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f686ce-c9b2-4c99-b152-6e69c83bb674 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:38.109502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f686ce-c9b2-4c99-b152-6e69c83bb674 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:38.110237 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f686ce-c9b2-4c99-b152-6e69c83bb674 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:23:38.110539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f686ce-c9b2-4c99-b152-6e69c83bb674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:38.111932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f686ce-c9b2-4c99-b152-6e69c83bb674 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:38.120495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 580/1196] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:23:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:38.126351 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb812895-4aed-4656-bfa2-29ffbe090728 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:38.229723 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb812895-4aed-4656-bfa2-29ffbe090728 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:38.262709 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fe4f4-57c5-4ea5-8479-324eb38303f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:38.263590 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fe4f4-57c5-4ea5-8479-324eb38303f4 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:38.263878 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fe4f4-57c5-4ea5-8479-324eb38303f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:38.264154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fe4f4-57c5-4ea5-8479-324eb38303f4 None admin] PATH_INFO: `/v3/users/3a1c0c4a3c3b4fb685718c4b901be4c9` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:38.265323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fe4f4-57c5-4ea5-8479-324eb38303f4 None admin] RBAC: Authorizing `identity:get_user(user_id=3a1c0c4a3c3b4fb685718c4b901be4c9)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:38.266766 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fe4f4-57c5-4ea5-8479-324eb38303f4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:38.268403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 617/1197] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Jun 15 10:23:38 2022] GET /identity/v3/users/3a1c0c4a3c3b4fb685718c4b901be4c9 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:38.274227 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f686ce-c9b2-4c99-b152-6e69c83bb674 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:38.370682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f686ce-c9b2-4c99-b152-6e69c83bb674 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:38.377230 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:38.403494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f7f28-f9e3-4105-8b0a-5b4d4c25c26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:38.404130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f7f28-f9e3-4105-8b0a-5b4d4c25c26e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:38.404414 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f7f28-f9e3-4105-8b0a-5b4d4c25c26e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:38.404686 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f7f28-f9e3-4105-8b0a-5b4d4c25c26e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:38.468827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f7f28-f9e3-4105-8b0a-5b4d4c25c26e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:38.470260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f7f28-f9e3-4105-8b0a-5b4d4c25c26e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:38.566979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 581/1198] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:23:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:23:38.572863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fe4f4-57c5-4ea5-8479-324eb38303f4 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:38.602879 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:38.669763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fe4f4-57c5-4ea5-8479-324eb38303f4 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:38.702055 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4a686-420a-48bf-bd3b-7654e9dfb430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:38.702894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4a686-420a-48bf-bd3b-7654e9dfb430 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:38.703176 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4a686-420a-48bf-bd3b-7654e9dfb430 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:38.703450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4a686-420a-48bf-bd3b-7654e9dfb430 None admin] PATH_INFO: `/v3/projects/b2da54154c0847339dc5eb99336320d3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:38.704638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4a686-420a-48bf-bd3b-7654e9dfb430 None admin] RBAC: Authorizing `identity:get_project(project_id=b2da54154c0847339dc5eb99336320d3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:38.706049 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4a686-420a-48bf-bd3b-7654e9dfb430 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:38.707742 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 618/1199] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Jun 15 10:23:38 2022] GET /identity/v3/projects/b2da54154c0847339dc5eb99336320d3 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:38.714430 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f7f28-f9e3-4105-8b0a-5b4d4c25c26e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:23:38.722410 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:38.811092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f7f28-f9e3-4105-8b0a-5b4d4c25c26e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:23:38.844298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19345725-c538-4cb2-8754-8405b08965e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:23:38.844941 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19345725-c538-4cb2-8754-8405b08965e6 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:23:38.845225 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19345725-c538-4cb2-8754-8405b08965e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:23:38.845502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19345725-c538-4cb2-8754-8405b08965e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:23:38.846332 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19345725-c538-4cb2-8754-8405b08965e6 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=b2da54154c0847339dc5eb99336320d3, user.id=3a1c0c4a3c3b4fb685718c4b901be4c9) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:23:38.846647 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19345725-c538-4cb2-8754-8405b08965e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:23:38.848265 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19345725-c538-4cb2-8754-8405b08965e6 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:23:38.854586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 582/1200] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:23:38 2022] GET /identity/v3/role_assignments?user.id=3a1c0c4a3c3b4fb685718c4b901be4c9&scope.project.id=b2da54154c0847339dc5eb99336320d3&role.id=e1a2021d08e14daa969362b3d23face3 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:23:48.698452 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=51 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:23:48.851962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=65 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:35.234959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf236-5679-47a1-923a-a9bd0162ab81 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:35.234959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf236-5679-47a1-923a-a9bd0162ab81 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:35.234959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf236-5679-47a1-923a-a9bd0162ab81 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:35.234959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 619/1201] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:24:35.242261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ec3ac-efa5-4efe-8967-35c04d8c85ee None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:35.242789 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ec3ac-efa5-4efe-8967-35c04d8c85ee None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:35.242789 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ec3ac-efa5-4efe-8967-35c04d8c85ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:35.261740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-753ec3ac-efa5-4efe-8967-35c04d8c85ee None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:24:35.262951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-753ec3ac-efa5-4efe-8967-35c04d8c85ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:24:35.356557 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 583/1202] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:24:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:24:35.384563 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadf236-5679-47a1-923a-a9bd0162ab81 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:35.528573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadf236-5679-47a1-923a-a9bd0162ab81 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:35.572554 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d30d57-59fd-4697-92f5-587e7cb3febd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:35.573436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d30d57-59fd-4697-92f5-587e7cb3febd None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:35.573662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d30d57-59fd-4697-92f5-587e7cb3febd None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:35.573971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d30d57-59fd-4697-92f5-587e7cb3febd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:35.589730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d30d57-59fd-4697-92f5-587e7cb3febd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:35.591206 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d30d57-59fd-4697-92f5-587e7cb3febd None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-90d30d57-59fd-4697-92f5-587e7cb3febd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:24:35.613970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:35.615342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:35.616544 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:24:35.616544 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:24:35.616544 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:35.616544 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:24:35.616544 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 620/1203] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:35.621876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ec3ac-efa5-4efe-8967-35c04d8c85ee None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:35.777003 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ec3ac-efa5-4efe-8967-35c04d8c85ee None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:35.817301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:35.827404 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfdafe-7d49-4585-a7df-2c7fed4b6936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:35.828385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfdafe-7d49-4585-a7df-2c7fed4b6936 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:35.828694 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfdafe-7d49-4585-a7df-2c7fed4b6936 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:35.829029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfdafe-7d49-4585-a7df-2c7fed4b6936 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:35.830429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfdafe-7d49-4585-a7df-2c7fed4b6936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:35.831108 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfdafe-7d49-4585-a7df-2c7fed4b6936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:35.834791 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfdafe-7d49-4585-a7df-2c7fed4b6936 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:35.852805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 584/1204] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:35.859865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d30d57-59fd-4697-92f5-587e7cb3febd None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:35.942291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:36.025458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d30d57-59fd-4697-92f5-587e7cb3febd None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:36.101079 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc30d5f-3505-4ade-80d7-78d14b21dd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:36.102286 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc30d5f-3505-4ade-80d7-78d14b21dd00 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:36.102991 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc30d5f-3505-4ade-80d7-78d14b21dd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:36.103578 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc30d5f-3505-4ade-80d7-78d14b21dd00 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:36.104658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc30d5f-3505-4ade-80d7-78d14b21dd00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:36.107146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc30d5f-3505-4ade-80d7-78d14b21dd00 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:36.142705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 621/1205] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Jun 15 10:24:35 2022] POST /identity/v3/users => generated 251 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:24:38.565934 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c5d9e-c26b-439e-8033-e42e0dffcdd6 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:38.566726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c5d9e-c26b-439e-8033-e42e0dffcdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:38.566726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c5d9e-c26b-439e-8033-e42e0dffcdd6 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:38.568756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 585/1206] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:24:38.574873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32011546-7188-497f-8936-b07ce242a33c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:38.575680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32011546-7188-497f-8936-b07ce242a33c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:38.575680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32011546-7188-497f-8936-b07ce242a33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:38.593945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-32011546-7188-497f-8936-b07ce242a33c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:24:38.595225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-32011546-7188-497f-8936-b07ce242a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:24:38.686972 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 622/1207] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:24:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:24:38.716855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c5d9e-c26b-439e-8033-e42e0dffcdd6 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:38.870451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c5d9e-c26b-439e-8033-e42e0dffcdd6 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:38.916149 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62692ded-397d-4dff-bc65-a485e49f786a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:38.916998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62692ded-397d-4dff-bc65-a485e49f786a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:38.917282 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62692ded-397d-4dff-bc65-a485e49f786a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:38.917599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62692ded-397d-4dff-bc65-a485e49f786a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:38.932481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62692ded-397d-4dff-bc65-a485e49f786a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-62692ded-397d-4dff-bc65-a485e49f786a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:24:38.941272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:38.942314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:38.943290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:38.943290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:38.943290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:38.943290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:38.943290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:24:38.943290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:24:38.943290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:24:38.943290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:24:38.943290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:24:38.943290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:24:38.943290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:24:38.943290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:24:38.943290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 586/1208] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:24:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:38.950854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32011546-7188-497f-8936-b07ce242a33c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:38.996099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:39.064610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32011546-7188-497f-8936-b07ce242a33c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:39.109194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ee02-ff6e-44e1-bb1d-4d30bb34b150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:39.109869 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ee02-ff6e-44e1-bb1d-4d30bb34b150 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:39.110152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ee02-ff6e-44e1-bb1d-4d30bb34b150 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:39.110428 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ee02-ff6e-44e1-bb1d-4d30bb34b150 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:39.111222 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ee02-ff6e-44e1-bb1d-4d30bb34b150 None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:39.111564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ee02-ff6e-44e1-bb1d-4d30bb34b150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:39.112970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ee02-ff6e-44e1-bb1d-4d30bb34b150 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:39.122360 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 623/1209] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:24:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:39.128102 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62692ded-397d-4dff-bc65-a485e49f786a None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:39.184257 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:39.240416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62692ded-397d-4dff-bc65-a485e49f786a None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:39.276201 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e9727-8196-4159-89c1-524384712ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:39.276984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e9727-8196-4159-89c1-524384712ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:39.277255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e9727-8196-4159-89c1-524384712ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:39.277520 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e9727-8196-4159-89c1-524384712ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:39.288666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e9727-8196-4159-89c1-524384712ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:39.290224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e9727-8196-4159-89c1-524384712ca7 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-ad2e9727-8196-4159-89c1-524384712ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:24:39.308286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:39.309866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:39.311206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:24:39.311206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:24:39.311206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:39.311206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:24:39.315505 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 587/1210] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:39.315650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ee02-ff6e-44e1-bb1d-4d30bb34b150 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:39.431182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:39.436567 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ee02-ff6e-44e1-bb1d-4d30bb34b150 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:39.479091 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe36fa-6213-48f0-8740-f30c91d7f271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:39.479835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe36fa-6213-48f0-8740-f30c91d7f271 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:39.480160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe36fa-6213-48f0-8740-f30c91d7f271 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:39.480439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe36fa-6213-48f0-8740-f30c91d7f271 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:39.481152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe36fa-6213-48f0-8740-f30c91d7f271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:39.481473 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe36fa-6213-48f0-8740-f30c91d7f271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:39.482827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe36fa-6213-48f0-8740-f30c91d7f271 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:39.497135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 624/1211] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:24:39.501703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e9727-8196-4159-89c1-524384712ca7 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:39.639439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e9727-8196-4159-89c1-524384712ca7 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:39.641207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:39.678580 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159817b-3525-49df-8d4f-45e37239ff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:39.679504 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159817b-3525-49df-8d4f-45e37239ff87 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:39.679795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159817b-3525-49df-8d4f-45e37239ff87 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:39.680122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159817b-3525-49df-8d4f-45e37239ff87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:39.689717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159817b-3525-49df-8d4f-45e37239ff87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:39.691085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159817b-3525-49df-8d4f-45e37239ff87 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-2159817b-3525-49df-8d4f-45e37239ff87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:24:39.714939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:39.719753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:39.720953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:39.720953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:39.720953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:24:39.720953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:24:39.720953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:24:39.720953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:24:39.720953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:24:39.720953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:24:39.720953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 10:24:39.720953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:24:39.720953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 588/1212] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:39.722163 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe36fa-6213-48f0-8740-f30c91d7f271 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:39.855349 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe36fa-6213-48f0-8740-f30c91d7f271 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:39.899598 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e65aa6-3347-4eab-b7c6-8eb9ec598ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:39.900256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e65aa6-3347-4eab-b7c6-8eb9ec598ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:39.900540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e65aa6-3347-4eab-b7c6-8eb9ec598ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:39.900827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e65aa6-3347-4eab-b7c6-8eb9ec598ad8 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:39.901733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e65aa6-3347-4eab-b7c6-8eb9ec598ad8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:39.902091 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e65aa6-3347-4eab-b7c6-8eb9ec598ad8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:39.904361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e65aa6-3347-4eab-b7c6-8eb9ec598ad8 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:39.925528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 625/1213] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Jun 15 10:24:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:39.933399 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159817b-3525-49df-8d4f-45e37239ff87 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:40.074494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159817b-3525-49df-8d4f-45e37239ff87 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:40.115454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ca32b-002c-4f6c-9008-b66790546ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:40.116134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca32b-002c-4f6c-9008-b66790546ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:40.116437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca32b-002c-4f6c-9008-b66790546ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:40.116689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca32b-002c-4f6c-9008-b66790546ce3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:40.156702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:40.208451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ca32b-002c-4f6c-9008-b66790546ce3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:40.209937 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ca32b-002c-4f6c-9008-b66790546ce3 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:40.341207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 589/1214] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:24:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:24:40.347500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e65aa6-3347-4eab-b7c6-8eb9ec598ad8 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:40.372520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:40.473506 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e65aa6-3347-4eab-b7c6-8eb9ec598ad8 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:40.515072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1a029-44c7-49d0-8dd5-c6890fd7ea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:40.516135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1a029-44c7-49d0-8dd5-c6890fd7ea08 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:40.516450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1a029-44c7-49d0-8dd5-c6890fd7ea08 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:40.516782 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1a029-44c7-49d0-8dd5-c6890fd7ea08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:40.529042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1a029-44c7-49d0-8dd5-c6890fd7ea08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:40.531629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1a029-44c7-49d0-8dd5-c6890fd7ea08 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-c3d1a029-44c7-49d0-8dd5-c6890fd7ea08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:24:40.555685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:40.556851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:40.557830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:24:40.557830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:24:40.557830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:40.557830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:24:40.562123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 626/1215] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:40.563331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ca32b-002c-4f6c-9008-b66790546ce3 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:40.657973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:40.709728 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ca32b-002c-4f6c-9008-b66790546ce3 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:40.754065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d80297-0c2a-4e41-844e-304276a7d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:40.754994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80297-0c2a-4e41-844e-304276a7d9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:40.755363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80297-0c2a-4e41-844e-304276a7d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:40.755673 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80297-0c2a-4e41-844e-304276a7d9a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:40.756410 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d80297-0c2a-4e41-844e-304276a7d9a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:40.756718 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d80297-0c2a-4e41-844e-304276a7d9a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:40.758115 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d80297-0c2a-4e41-844e-304276a7d9a3 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:40.772123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 590/1216] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:40.777691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1a029-44c7-49d0-8dd5-c6890fd7ea08 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:40.860805 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:40.898412 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1a029-44c7-49d0-8dd5-c6890fd7ea08 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:40.940968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafb6b4-982a-4642-a2ee-ad93d195d215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:40.941912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafb6b4-982a-4642-a2ee-ad93d195d215 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:40.942113 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafb6b4-982a-4642-a2ee-ad93d195d215 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:40.942471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafb6b4-982a-4642-a2ee-ad93d195d215 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:40.950684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acafb6b4-982a-4642-a2ee-ad93d195d215 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:40.952320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acafb6b4-982a-4642-a2ee-ad93d195d215 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-acafb6b4-982a-4642-a2ee-ad93d195d215 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:24:40.969856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:40.971114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:40.972195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:24:40.972195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:24:40.972195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:24:40.972195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:24:40.972195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:24:40.972195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:24:40.972195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:24:40.972195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:24:40.972195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 627/1217] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:24:40.979076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d80297-0c2a-4e41-844e-304276a7d9a3 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:41.115703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d80297-0c2a-4e41-844e-304276a7d9a3 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:41.145509 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:41.160988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a748551-613e-4766-a79a-af5d57fe96a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:41.161990 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a748551-613e-4766-a79a-af5d57fe96a1 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:41.162336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a748551-613e-4766-a79a-af5d57fe96a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:41.162686 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a748551-613e-4766-a79a-af5d57fe96a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:41.163587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a748551-613e-4766-a79a-af5d57fe96a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:41.163978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a748551-613e-4766-a79a-af5d57fe96a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:41.165490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a748551-613e-4766-a79a-af5d57fe96a1 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:41.193281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 591/1218] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:24:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:24:41.194031 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafb6b4-982a-4642-a2ee-ad93d195d215 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:41.316808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafb6b4-982a-4642-a2ee-ad93d195d215 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:41.348847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:41.355871 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3ed19-26eb-43fc-975e-0aa6a4942a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:41.356602 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3ed19-26eb-43fc-975e-0aa6a4942a84 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:41.356886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3ed19-26eb-43fc-975e-0aa6a4942a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:41.357206 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3ed19-26eb-43fc-975e-0aa6a4942a84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:41.358063 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3ed19-26eb-43fc-975e-0aa6a4942a84 None admin] RBAC: Adding query filter params (role.id=f6ffe6f612824e50a23f0b06a16a1f91, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=2729cb0b9adb44f7ba5c968b6158a93c) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:41.358650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3ed19-26eb-43fc-975e-0aa6a4942a84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:41.360372 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3ed19-26eb-43fc-975e-0aa6a4942a84 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:41.367784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 628/1219] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:24:41 2022] GET /identity/v3/role_assignments?user.id=2729cb0b9adb44f7ba5c968b6158a93c&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=f6ffe6f612824e50a23f0b06a16a1f91 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:43.667595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279549cb-52cc-4a49-aab7-40089df80b92 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:43.668157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279549cb-52cc-4a49-aab7-40089df80b92 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:43.668157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279549cb-52cc-4a49-aab7-40089df80b92 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:43.670774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 592/1220] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:24:43.675209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1fde-ff14-4c9c-9280-215dac9e638b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:43.675694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1fde-ff14-4c9c-9280-215dac9e638b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:43.675911 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1fde-ff14-4c9c-9280-215dac9e638b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:43.693071 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c40e1fde-ff14-4c9c-9280-215dac9e638b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:24:43.694496 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c40e1fde-ff14-4c9c-9280-215dac9e638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:24:43.765188 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 629/1221] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:24:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:24:43.788937 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279549cb-52cc-4a49-aab7-40089df80b92 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:43.901998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279549cb-52cc-4a49-aab7-40089df80b92 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:43.941776 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97151a5c-f5e6-4e44-b9bd-524d5f461f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:43.942995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97151a5c-f5e6-4e44-b9bd-524d5f461f98 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:43.943354 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97151a5c-f5e6-4e44-b9bd-524d5f461f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:43.943783 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97151a5c-f5e6-4e44-b9bd-524d5f461f98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:43.953933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97151a5c-f5e6-4e44-b9bd-524d5f461f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-97151a5c-f5e6-4e44-b9bd-524d5f461f98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:24:43.962073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:43.963078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:43.964334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:43.964334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:43.964334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:43.964334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:43.964334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:24:43.964334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:24:43.964334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:24:43.964334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:24:43.964334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:24:43.964334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:24:43.964334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:24:43.964334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:24:43.967631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 593/1222] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:24:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:43.969651 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e1fde-ff14-4c9c-9280-215dac9e638b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:44.078336 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e1fde-ff14-4c9c-9280-215dac9e638b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:44.102075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:44.115050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c7102-996c-4ee2-9e42-ed894b0705ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:44.115846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c7102-996c-4ee2-9e42-ed894b0705ff None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:44.116133 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c7102-996c-4ee2-9e42-ed894b0705ff None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:44.116409 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c7102-996c-4ee2-9e42-ed894b0705ff None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:44.117153 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c7102-996c-4ee2-9e42-ed894b0705ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:44.117459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c7102-996c-4ee2-9e42-ed894b0705ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:44.119269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c7102-996c-4ee2-9e42-ed894b0705ff None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:44.129097 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 630/1223] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:24:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:44.136532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97151a5c-f5e6-4e44-b9bd-524d5f461f98 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:44.181780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:44.252395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97151a5c-f5e6-4e44-b9bd-524d5f461f98 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:44.290611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdc45c-7868-4a2c-9af4-7a508901f6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:44.291405 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdc45c-7868-4a2c-9af4-7a508901f6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:44.291713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdc45c-7868-4a2c-9af4-7a508901f6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:44.291985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdc45c-7868-4a2c-9af4-7a508901f6f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:44.303336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdc45c-7868-4a2c-9af4-7a508901f6f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:44.305082 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdc45c-7868-4a2c-9af4-7a508901f6f3 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-83bdc45c-7868-4a2c-9af4-7a508901f6f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:24:44.327857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:44.329078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:44.330228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:24:44.330228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:24:44.330228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:44.330228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:24:44.330228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 594/1224] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:44.337070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c7102-996c-4ee2-9e42-ed894b0705ff None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:44.455515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c7102-996c-4ee2-9e42-ed894b0705ff None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:44.490322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0c721-20d7-447e-ab84-6bdec509ca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:44.491000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0c721-20d7-447e-ab84-6bdec509ca6e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:44.491320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0c721-20d7-447e-ab84-6bdec509ca6e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:44.491625 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0c721-20d7-447e-ab84-6bdec509ca6e None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:44.492417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0c721-20d7-447e-ab84-6bdec509ca6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:44.492729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0c721-20d7-447e-ab84-6bdec509ca6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:44.494359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0c721-20d7-447e-ab84-6bdec509ca6e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:44.507100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 631/1225] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:24:44.512994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdc45c-7868-4a2c-9af4-7a508901f6f3 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:44.627389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:44.635845 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdc45c-7868-4a2c-9af4-7a508901f6f3 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:44.672523 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5553d3-b701-4b4c-966f-72d0cf29ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:44.673551 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5553d3-b701-4b4c-966f-72d0cf29ae93 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:44.673700 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5553d3-b701-4b4c-966f-72d0cf29ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:44.673958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5553d3-b701-4b4c-966f-72d0cf29ae93 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:44.684063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5553d3-b701-4b4c-966f-72d0cf29ae93 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:44.685813 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5553d3-b701-4b4c-966f-72d0cf29ae93 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-da5553d3-b701-4b4c-966f-72d0cf29ae93 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:24:44.703595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:44.704801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:44.706139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:44.706139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:44.706139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:24:44.706139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:24:44.706139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:24:44.706139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:24:44.706139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:24:44.706139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:24:44.706139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 10:24:44.706139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:24:44.706139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 595/1226] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:44.710750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0c721-20d7-447e-ab84-6bdec509ca6e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:44.764110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:44.825334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0c721-20d7-447e-ab84-6bdec509ca6e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:44.862833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8849b-773c-4458-b14a-5be098ec80d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:44.863572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8849b-773c-4458-b14a-5be098ec80d0 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:44.863850 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8849b-773c-4458-b14a-5be098ec80d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:44.864156 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8849b-773c-4458-b14a-5be098ec80d0 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:44.865545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8849b-773c-4458-b14a-5be098ec80d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:44.865857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8849b-773c-4458-b14a-5be098ec80d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:44.867339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8849b-773c-4458-b14a-5be098ec80d0 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:44.887343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 632/1227] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Jun 15 10:24:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:44.893541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5553d3-b701-4b4c-966f-72d0cf29ae93 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:45.009079 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5553d3-b701-4b4c-966f-72d0cf29ae93 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:45.045490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d25fdc-53d2-49c4-9c9d-7a85a5c007c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:45.046192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d25fdc-53d2-49c4-9c9d-7a85a5c007c8 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:45.046492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d25fdc-53d2-49c4-9c9d-7a85a5c007c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:45.046753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d25fdc-53d2-49c4-9c9d-7a85a5c007c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:45.057945 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d25fdc-53d2-49c4-9c9d-7a85a5c007c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:45.059385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d25fdc-53d2-49c4-9c9d-7a85a5c007c8 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-18d25fdc-53d2-49c4-9c9d-7a85a5c007c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:24:45.078207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:45.079760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:45.080968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:24:45.080968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:24:45.080968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:45.080968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:24:45.080968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 596/1228] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:24:45.085912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8849b-773c-4458-b14a-5be098ec80d0 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:45.190533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8849b-773c-4458-b14a-5be098ec80d0 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:45.193618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:45.225902 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f4c2a-5309-4ed9-af74-6f6d11fb88ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:45.226557 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f4c2a-5309-4ed9-af74-6f6d11fb88ff None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:45.226836 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f4c2a-5309-4ed9-af74-6f6d11fb88ff None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:45.227109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f4c2a-5309-4ed9-af74-6f6d11fb88ff None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:45.227853 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f4c2a-5309-4ed9-af74-6f6d11fb88ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:45.228153 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f4c2a-5309-4ed9-af74-6f6d11fb88ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:45.229643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f4c2a-5309-4ed9-af74-6f6d11fb88ff None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:45.242439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 633/1229] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:45.248415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d25fdc-53d2-49c4-9c9d-7a85a5c007c8 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:45.258644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:45.357248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d25fdc-53d2-49c4-9c9d-7a85a5c007c8 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:45.394849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fee48-69c3-43b1-bead-90a2ea38911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:45.395957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fee48-69c3-43b1-bead-90a2ea38911a None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:45.396465 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fee48-69c3-43b1-bead-90a2ea38911a None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:45.397021 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fee48-69c3-43b1-bead-90a2ea38911a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:45.407246 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fee48-69c3-43b1-bead-90a2ea38911a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:45.408933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fee48-69c3-43b1-bead-90a2ea38911a None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-1b8fee48-69c3-43b1-bead-90a2ea38911a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:24:45.425416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:45.426604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:45.428364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:24:45.428364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:24:45.428364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:24:45.428364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:24:45.428364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:24:45.428364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:24:45.428364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:24:45.428364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:24:45.428364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 597/1230] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:24:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:45.434110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f4c2a-5309-4ed9-af74-6f6d11fb88ff None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:45.545955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f4c2a-5309-4ed9-af74-6f6d11fb88ff None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:45.582358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6002aa3-39de-4f17-9511-e712784bd2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:45.583015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6002aa3-39de-4f17-9511-e712784bd2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:45.583294 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6002aa3-39de-4f17-9511-e712784bd2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:45.583600 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6002aa3-39de-4f17-9511-e712784bd2d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:45.584382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6002aa3-39de-4f17-9511-e712784bd2d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:45.584693 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6002aa3-39de-4f17-9511-e712784bd2d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:45.586105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6002aa3-39de-4f17-9511-e712784bd2d2 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:45.598424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 634/1231] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:24:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:45.605512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fee48-69c3-43b1-bead-90a2ea38911a None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:45.700584 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:45.751713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fee48-69c3-43b1-bead-90a2ea38911a None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:45.793825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e6dee-2055-4151-bb9c-1fbbabdf6153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:45.794811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e6dee-2055-4151-bb9c-1fbbabdf6153 None admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:45.795203 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e6dee-2055-4151-bb9c-1fbbabdf6153 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:45.795692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e6dee-2055-4151-bb9c-1fbbabdf6153 None admin] PATH_INFO: `/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/2729cb0b9adb44f7ba5c968b6158a93c/roles/f6ffe6f612824e50a23f0b06a16a1f91` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:45.813078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e6dee-2055-4151-bb9c-1fbbabdf6153 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2eb230241340229293ca1aa5585cdc, user_id=2729cb0b9adb44f7ba5c968b6158a93c, role_id=f6ffe6f612824e50a23f0b06a16a1f91)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:45.814567 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e6dee-2055-4151-bb9c-1fbbabdf6153 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:45.833985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 598/1232] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:24:45 2022] PUT /identity/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/2729cb0b9adb44f7ba5c968b6158a93c/roles/f6ffe6f612824e50a23f0b06a16a1f91 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:24:48.163397 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f23b2-c1bd-440f-a153-2fcd91af18bf None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:48.164224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f23b2-c1bd-440f-a153-2fcd91af18bf None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:48.164451 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f23b2-c1bd-440f-a153-2fcd91af18bf None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:48.166408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 635/1233] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:24:48.173823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835491a9-0fe2-4452-b09b-66fd71c0e94d None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:48.174375 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835491a9-0fe2-4452-b09b-66fd71c0e94d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:48.174375 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835491a9-0fe2-4452-b09b-66fd71c0e94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:48.194874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-835491a9-0fe2-4452-b09b-66fd71c0e94d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:24:48.196132 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-835491a9-0fe2-4452-b09b-66fd71c0e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:24:48.283846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 599/1234] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:24:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:24:48.307858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f23b2-c1bd-440f-a153-2fcd91af18bf None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:48.335348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:48.419570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f23b2-c1bd-440f-a153-2fcd91af18bf None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:48.467686 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe080e5-1988-4fc0-9799-b9aef97a6208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:48.468565 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe080e5-1988-4fc0-9799-b9aef97a6208 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:48.468849 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe080e5-1988-4fc0-9799-b9aef97a6208 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:48.469150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe080e5-1988-4fc0-9799-b9aef97a6208 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:48.481691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe080e5-1988-4fc0-9799-b9aef97a6208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-dbe080e5-1988-4fc0-9799-b9aef97a6208 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:24:48.491042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:48.492471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:48.493628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:48.493628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:48.493628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:48.493628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:48.493628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:24:48.493628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:24:48.493628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:24:48.493628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:24:48.493628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:24:48.493628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:24:48.493628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 10:24:48.493628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:24:48.493628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 636/1235] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Jun 15 10:24:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:48.498657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835491a9-0fe2-4452-b09b-66fd71c0e94d None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:48.553184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:48.617351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835491a9-0fe2-4452-b09b-66fd71c0e94d None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:48.652626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c2aa5-d9b9-442b-9641-f0b1366811e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:48.653226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c2aa5-d9b9-442b-9641-f0b1366811e5 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:48.653788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c2aa5-d9b9-442b-9641-f0b1366811e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:48.653788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c2aa5-d9b9-442b-9641-f0b1366811e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:48.654514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c2aa5-d9b9-442b-9641-f0b1366811e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:48.654820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c2aa5-d9b9-442b-9641-f0b1366811e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:48.656228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c2aa5-d9b9-442b-9641-f0b1366811e5 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:48.665809 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 600/1236] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Jun 15 10:24:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:24:48.672944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe080e5-1988-4fc0-9799-b9aef97a6208 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:48.764320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:48.791551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe080e5-1988-4fc0-9799-b9aef97a6208 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:48.833664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e146b1-ba73-49ac-8fdc-827f30d017c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:48.835958 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e146b1-ba73-49ac-8fdc-827f30d017c1 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:48.836255 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e146b1-ba73-49ac-8fdc-827f30d017c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:48.836703 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e146b1-ba73-49ac-8fdc-827f30d017c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:48.851969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e146b1-ba73-49ac-8fdc-827f30d017c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:48.853477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e146b1-ba73-49ac-8fdc-827f30d017c1 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-85e146b1-ba73-49ac-8fdc-827f30d017c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:24:48.876510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:48.877583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:48.878837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:24:48.878837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:24:48.878837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:48.878837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:24:48.883203 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 637/1237] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:48.884308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c2aa5-d9b9-442b-9641-f0b1366811e5 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:48.997720 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c2aa5-d9b9-442b-9641-f0b1366811e5 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:49.009223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:49.038158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd912e9-ed89-4a13-ac7e-ce0f0a89e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:49.039001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd912e9-ed89-4a13-ac7e-ce0f0a89e588 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:49.039328 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd912e9-ed89-4a13-ac7e-ce0f0a89e588 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:49.039590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd912e9-ed89-4a13-ac7e-ce0f0a89e588 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:49.040395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd912e9-ed89-4a13-ac7e-ce0f0a89e588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:49.040705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd912e9-ed89-4a13-ac7e-ce0f0a89e588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:49.042181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd912e9-ed89-4a13-ac7e-ce0f0a89e588 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:49.056929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 601/1238] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:49.062818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e146b1-ba73-49ac-8fdc-827f30d017c1 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:49.185911 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e146b1-ba73-49ac-8fdc-827f30d017c1 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:49.223077 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a16e1-c31b-4f27-88dd-1928c5c012f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:49.224443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a16e1-c31b-4f27-88dd-1928c5c012f9 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:49.224725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a16e1-c31b-4f27-88dd-1928c5c012f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:49.224999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a16e1-c31b-4f27-88dd-1928c5c012f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:49.227715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:49.233877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a16e1-c31b-4f27-88dd-1928c5c012f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:49.235819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a16e1-c31b-4f27-88dd-1928c5c012f9 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-c44a16e1-c31b-4f27-88dd-1928c5c012f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:24:49.251340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:49.252588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:49.253912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:49.253912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:49.253912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:24:49.253912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:24:49.253912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:24:49.253912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:24:49.253912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:24:49.253912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:24:49.253912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 10:24:49.253912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:24:49.258087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 638/1239] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:49.258879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd912e9-ed89-4a13-ac7e-ce0f0a89e588 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:49.374888 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd912e9-ed89-4a13-ac7e-ce0f0a89e588 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:49.417683 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0738496-960f-4a9c-9193-b48c35c8844e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:49.418373 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738496-960f-4a9c-9193-b48c35c8844e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:49.418741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738496-960f-4a9c-9193-b48c35c8844e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:49.419039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738496-960f-4a9c-9193-b48c35c8844e None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:49.419878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0738496-960f-4a9c-9193-b48c35c8844e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:49.420207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0738496-960f-4a9c-9193-b48c35c8844e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:49.421825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0738496-960f-4a9c-9193-b48c35c8844e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:49.442919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 602/1240] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Jun 15 10:24:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:24:49.450596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a16e1-c31b-4f27-88dd-1928c5c012f9 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:49.573149 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a16e1-c31b-4f27-88dd-1928c5c012f9 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:49.611227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe02c0-a48c-4d36-8a8b-a892ad7ec59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:49.611227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe02c0-a48c-4d36-8a8b-a892ad7ec59c None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:49.611227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe02c0-a48c-4d36-8a8b-a892ad7ec59c None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:49.611227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe02c0-a48c-4d36-8a8b-a892ad7ec59c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:49.681348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:49.688526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe02c0-a48c-4d36-8a8b-a892ad7ec59c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:49.690023 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe02c0-a48c-4d36-8a8b-a892ad7ec59c None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:49.800960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 639/1241] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:24:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:24:49.807993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0738496-960f-4a9c-9193-b48c35c8844e None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:49.846275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:49.928054 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0738496-960f-4a9c-9193-b48c35c8844e None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:49.975085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071043a3-405d-420d-82ce-b36b20f26ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:49.975968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071043a3-405d-420d-82ce-b36b20f26ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:49.976220 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071043a3-405d-420d-82ce-b36b20f26ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:49.976480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071043a3-405d-420d-82ce-b36b20f26ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:49.987215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071043a3-405d-420d-82ce-b36b20f26ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:49.988985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071043a3-405d-420d-82ce-b36b20f26ca9 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-071043a3-405d-420d-82ce-b36b20f26ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:24:50.008891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:50.009996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:50.010974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:24:50.010974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:24:50.010974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:50.010974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:24:50.010974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 603/1242] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:24:50.016280 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe02c0-a48c-4d36-8a8b-a892ad7ec59c None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:50.127509 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:50.141634 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe02c0-a48c-4d36-8a8b-a892ad7ec59c None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:50.184637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c82e3-9421-45ff-82a5-921f16aefe6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:50.185608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c82e3-9421-45ff-82a5-921f16aefe6b None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:50.185883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c82e3-9421-45ff-82a5-921f16aefe6b None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:50.186039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c82e3-9421-45ff-82a5-921f16aefe6b None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:50.186969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c82e3-9421-45ff-82a5-921f16aefe6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:50.187132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c82e3-9421-45ff-82a5-921f16aefe6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:50.188559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c82e3-9421-45ff-82a5-921f16aefe6b None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:50.201461 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 640/1243] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:50.207230 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071043a3-405d-420d-82ce-b36b20f26ca9 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:50.299671 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:50.324154 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071043a3-405d-420d-82ce-b36b20f26ca9 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:50.363785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71756c32-88c7-49cc-8180-6917df2a6553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:50.365109 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71756c32-88c7-49cc-8180-6917df2a6553 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:50.365395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71756c32-88c7-49cc-8180-6917df2a6553 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:50.365672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71756c32-88c7-49cc-8180-6917df2a6553 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:50.372789 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71756c32-88c7-49cc-8180-6917df2a6553 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:50.374237 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71756c32-88c7-49cc-8180-6917df2a6553 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-71756c32-88c7-49cc-8180-6917df2a6553 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:24:50.388640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:50.389834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:50.390962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:24:50.390962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:24:50.390962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:24:50.390962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:24:50.390962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:24:50.390962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:24:50.390962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:24:50.390962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:24:50.390962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 604/1244] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:24:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:50.396515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c82e3-9421-45ff-82a5-921f16aefe6b None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:50.516143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c82e3-9421-45ff-82a5-921f16aefe6b None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:50.556171 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061cae5-b73b-4981-9e70-171858ccc439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:50.556836 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061cae5-b73b-4981-9e70-171858ccc439 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:50.557116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061cae5-b73b-4981-9e70-171858ccc439 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:50.557394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061cae5-b73b-4981-9e70-171858ccc439 None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:50.558184 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061cae5-b73b-4981-9e70-171858ccc439 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:50.558488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061cae5-b73b-4981-9e70-171858ccc439 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:50.559963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061cae5-b73b-4981-9e70-171858ccc439 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:50.572854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 641/1245] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:24:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:50.579806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71756c32-88c7-49cc-8180-6917df2a6553 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:50.690490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71756c32-88c7-49cc-8180-6917df2a6553 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:50.726345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de86fb4-ee4c-444d-9620-02f0f7507e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:50.726992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de86fb4-ee4c-444d-9620-02f0f7507e0e None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:50.727272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de86fb4-ee4c-444d-9620-02f0f7507e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:50.727588 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de86fb4-ee4c-444d-9620-02f0f7507e0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:50.728443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de86fb4-ee4c-444d-9620-02f0f7507e0e None admin] RBAC: Adding query filter params (role.id=f6ffe6f612824e50a23f0b06a16a1f91, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=2729cb0b9adb44f7ba5c968b6158a93c) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:50.728719 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de86fb4-ee4c-444d-9620-02f0f7507e0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:50.730254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de86fb4-ee4c-444d-9620-02f0f7507e0e None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:50.736612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 605/1246] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:24:50 2022] GET /identity/v3/role_assignments?user.id=2729cb0b9adb44f7ba5c968b6158a93c&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=f6ffe6f612824e50a23f0b06a16a1f91 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:24:53.116235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5555-59b3-46ee-82c3-98d8b206da9e None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:53.116765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5555-59b3-46ee-82c3-98d8b206da9e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:53.116857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5555-59b3-46ee-82c3-98d8b206da9e None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:53.118162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 642/1247] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:24:53.124430 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09add12f-e2b1-4226-b6f2-3acfbc7c224e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:53.124889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09add12f-e2b1-4226-b6f2-3acfbc7c224e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:53.125178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09add12f-e2b1-4226-b6f2-3acfbc7c224e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:53.130487 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:53.143241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-09add12f-e2b1-4226-b6f2-3acfbc7c224e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:24:53.144550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-09add12f-e2b1-4226-b6f2-3acfbc7c224e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:24:53.217897 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 606/1248] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:24:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:24:53.242281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5555-59b3-46ee-82c3-98d8b206da9e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:53.262716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:53.368094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5555-59b3-46ee-82c3-98d8b206da9e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:53.404246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b790e05-28a6-4bf6-b96d-781181023a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:53.405210 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790e05-28a6-4bf6-b96d-781181023a49 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:53.405567 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790e05-28a6-4bf6-b96d-781181023a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:53.405943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790e05-28a6-4bf6-b96d-781181023a49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:53.422072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b790e05-28a6-4bf6-b96d-781181023a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-5b790e05-28a6-4bf6-b96d-781181023a49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:24:53.431935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:53.433714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:53.434823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:53.434823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:53.434823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:53.434823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:53.434823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:24:53.434823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:24:53.434823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:24:53.434823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:24:53.434823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:24:53.434823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:24:53.434823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:24:53.434823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:24:53.434823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 643/1249] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:24:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:53.439601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09add12f-e2b1-4226-b6f2-3acfbc7c224e None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:53.553210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09add12f-e2b1-4226-b6f2-3acfbc7c224e None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:53.587592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:53.592920 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895fe50-eb58-465a-90fc-339cf9e36289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:53.593593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895fe50-eb58-465a-90fc-339cf9e36289 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:53.593871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895fe50-eb58-465a-90fc-339cf9e36289 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:53.594151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895fe50-eb58-465a-90fc-339cf9e36289 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:53.594901 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895fe50-eb58-465a-90fc-339cf9e36289 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:53.595206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895fe50-eb58-465a-90fc-339cf9e36289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:53.596636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895fe50-eb58-465a-90fc-339cf9e36289 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:53.606305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 607/1250] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:24:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:53.613776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b790e05-28a6-4bf6-b96d-781181023a49 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:53.706660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:53.732722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b790e05-28a6-4bf6-b96d-781181023a49 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:53.768662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236811d-9195-426d-b90b-7407ae8c7912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:53.769459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236811d-9195-426d-b90b-7407ae8c7912 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:53.769734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236811d-9195-426d-b90b-7407ae8c7912 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:53.769991 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236811d-9195-426d-b90b-7407ae8c7912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:53.781884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236811d-9195-426d-b90b-7407ae8c7912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:53.783436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236811d-9195-426d-b90b-7407ae8c7912 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-1236811d-9195-426d-b90b-7407ae8c7912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:24:53.802712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:53.803888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:53.805051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:24:53.805051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:24:53.805051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:53.805051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:24:53.805051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 644/1251] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:53.810630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895fe50-eb58-465a-90fc-339cf9e36289 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:53.933186 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895fe50-eb58-465a-90fc-339cf9e36289 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:53.972684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd675-2aa8-45f9-9583-916fb143e758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:53.973799 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd675-2aa8-45f9-9583-916fb143e758 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:53.974383 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd675-2aa8-45f9-9583-916fb143e758 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:53.974849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd675-2aa8-45f9-9583-916fb143e758 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:53.975989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fd675-2aa8-45f9-9583-916fb143e758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:53.976471 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fd675-2aa8-45f9-9583-916fb143e758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:53.978226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fd675-2aa8-45f9-9583-916fb143e758 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:53.997485 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 608/1252] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:53.998785 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236811d-9195-426d-b90b-7407ae8c7912 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:54.108171 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236811d-9195-426d-b90b-7407ae8c7912 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:54.139855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:54.149532 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064fc4b-8574-467e-ab7b-a6653e1d1d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:54.150367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064fc4b-8574-467e-ab7b-a6653e1d1d95 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:54.150652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064fc4b-8574-467e-ab7b-a6653e1d1d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:54.150921 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064fc4b-8574-467e-ab7b-a6653e1d1d95 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:54.158728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064fc4b-8574-467e-ab7b-a6653e1d1d95 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:54.160189 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064fc4b-8574-467e-ab7b-a6653e1d1d95 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-d064fc4b-8574-467e-ab7b-a6653e1d1d95 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:24:54.174900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:54.176062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:54.177660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:54.177660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:54.177660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:24:54.177660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:24:54.177660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:24:54.177660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:24:54.177660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:24:54.177660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:24:54.177660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 10:24:54.177660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:24:54.177660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 645/1253] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:24:54.182668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd675-2aa8-45f9-9583-916fb143e758 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:54.246239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:54.293294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd675-2aa8-45f9-9583-916fb143e758 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:54.331383 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a16a5-1233-4cf7-9b3f-7f2b143bc716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:54.332077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a16a5-1233-4cf7-9b3f-7f2b143bc716 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:54.332362 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a16a5-1233-4cf7-9b3f-7f2b143bc716 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:54.332633 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a16a5-1233-4cf7-9b3f-7f2b143bc716 None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:54.333499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a16a5-1233-4cf7-9b3f-7f2b143bc716 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:54.333810 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a16a5-1233-4cf7-9b3f-7f2b143bc716 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:54.335236 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a16a5-1233-4cf7-9b3f-7f2b143bc716 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:54.353631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 609/1254] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Jun 15 10:24:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:54.359367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064fc4b-8574-467e-ab7b-a6653e1d1d95 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:54.485107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064fc4b-8574-467e-ab7b-a6653e1d1d95 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:54.520948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f74509-9c3a-46a2-805d-7cd8c142a6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:54.521532 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f74509-9c3a-46a2-805d-7cd8c142a6df None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:54.521813 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f74509-9c3a-46a2-805d-7cd8c142a6df None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:54.522084 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f74509-9c3a-46a2-805d-7cd8c142a6df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:54.577804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:54.591622 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f74509-9c3a-46a2-805d-7cd8c142a6df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:54.593067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f74509-9c3a-46a2-805d-7cd8c142a6df None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:54.697794 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 646/1255] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:24:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:24:54.703587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a16a5-1233-4cf7-9b3f-7f2b143bc716 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:54.806468 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a16a5-1233-4cf7-9b3f-7f2b143bc716 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:54.820669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:54.844408 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af159a-b0a5-4bce-bb88-2d51a6446cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:54.845322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af159a-b0a5-4bce-bb88-2d51a6446cab None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:54.845616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af159a-b0a5-4bce-bb88-2d51a6446cab None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:54.845885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af159a-b0a5-4bce-bb88-2d51a6446cab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:54.856697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af159a-b0a5-4bce-bb88-2d51a6446cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:54.858285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af159a-b0a5-4bce-bb88-2d51a6446cab None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-91af159a-b0a5-4bce-bb88-2d51a6446cab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:24:54.878241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:54.879407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:54.881060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:24:54.881060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:24:54.881060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:54.881060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:24:54.881060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 610/1256] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:54.885824 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f74509-9c3a-46a2-805d-7cd8c142a6df None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:54.977583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:54.991060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f74509-9c3a-46a2-805d-7cd8c142a6df None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:55.027303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34940d-0dff-4cc5-bfea-567dad4ca693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:55.028006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34940d-0dff-4cc5-bfea-567dad4ca693 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:55.028265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34940d-0dff-4cc5-bfea-567dad4ca693 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:55.028533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34940d-0dff-4cc5-bfea-567dad4ca693 None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:55.029242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34940d-0dff-4cc5-bfea-567dad4ca693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:55.029545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34940d-0dff-4cc5-bfea-567dad4ca693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:55.030894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34940d-0dff-4cc5-bfea-567dad4ca693 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:55.042943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 647/1257] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:55.048490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af159a-b0a5-4bce-bb88-2d51a6446cab None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:55.157950 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af159a-b0a5-4bce-bb88-2d51a6446cab None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:55.193543 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d3ff5-fd13-44a0-b6a0-34041c8ec2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:55.194367 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d3ff5-fd13-44a0-b6a0-34041c8ec2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:55.194613 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d3ff5-fd13-44a0-b6a0-34041c8ec2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:55.194884 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d3ff5-fd13-44a0-b6a0-34041c8ec2f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:55.201616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d3ff5-fd13-44a0-b6a0-34041c8ec2f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:55.203031 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d3ff5-fd13-44a0-b6a0-34041c8ec2f6 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-714d3ff5-fd13-44a0-b6a0-34041c8ec2f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:24:55.216539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:55.223114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:55.225131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:24:55.225131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:24:55.225131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:24:55.225131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:24:55.225131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:24:55.225131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:24:55.225131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:24:55.225131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:24:55.225131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 611/1258] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:24:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:55.225650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34940d-0dff-4cc5-bfea-567dad4ca693 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:55.339780 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34940d-0dff-4cc5-bfea-567dad4ca693 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:55.378385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08362410-ee2a-4a7b-a3c3-62168d49408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:55.379066 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08362410-ee2a-4a7b-a3c3-62168d49408f None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:55.379361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08362410-ee2a-4a7b-a3c3-62168d49408f None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:55.379692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08362410-ee2a-4a7b-a3c3-62168d49408f None admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:55.380506 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08362410-ee2a-4a7b-a3c3-62168d49408f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:55.380819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08362410-ee2a-4a7b-a3c3-62168d49408f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:55.382289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08362410-ee2a-4a7b-a3c3-62168d49408f None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:55.397047 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 648/1259] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:24:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:55.403874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d3ff5-fd13-44a0-b6a0-34041c8ec2f6 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:55.437906 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:55.524449 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d3ff5-fd13-44a0-b6a0-34041c8ec2f6 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:55.559282 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc669f2-8964-40d7-ad78-3f4037579f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:55.559955 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc669f2-8964-40d7-ad78-3f4037579f07 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:55.560234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc669f2-8964-40d7-ad78-3f4037579f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:55.560504 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc669f2-8964-40d7-ad78-3f4037579f07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:55.561333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc669f2-8964-40d7-ad78-3f4037579f07 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=2729cb0b9adb44f7ba5c968b6158a93c) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:55.561640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc669f2-8964-40d7-ad78-3f4037579f07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:55.563095 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc669f2-8964-40d7-ad78-3f4037579f07 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:55.569163 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 612/1260] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:24:55 2022] GET /identity/v3/role_assignments?user.id=2729cb0b9adb44f7ba5c968b6158a93c&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=e1a2021d08e14daa969362b3d23face3 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:57.725253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e825e40-a55b-4707-aaf2-2524c199dae3 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:57.725859 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e825e40-a55b-4707-aaf2-2524c199dae3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:57.725859 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e825e40-a55b-4707-aaf2-2524c199dae3 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:57.727179 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 649/1261] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:24:57.732712 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8465926-8f6d-423d-9fcd-9d7f06e1c490 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:57.733170 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8465926-8f6d-423d-9fcd-9d7f06e1c490 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:57.733359 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8465926-8f6d-423d-9fcd-9d7f06e1c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:57.755932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-c8465926-8f6d-423d-9fcd-9d7f06e1c490 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:24:57.757128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c8465926-8f6d-423d-9fcd-9d7f06e1c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:24:57.823584 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 613/1262] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:24:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:24:57.846989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e825e40-a55b-4707-aaf2-2524c199dae3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:57.858005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:57.952707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e825e40-a55b-4707-aaf2-2524c199dae3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:57.986757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1274095-98a1-41db-9ec7-9571ec472567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:57.987567 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1274095-98a1-41db-9ec7-9571ec472567 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:57.987854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1274095-98a1-41db-9ec7-9571ec472567 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:57.988133 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1274095-98a1-41db-9ec7-9571ec472567 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:57.999539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1274095-98a1-41db-9ec7-9571ec472567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-a1274095-98a1-41db-9ec7-9571ec472567 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:24:58.007905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:58.009178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:58.010313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:58.010313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:58.010313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:58.010313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:58.010313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:24:58.010313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:24:58.010313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:24:58.010313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:24:58.010313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:24:58.010313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:24:58.010313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:24:58.010313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:24:58.010313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 650/1263] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:24:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:58.017985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8465926-8f6d-423d-9fcd-9d7f06e1c490 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:58.036041 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:58.116358 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8465926-8f6d-423d-9fcd-9d7f06e1c490 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:58.152253 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92bef2-2548-4914-9b2e-2f359087b978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:58.152914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92bef2-2548-4914-9b2e-2f359087b978 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:58.153190 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92bef2-2548-4914-9b2e-2f359087b978 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:58.153462 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92bef2-2548-4914-9b2e-2f359087b978 None admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:58.154207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92bef2-2548-4914-9b2e-2f359087b978 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:58.154507 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92bef2-2548-4914-9b2e-2f359087b978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:58.155898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92bef2-2548-4914-9b2e-2f359087b978 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:58.164570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 614/1264] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:24:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:58.170449 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1274095-98a1-41db-9ec7-9571ec472567 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:58.236916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:58.270987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1274095-98a1-41db-9ec7-9571ec472567 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:58.306138 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cbed4-8774-4376-b1f5-253f2f55dfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:58.306929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cbed4-8774-4376-b1f5-253f2f55dfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:58.307212 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cbed4-8774-4376-b1f5-253f2f55dfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:58.307507 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cbed4-8774-4376-b1f5-253f2f55dfc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:58.318996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cbed4-8774-4376-b1f5-253f2f55dfc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:58.320519 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cbed4-8774-4376-b1f5-253f2f55dfc6 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-7a1cbed4-8774-4376-b1f5-253f2f55dfc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:24:58.337851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:58.338979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:58.340147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:24:58.340147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:24:58.340147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:58.340147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:24:58.340147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 651/1265] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:58.344851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92bef2-2548-4914-9b2e-2f359087b978 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:58.440107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:58.466262 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92bef2-2548-4914-9b2e-2f359087b978 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:58.506267 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c8911-7b5c-46f0-b18d-a6c60c635681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:58.506844 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c8911-7b5c-46f0-b18d-a6c60c635681 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:58.507126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c8911-7b5c-46f0-b18d-a6c60c635681 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:58.507402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c8911-7b5c-46f0-b18d-a6c60c635681 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:58.508155 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c8911-7b5c-46f0-b18d-a6c60c635681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:58.508459 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c8911-7b5c-46f0-b18d-a6c60c635681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:58.509828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c8911-7b5c-46f0-b18d-a6c60c635681 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:58.521440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 615/1266] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:58.527214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cbed4-8774-4376-b1f5-253f2f55dfc6 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:58.626240 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cbed4-8774-4376-b1f5-253f2f55dfc6 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:58.646416 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:58.660421 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bbdd7-ce4a-430c-9871-197c5e583974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:58.661780 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bbdd7-ce4a-430c-9871-197c5e583974 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:58.662057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bbdd7-ce4a-430c-9871-197c5e583974 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:58.662331 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bbdd7-ce4a-430c-9871-197c5e583974 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:58.670273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bbdd7-ce4a-430c-9871-197c5e583974 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:58.671763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bbdd7-ce4a-430c-9871-197c5e583974 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-012bbdd7-ce4a-430c-9871-197c5e583974 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:24:58.686587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:58.689220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:58.691087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:58.691087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:58.691087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:24:58.691087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:24:58.691087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:24:58.691087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:24:58.691087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:24:58.691087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:24:58.691087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 10:24:58.691087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:24:58.691087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 652/1267] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:58.693672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c8911-7b5c-46f0-b18d-a6c60c635681 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:58.793270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c8911-7b5c-46f0-b18d-a6c60c635681 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:58.828104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b15602-5e44-451b-a961-3f19caebcf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:58.828771 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15602-5e44-451b-a961-3f19caebcf1b None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:58.829050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15602-5e44-451b-a961-3f19caebcf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:58.829321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15602-5e44-451b-a961-3f19caebcf1b None admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:58.830165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b15602-5e44-451b-a961-3f19caebcf1b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:58.830465 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b15602-5e44-451b-a961-3f19caebcf1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:58.831922 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b15602-5e44-451b-a961-3f19caebcf1b None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:58.841460 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:58.850759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 616/1268] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Jun 15 10:24:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:58.856574 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bbdd7-ce4a-430c-9871-197c5e583974 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:58.961193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bbdd7-ce4a-430c-9871-197c5e583974 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:58.995286 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2683e04-c6a5-481b-aeb3-6d49ad651f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:58.996098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683e04-c6a5-481b-aeb3-6d49ad651f35 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:58.996375 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683e04-c6a5-481b-aeb3-6d49ad651f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:58.996718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683e04-c6a5-481b-aeb3-6d49ad651f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:59.007892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2683e04-c6a5-481b-aeb3-6d49ad651f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:59.009318 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2683e04-c6a5-481b-aeb3-6d49ad651f35 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-f2683e04-c6a5-481b-aeb3-6d49ad651f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:24:59.026427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:59.027570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:59.028610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:24:59.028610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:24:59.028610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:24:59.028610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:24:59.028610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 653/1269] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:59.033699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b15602-5e44-451b-a961-3f19caebcf1b None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:59.138319 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b15602-5e44-451b-a961-3f19caebcf1b None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:59.174092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815e3a8-6563-407f-ab36-6815c6e78443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:59.174760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e3a8-6563-407f-ab36-6815c6e78443 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:59.175042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e3a8-6563-407f-ab36-6815c6e78443 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:59.175316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e3a8-6563-407f-ab36-6815c6e78443 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:59.176076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815e3a8-6563-407f-ab36-6815c6e78443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:59.176413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815e3a8-6563-407f-ab36-6815c6e78443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:59.177788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815e3a8-6563-407f-ab36-6815c6e78443 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:59.189311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 617/1270] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:59.195482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2683e04-c6a5-481b-aeb3-6d49ad651f35 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:59.227486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:59.298872 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2683e04-c6a5-481b-aeb3-6d49ad651f35 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:59.333650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb40fff-19cd-433b-a1bf-5fa1a8fab264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:59.334432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb40fff-19cd-433b-a1bf-5fa1a8fab264 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:59.334714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb40fff-19cd-433b-a1bf-5fa1a8fab264 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:59.334988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb40fff-19cd-433b-a1bf-5fa1a8fab264 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:59.341892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb40fff-19cd-433b-a1bf-5fa1a8fab264 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:59.343333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb40fff-19cd-433b-a1bf-5fa1a8fab264 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-3fb40fff-19cd-433b-a1bf-5fa1a8fab264 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:24:59.357847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:24:59.359036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:24:59.360353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:24:59.360353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:24:59.360353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:24:59.360353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:24:59.360353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:24:59.360353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:24:59.360353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:24:59.360353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:24:59.360353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 654/1271] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:24:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:24:59.365404 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815e3a8-6563-407f-ab36-6815c6e78443 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:59.428657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:59.471989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815e3a8-6563-407f-ab36-6815c6e78443 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:59.506968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783d4da-f222-4ed1-966a-f734dfac6d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:59.507655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783d4da-f222-4ed1-966a-f734dfac6d13 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:59.507938 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783d4da-f222-4ed1-966a-f734dfac6d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:59.508213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783d4da-f222-4ed1-966a-f734dfac6d13 None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:59.508993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783d4da-f222-4ed1-966a-f734dfac6d13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:24:59.509299 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783d4da-f222-4ed1-966a-f734dfac6d13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:59.510729 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783d4da-f222-4ed1-966a-f734dfac6d13 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:59.522829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 618/1272] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:24:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:24:59.529466 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb40fff-19cd-433b-a1bf-5fa1a8fab264 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:24:59.620982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:24:59.630237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb40fff-19cd-433b-a1bf-5fa1a8fab264 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:24:59.667241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527d17-a1cf-447e-b69f-3c9c88bd8c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:24:59.668229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527d17-a1cf-447e-b69f-3c9c88bd8c82 None admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:24:59.668507 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527d17-a1cf-447e-b69f-3c9c88bd8c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:24:59.668783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527d17-a1cf-447e-b69f-3c9c88bd8c82 None admin] PATH_INFO: `/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/2729cb0b9adb44f7ba5c968b6158a93c/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:24:59.670851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35527d17-a1cf-447e-b69f-3c9c88bd8c82 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2eb230241340229293ca1aa5585cdc, user_id=2729cb0b9adb44f7ba5c968b6158a93c, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:24:59.672327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35527d17-a1cf-447e-b69f-3c9c88bd8c82 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:24:59.687142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 655/1273] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Jun 15 10:24:59 2022] PUT /identity/v3/projects/ab2eb230241340229293ca1aa5585cdc/users/2729cb0b9adb44f7ba5c968b6158a93c/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:25:01.827940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dcd7a-c928-4691-83c7-7a4b19577e6a None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:01.828496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dcd7a-c928-4691-83c7-7a4b19577e6a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:01.828496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dcd7a-c928-4691-83c7-7a4b19577e6a None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:01.829872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 619/1274] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:25:01.835728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b2294-7b82-4e04-a585-109c4b70fb49 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:01.836169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b2294-7b82-4e04-a585-109c4b70fb49 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:01.836269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b2294-7b82-4e04-a585-109c4b70fb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:01.853361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-132b2294-7b82-4e04-a585-109c4b70fb49 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:25:01.854541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-132b2294-7b82-4e04-a585-109c4b70fb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:25:01.926248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 656/1275] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:25:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:25:01.949358 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748dcd7a-c928-4691-83c7-7a4b19577e6a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:02.049949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748dcd7a-c928-4691-83c7-7a4b19577e6a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:02.067529 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:02.084714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481377ff-ca77-4b00-a28e-4931295736b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:02.085497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481377ff-ca77-4b00-a28e-4931295736b1 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:02.085776 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481377ff-ca77-4b00-a28e-4931295736b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:02.086048 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481377ff-ca77-4b00-a28e-4931295736b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:02.095923 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481377ff-ca77-4b00-a28e-4931295736b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-481377ff-ca77-4b00-a28e-4931295736b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 10:25:02.103427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:25:02.104666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:25:02.105704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:25:02.105704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:25:02.105704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:25:02.105704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:25:02.105704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 10:25:02.105704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 10:25:02.105704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 10:25:02.105704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 10:25:02.105704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 10:25:02.105704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 10:25:02.105704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 10:25:02.105704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:25:02.105704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 620/1276] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Jun 15 10:25:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:25:02.110993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b2294-7b82-4e04-a585-109c4b70fb49 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:02.200195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:02.220263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b2294-7b82-4e04-a585-109c4b70fb49 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:02.257266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7240e8-5f9f-47fd-80ee-15431e585800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:02.257926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7240e8-5f9f-47fd-80ee-15431e585800 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:02.258230 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7240e8-5f9f-47fd-80ee-15431e585800 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:02.258504 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7240e8-5f9f-47fd-80ee-15431e585800 None admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:02.259245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7240e8-5f9f-47fd-80ee-15431e585800 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:25:02.259572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7240e8-5f9f-47fd-80ee-15431e585800 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:02.260944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7240e8-5f9f-47fd-80ee-15431e585800 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:02.269838 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 657/1277] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Jun 15 10:25:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:25:02.276305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481377ff-ca77-4b00-a28e-4931295736b1 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:02.376528 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481377ff-ca77-4b00-a28e-4931295736b1 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:02.414775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36ed83-6a6d-434d-bb20-41fbe598d845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:02.415718 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ed83-6a6d-434d-bb20-41fbe598d845 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:02.416044 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ed83-6a6d-434d-bb20-41fbe598d845 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:02.416318 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ed83-6a6d-434d-bb20-41fbe598d845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:02.429811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36ed83-6a6d-434d-bb20-41fbe598d845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:02.431835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36ed83-6a6d-434d-bb20-41fbe598d845 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-0b36ed83-6a6d-434d-bb20-41fbe598d845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:25:02.452228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:25:02.453391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:25:02.454426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:25:02.454426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:25:02.454426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:25:02.454426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:25:02.454426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 621/1278] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:25:02.460350 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7240e8-5f9f-47fd-80ee-15431e585800 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:02.565577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7240e8-5f9f-47fd-80ee-15431e585800 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:02.599125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa16ab-4f2c-4391-90c2-f88adfc98f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:02.599798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa16ab-4f2c-4391-90c2-f88adfc98f3d None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:02.600078 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa16ab-4f2c-4391-90c2-f88adfc98f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:02.600347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa16ab-4f2c-4391-90c2-f88adfc98f3d None admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:02.601058 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa16ab-4f2c-4391-90c2-f88adfc98f3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:25:02.601359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa16ab-4f2c-4391-90c2-f88adfc98f3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:02.602712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa16ab-4f2c-4391-90c2-f88adfc98f3d None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:02.615030 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 658/1279] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:25:02.621176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36ed83-6a6d-434d-bb20-41fbe598d845 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:02.652496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:02.725994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36ed83-6a6d-434d-bb20-41fbe598d845 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:02.759430 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5ec4f-e66f-4581-9be6-51deb1761ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:02.760269 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5ec4f-e66f-4581-9be6-51deb1761ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:02.760547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5ec4f-e66f-4581-9be6-51deb1761ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:02.760824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5ec4f-e66f-4581-9be6-51deb1761ac1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:02.769569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5ec4f-e66f-4581-9be6-51deb1761ac1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:02.771092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5ec4f-e66f-4581-9be6-51deb1761ac1 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-bab5ec4f-e66f-4581-9be6-51deb1761ac1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 10:25:02.786389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:25:02.787631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:25:02.789026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:25:02.789026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:25:02.789026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 10:25:02.789026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 10:25:02.789026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 10:25:02.789026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 10:25:02.789026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 10:25:02.789026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 10:25:02.789026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 10:25:02.789026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:25:02.789026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 622/1280] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:25:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:25:02.793575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa16ab-4f2c-4391-90c2-f88adfc98f3d None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:02.797428 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:02.894312 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa16ab-4f2c-4391-90c2-f88adfc98f3d None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:02.932751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d5c6e-adea-423b-8939-73991b24ec36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:02.933433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d5c6e-adea-423b-8939-73991b24ec36 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:02.933714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d5c6e-adea-423b-8939-73991b24ec36 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:02.933987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d5c6e-adea-423b-8939-73991b24ec36 None admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:02.934841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d5c6e-adea-423b-8939-73991b24ec36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:25:02.935146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d5c6e-adea-423b-8939-73991b24ec36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:02.936610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d5c6e-adea-423b-8939-73991b24ec36 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:02.954817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 659/1281] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Jun 15 10:25:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:25:02.960582 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5ec4f-e66f-4581-9be6-51deb1761ac1 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:03.067615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:03.078107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5ec4f-e66f-4581-9be6-51deb1761ac1 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:03.112115 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86d3b5-fb3a-48c4-a35c-350a1e9e77b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:03.112765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86d3b5-fb3a-48c4-a35c-350a1e9e77b2 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:03.113054 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86d3b5-fb3a-48c4-a35c-350a1e9e77b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:03.113331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86d3b5-fb3a-48c4-a35c-350a1e9e77b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:03.183866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86d3b5-fb3a-48c4-a35c-350a1e9e77b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:03.185327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86d3b5-fb3a-48c4-a35c-350a1e9e77b2 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:03.275289 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:03.286572 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 623/1282] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Jun 15 10:25:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 10:25:03.292398 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d5c6e-adea-423b-8939-73991b24ec36 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:03.356005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:03.397090 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d5c6e-adea-423b-8939-73991b24ec36 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:03.432327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2902f-8598-4aab-978c-db18471bbc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:03.433112 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2902f-8598-4aab-978c-db18471bbc93 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:03.433395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2902f-8598-4aab-978c-db18471bbc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:03.433671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2902f-8598-4aab-978c-db18471bbc93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:03.444193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2902f-8598-4aab-978c-db18471bbc93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:03.445655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2902f-8598-4aab-978c-db18471bbc93 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-f3e2902f-8598-4aab-978c-db18471bbc93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 10:25:03.464777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:25:03.465986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:25:03.471410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 10:25:03.471410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 10:25:03.471410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 10:25:03.471410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:25:03.471410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 660/1283] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:25:03.471843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86d3b5-fb3a-48c4-a35c-350a1e9e77b2 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:03.576428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86d3b5-fb3a-48c4-a35c-350a1e9e77b2 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:03.611347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524bb23-40ff-4240-ac3d-24251e651b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:03.611962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524bb23-40ff-4240-ac3d-24251e651b50 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:03.612241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524bb23-40ff-4240-ac3d-24251e651b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:03.612507 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524bb23-40ff-4240-ac3d-24251e651b50 None admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:03.613225 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524bb23-40ff-4240-ac3d-24251e651b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:25:03.613521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524bb23-40ff-4240-ac3d-24251e651b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:03.614905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524bb23-40ff-4240-ac3d-24251e651b50 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:03.626729 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 624/1284] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Jun 15 10:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:25:03.632950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2902f-8598-4aab-978c-db18471bbc93 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:03.736666 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2902f-8598-4aab-978c-db18471bbc93 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:03.752333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:03.774904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f0fa-b7d4-417a-aed7-b4da9e9b5a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:03.775715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f0fa-b7d4-417a-aed7-b4da9e9b5a57 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:03.775994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f0fa-b7d4-417a-aed7-b4da9e9b5a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:03.776262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f0fa-b7d4-417a-aed7-b4da9e9b5a57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:03.783189 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953f0fa-b7d4-417a-aed7-b4da9e9b5a57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:03.784663 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953f0fa-b7d4-417a-aed7-b4da9e9b5a57 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application [None req-a953f0fa-b7d4-417a-aed7-b4da9e9b5a57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 10:25:03.798167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application with Lock( Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:25:03.799289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:25:03.800482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 10:25:03.800482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 10:25:03.800482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 10:25:03.800482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 10:25:03.800482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 10:25:03.800482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 10:25:03.800482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 10:25:03.800482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: ERROR keystone.server.flask.application Jun 15 10:25:03.800482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 661/1285] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Jun 15 10:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:25:03.805250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524bb23-40ff-4240-ac3d-24251e651b50 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:03.855438 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:03.906770 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524bb23-40ff-4240-ac3d-24251e651b50 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:03.940664 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9179cf0-ffe4-4cfa-962b-cdd78f7f1411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:03.941319 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9179cf0-ffe4-4cfa-962b-cdd78f7f1411 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:03.941600 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9179cf0-ffe4-4cfa-962b-cdd78f7f1411 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:03.941875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9179cf0-ffe4-4cfa-962b-cdd78f7f1411 None admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:03.943225 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9179cf0-ffe4-4cfa-962b-cdd78f7f1411 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:25:03.943555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9179cf0-ffe4-4cfa-962b-cdd78f7f1411 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:03.944994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9179cf0-ffe4-4cfa-962b-cdd78f7f1411 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:03.957139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 625/1286] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Jun 15 10:25:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:25:03.963260 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f0fa-b7d4-417a-aed7-b4da9e9b5a57 None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:04.064825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f0fa-b7d4-417a-aed7-b4da9e9b5a57 None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:04.099149 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0541da2-bb6d-41a1-978d-3d18f44daf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:04.099828 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0541da2-bb6d-41a1-978d-3d18f44daf11 None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:04.100112 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0541da2-bb6d-41a1-978d-3d18f44daf11 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:04.100388 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0541da2-bb6d-41a1-978d-3d18f44daf11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:04.101218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0541da2-bb6d-41a1-978d-3d18f44daf11 None admin] RBAC: Adding query filter params (role.id=e1a2021d08e14daa969362b3d23face3, scope.project.id=ab2eb230241340229293ca1aa5585cdc, user.id=2729cb0b9adb44f7ba5c968b6158a93c) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:25:04.101524 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0541da2-bb6d-41a1-978d-3d18f44daf11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:04.102946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0541da2-bb6d-41a1-978d-3d18f44daf11 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:04.109196 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 662/1287] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Jun 15 10:25:03 2022] GET /identity/v3/role_assignments?user.id=2729cb0b9adb44f7ba5c968b6158a93c&scope.project.id=ab2eb230241340229293ca1aa5585cdc&role.id=e1a2021d08e14daa969362b3d23face3 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:25:06.295770 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724936d-5097-44e7-a9fe-fdabdf3cd124 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:06.296337 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724936d-5097-44e7-a9fe-fdabdf3cd124 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:06.296337 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724936d-5097-44e7-a9fe-fdabdf3cd124 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:06.297677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 626/1288] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:25:06.303042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06f2ac-3863-43fa-97d2-8060af220b3a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:06.303527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06f2ac-3863-43fa-97d2-8060af220b3a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:06.303638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06f2ac-3863-43fa-97d2-8060af220b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:06.320204 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8c06f2ac-3863-43fa-97d2-8060af220b3a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:25:06.321404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8c06f2ac-3863-43fa-97d2-8060af220b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:25:06.361244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:06.400150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 663/1289] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:25:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:25:06.423173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724936d-5097-44e7-a9fe-fdabdf3cd124 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:06.555733 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724936d-5097-44e7-a9fe-fdabdf3cd124 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:06.567788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:06.592309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f20850-8143-449a-8611-1b8a2835d5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:06.593107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f20850-8143-449a-8611-1b8a2835d5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:06.593390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f20850-8143-449a-8611-1b8a2835d5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:06.593665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f20850-8143-449a-8611-1b8a2835d5e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:06.594324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f20850-8143-449a-8611-1b8a2835d5e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:06.595729 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f20850-8143-449a-8611-1b8a2835d5e1 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-f0f20850-8143-449a-8611-1b8a2835d5e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:25:06.607940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:25:06.609241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:25:06.610168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 627/1290] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Jun 15 10:25:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 10:25:06.615424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06f2ac-3863-43fa-97d2-8060af220b3a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:06.722491 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06f2ac-3863-43fa-97d2-8060af220b3a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:06.757008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cee889-ae02-4fd7-8e1b-b07cbb746b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:06.757658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cee889-ae02-4fd7-8e1b-b07cbb746b3a None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:06.757941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cee889-ae02-4fd7-8e1b-b07cbb746b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:06.758216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cee889-ae02-4fd7-8e1b-b07cbb746b3a None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:06.758919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cee889-ae02-4fd7-8e1b-b07cbb746b3a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:25:06.759223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cee889-ae02-4fd7-8e1b-b07cbb746b3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:06.760620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cee889-ae02-4fd7-8e1b-b07cbb746b3a None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:06.765829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 664/1291] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Jun 15 10:25:06 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:25:06.772273 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f20850-8143-449a-8611-1b8a2835d5e1 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:06.873931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f20850-8143-449a-8611-1b8a2835d5e1 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:06.908009 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d5233-5c69-4318-aa18-a3dfb805d287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:06.908677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d5233-5c69-4318-aa18-a3dfb805d287 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:06.908961 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d5233-5c69-4318-aa18-a3dfb805d287 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:06.909238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d5233-5c69-4318-aa18-a3dfb805d287 None admin] PATH_INFO: `/v3/services` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:06.909955 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d5233-5c69-4318-aa18-a3dfb805d287 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:25:06.910264 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d5233-5c69-4318-aa18-a3dfb805d287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:06.911702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d5233-5c69-4318-aa18-a3dfb805d287 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:06.918908 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 628/1292] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Jun 15 10:25:06 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:25:09.064218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e17ffa-6049-4009-83ae-9a3c23f25631 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:09.064734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e17ffa-6049-4009-83ae-9a3c23f25631 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:09.064734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e17ffa-6049-4009-83ae-9a3c23f25631 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:09.066037 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 665/1293] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:25:09.072794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b8424-dfbf-4f5c-b9c3-0505b4e11b43 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:09.073298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b8424-dfbf-4f5c-b9c3-0505b4e11b43 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:09.073443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b8424-dfbf-4f5c-b9c3-0505b4e11b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:09.091114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-975b8424-dfbf-4f5c-b9c3-0505b4e11b43 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:25:09.092422 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-975b8424-dfbf-4f5c-b9c3-0505b4e11b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:25:09.124882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:09.163369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 629/1294] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:25:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:25:09.187014 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e17ffa-6049-4009-83ae-9a3c23f25631 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:09.219390 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:09.301345 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e17ffa-6049-4009-83ae-9a3c23f25631 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:09.342170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3596ec7-21a1-494d-b96a-4a71d3f61bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:09.342840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3596ec7-21a1-494d-b96a-4a71d3f61bd4 None admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:09.343123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3596ec7-21a1-494d-b96a-4a71d3f61bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:09.343399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3596ec7-21a1-494d-b96a-4a71d3f61bd4 None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:09.344166 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3596ec7-21a1-494d-b96a-4a71d3f61bd4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:09.345545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3596ec7-21a1-494d-b96a-4a71d3f61bd4 None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:09.361548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 666/1295] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Jun 15 10:25:09 2022] POST /identity/v3/services => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:25:11.576579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294169a9-0161-4532-866d-28deefc23431 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:11.577123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294169a9-0161-4532-866d-28deefc23431 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:11.577123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294169a9-0161-4532-866d-28deefc23431 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:11.578503 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 630/1296] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:25:11.584215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5721f-c666-4277-bc0a-b88ca9cf26ad None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:11.584686 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5721f-c666-4277-bc0a-b88ca9cf26ad None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:11.584806 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5721f-c666-4277-bc0a-b88ca9cf26ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:11.601818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b1d5721f-c666-4277-bc0a-b88ca9cf26ad None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:25:11.603005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b1d5721f-c666-4277-bc0a-b88ca9cf26ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:25:11.682791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 667/1297] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:25:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:25:11.706219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294169a9-0161-4532-866d-28deefc23431 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:11.810259 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294169a9-0161-4532-866d-28deefc23431 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:11.846476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47149779-691f-4a72-afc9-4c33f0825153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:11.847272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47149779-691f-4a72-afc9-4c33f0825153 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:11.847591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47149779-691f-4a72-afc9-4c33f0825153 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:11.847864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47149779-691f-4a72-afc9-4c33f0825153 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:11.849025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47149779-691f-4a72-afc9-4c33f0825153 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:11.850393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47149779-691f-4a72-afc9-4c33f0825153 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-47149779-691f-4a72-afc9-4c33f0825153 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:25:11.862255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:25:11.863574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:25:11.865127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 631/1298] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Jun 15 10:25:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:25:11.870555 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5721f-c666-4277-bc0a-b88ca9cf26ad None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:11.889273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:11.980489 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5721f-c666-4277-bc0a-b88ca9cf26ad None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:12.016731 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21abf3-01e5-4da7-b173-1a0c719f792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:12.017728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21abf3-01e5-4da7-b173-1a0c719f792e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:12.018269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21abf3-01e5-4da7-b173-1a0c719f792e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:12.019427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21abf3-01e5-4da7-b173-1a0c719f792e None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:12.019427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21abf3-01e5-4da7-b173-1a0c719f792e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:25:12.019682 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21abf3-01e5-4da7-b173-1a0c719f792e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:12.021049 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21abf3-01e5-4da7-b173-1a0c719f792e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:12.026583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 668/1299] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Jun 15 10:25:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:25:12.032798 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47149779-691f-4a72-afc9-4c33f0825153 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:12.067527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:12.137258 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47149779-691f-4a72-afc9-4c33f0825153 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:12.172673 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b55c29-7202-4969-aacc-2a384085beb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:12.173331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55c29-7202-4969-aacc-2a384085beb4 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:12.173615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55c29-7202-4969-aacc-2a384085beb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:12.173892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b55c29-7202-4969-aacc-2a384085beb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:12.174682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b55c29-7202-4969-aacc-2a384085beb4 None admin] RBAC: Adding query filter params (interface=public, service_id=cbd54b63747546fcaf8d95d9ea73425b, region_id=RegionOne) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:25:12.174993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b55c29-7202-4969-aacc-2a384085beb4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:12.176911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b55c29-7202-4969-aacc-2a384085beb4 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:12.182146 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 632/1300] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Jun 15 10:25:12 2022] GET /identity/v3/endpoints?service_id=cbd54b63747546fcaf8d95d9ea73425b&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:25:12.187983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21abf3-01e5-4da7-b173-1a0c719f792e None admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:12.269946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:12.287959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21abf3-01e5-4da7-b173-1a0c719f792e None admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:12.323746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec82523-cddf-4da8-91fc-a0e553b2b57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:12.324389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec82523-cddf-4da8-91fc-a0e553b2b57e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:12.324669 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec82523-cddf-4da8-91fc-a0e553b2b57e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:12.324944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec82523-cddf-4da8-91fc-a0e553b2b57e None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:12.325623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec82523-cddf-4da8-91fc-a0e553b2b57e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:12.326981 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec82523-cddf-4da8-91fc-a0e553b2b57e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:12.333958 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 669/1301] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Jun 15 10:25:12 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:25:14.465831 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7185d-1cc6-4f4d-a5fb-e55edb1fb625 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:14.466372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7185d-1cc6-4f4d-a5fb-e55edb1fb625 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:14.466372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7185d-1cc6-4f4d-a5fb-e55edb1fb625 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:14.467843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 633/1302] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:25:14.473637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b19d2-a3fe-47aa-aca5-084bd75ca4ec None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:14.474103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b19d2-a3fe-47aa-aca5-084bd75ca4ec None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:14.474197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b19d2-a3fe-47aa-aca5-084bd75ca4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:14.491149 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-253b19d2-a3fe-47aa-aca5-084bd75ca4ec None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:25:14.492405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-253b19d2-a3fe-47aa-aca5-084bd75ca4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:25:14.564376 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 670/1303] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:25:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 10:25:14.587167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7185d-1cc6-4f4d-a5fb-e55edb1fb625 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:14.684166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:14.692003 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7185d-1cc6-4f4d-a5fb-e55edb1fb625 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:14.726808 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45e53d-6f9c-4d12-9b03-bf2e1b51cdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:14.727569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45e53d-6f9c-4d12-9b03-bf2e1b51cdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:14.727857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45e53d-6f9c-4d12-9b03-bf2e1b51cdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:14.728134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45e53d-6f9c-4d12-9b03-bf2e1b51cdc8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:14.728792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45e53d-6f9c-4d12-9b03-bf2e1b51cdc8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:14.730168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45e53d-6f9c-4d12-9b03-bf2e1b51cdc8 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application [None req-1d45e53d-6f9c-4d12-9b03-bf2e1b51cdc8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 10:25:14.742160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 10:25:14.749023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application with Lock( Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self._enter() Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application return self.creator() Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application created_value = creator( Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: ERROR keystone.server.flask.application Jun 15 10:25:14.750174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 634/1304] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Jun 15 10:25:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 10:25:14.751418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b19d2-a3fe-47aa-aca5-084bd75ca4ec None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:14.825483 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:14.849557 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b19d2-a3fe-47aa-aca5-084bd75ca4ec None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:14.883162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150d441-21c0-48e3-817b-efebadcd732e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:14.883851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150d441-21c0-48e3-817b-efebadcd732e None admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:14.884123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150d441-21c0-48e3-817b-efebadcd732e None admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:14.884394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150d441-21c0-48e3-817b-efebadcd732e None admin] PATH_INFO: `/v3/services` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:14.885090 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150d441-21c0-48e3-817b-efebadcd732e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:25:14.885392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150d441-21c0-48e3-817b-efebadcd732e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:14.886745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150d441-21c0-48e3-817b-efebadcd732e None admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:14.891948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 671/1305] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Jun 15 10:25:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:25:14.897972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45e53d-6f9c-4d12-9b03-bf2e1b51cdc8 None admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:25:14.999109 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45e53d-6f9c-4d12-9b03-bf2e1b51cdc8 None admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:25:15.032643 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a91a6-ed57-46f2-9e47-9305cb238f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:25:15.033294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a91a6-ed57-46f2-9e47-9305cb238f91 None admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:25:15.033572 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a91a6-ed57-46f2-9e47-9305cb238f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:25:15.033846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a91a6-ed57-46f2-9e47-9305cb238f91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:25:15.034590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a91a6-ed57-46f2-9e47-9305cb238f91 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:25:15.036526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a91a6-ed57-46f2-9e47-9305cb238f91 None admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:25:15.056111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 635/1306] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Jun 15 10:25:14 2022] POST /identity/v3/endpoints => generated 331 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:25:24.888891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=30 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:25:25.050394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:18.691632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935059d2-8ced-4e64-81ac-4826d1014967 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:18.692087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935059d2-8ced-4e64-81ac-4826d1014967 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:18.692644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935059d2-8ced-4e64-81ac-4826d1014967 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:18.698519 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 672/1307] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:26:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:18.699949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f10f6-6914-4362-b98c-0afe6d556188 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:18.700338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f10f6-6914-4362-b98c-0afe6d556188 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:18.700578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f10f6-6914-4362-b98c-0afe6d556188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:18.800800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-1f8f10f6-6914-4362-b98c-0afe6d556188 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:18.804031 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1f8f10f6-6914-4362-b98c-0afe6d556188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:18.936174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 636/1308] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:26:18.976047 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d32cd5-9e6c-42fa-946f-dd726251a03a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:18.976904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d32cd5-9e6c-42fa-946f-dd726251a03a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:18.977365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d32cd5-9e6c-42fa-946f-dd726251a03a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:18.979009 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 673/1309] 10.222.0.50 () {54 vars in 964 bytes} [Wed Jun 15 10:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:18.985204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093daf60-5f85-462b-975a-fd3f750990aa None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:18.985499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093daf60-5f85-462b-975a-fd3f750990aa None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:18.985787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093daf60-5f85-462b-975a-fd3f750990aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:19.087052 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-093daf60-5f85-462b-975a-fd3f750990aa None None] MFA Rules not processed for user `5f2e2038f69f49019a1e528107296223`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:19.088442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-093daf60-5f85-462b-975a-fd3f750990aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:19.112157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:19.185438 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 637/1310] 10.222.0.50 () {58 vars in 1061 bytes} [Wed Jun 15 10:26:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:26:19.186288 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d32cd5-9e6c-42fa-946f-dd726251a03a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:26:19.188048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a7d32cd5-9e6c-42fa-946f-dd726251a03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:19.319812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d32cd5-9e6c-42fa-946f-dd726251a03a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:26:19.409419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184508e3-3d6c-4ace-9d36-7a06b25eb5f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:26:19.410619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184508e3-3d6c-4ace-9d36-7a06b25eb5f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:19.411154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184508e3-3d6c-4ace-9d36-7a06b25eb5f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:19.411769 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184508e3-3d6c-4ace-9d36-7a06b25eb5f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:19.414120 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-184508e3-3d6c-4ace-9d36-7a06b25eb5f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:19.477677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:19.544691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184508e3-3d6c-4ace-9d36-7a06b25eb5f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:26:19.546652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184508e3-3d6c-4ace-9d36-7a06b25eb5f4 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:26:19.569938 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 674/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:26:22.106780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047331b-dd95-48f4-b0ca-a40881b88a69 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:22.107313 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047331b-dd95-48f4-b0ca-a40881b88a69 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:22.107406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047331b-dd95-48f4-b0ca-a40881b88a69 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:22.108758 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 638/1312] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:22.114561 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2069ef-6d68-49a6-88eb-b9749684a527 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:22.114963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2069ef-6d68-49a6-88eb-b9749684a527 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:22.115103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2069ef-6d68-49a6-88eb-b9749684a527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:22.197428 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-db2069ef-6d68-49a6-88eb-b9749684a527 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:22.198652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-db2069ef-6d68-49a6-88eb-b9749684a527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:22.303982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 675/1313] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:26:22.342716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047331b-dd95-48f4-b0ca-a40881b88a69 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:26:22.344297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6047331b-dd95-48f4-b0ca-a40881b88a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:22.449827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047331b-dd95-48f4-b0ca-a40881b88a69 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:26:22.520229 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:22.524190 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7316056-d5cc-40d1-8f79-3440c4fc1d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:26:22.524894 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7316056-d5cc-40d1-8f79-3440c4fc1d26 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:22.525356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7316056-d5cc-40d1-8f79-3440c4fc1d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:22.525803 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7316056-d5cc-40d1-8f79-3440c4fc1d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:22.527686 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a7316056-d5cc-40d1-8f79-3440c4fc1d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:22.641626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7316056-d5cc-40d1-8f79-3440c4fc1d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:26:22.643072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7316056-d5cc-40d1-8f79-3440c4fc1d26 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:26:22.662083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 639/1314] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:26:25.073964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f3f31-a161-4d1a-8862-5bc3da103afc None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:25.074476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f3f31-a161-4d1a-8862-5bc3da103afc None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:25.074476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f3f31-a161-4d1a-8862-5bc3da103afc None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:25.075863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 676/1315] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:25.080850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebbd08-f14f-4567-9366-d2579faa494e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:25.081257 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebbd08-f14f-4567-9366-d2579faa494e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:25.081433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebbd08-f14f-4567-9366-d2579faa494e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:25.145616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-baebbd08-f14f-4567-9366-d2579faa494e None None] MFA Rules not processed for user `e524aa79ee4a4cec95734314eb804eae`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:25.146813 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-baebbd08-f14f-4567-9366-d2579faa494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:25.197653 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:25.241329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 640/1316] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:26:25.295490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae5679-6269-4f79-902d-3b902e54d5de None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:25.295788 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae5679-6269-4f79-902d-3b902e54d5de None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:25.296064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae5679-6269-4f79-902d-3b902e54d5de None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:25.297432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 677/1317] 10.222.0.50 () {54 vars in 964 bytes} [Wed Jun 15 10:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:25.303905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538f55b-99cd-458f-b960-a19cc7b28c5f None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:25.304193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538f55b-99cd-458f-b960-a19cc7b28c5f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:25.304475 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538f55b-99cd-458f-b960-a19cc7b28c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:25.376622 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-3538f55b-99cd-458f-b960-a19cc7b28c5f None None] MFA Rules not processed for user `5f2e2038f69f49019a1e528107296223`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:25.377823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-3538f55b-99cd-458f-b960-a19cc7b28c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:25.454755 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 641/1318] 10.222.0.50 () {58 vars in 1061 bytes} [Wed Jun 15 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:26:25.464041 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae5679-6269-4f79-902d-3b902e54d5de None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:26:25.465718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dbae5679-6269-4f79-902d-3b902e54d5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:25.475292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:25.568855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae5679-6269-4f79-902d-3b902e54d5de None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:26:25.643052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbdec5-0c2b-4126-8ac2-0beced80b1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:26:25.643625 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbdec5-0c2b-4126-8ac2-0beced80b1df service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:25.643942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbdec5-0c2b-4126-8ac2-0beced80b1df service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:25.644754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbdec5-0c2b-4126-8ac2-0beced80b1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:25.646419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-62cbdec5-0c2b-4126-8ac2-0beced80b1df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:25.707621 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:25.754210 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbdec5-0c2b-4126-8ac2-0beced80b1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:26:25.755663 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbdec5-0c2b-4126-8ac2-0beced80b1df service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:26:25.773793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 678/1319] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:26:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:26:28.809167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab82a0-0229-4357-9ca0-26b5cec01318 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:28.809692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab82a0-0229-4357-9ca0-26b5cec01318 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:28.809812 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab82a0-0229-4357-9ca0-26b5cec01318 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:28.811096 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 642/1320] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:28.816863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7e4f3-3b9f-4586-8c2f-fd153f1c3b78 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:28.817295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7e4f3-3b9f-4586-8c2f-fd153f1c3b78 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:28.817455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7e4f3-3b9f-4586-8c2f-fd153f1c3b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:28.882459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e6d7e4f3-3b9f-4586-8c2f-fd153f1c3b78 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:28.883622 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e6d7e4f3-3b9f-4586-8c2f-fd153f1c3b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:28.992019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 679/1321] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:26:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:26:29.030843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab82a0-0229-4357-9ca0-26b5cec01318 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:26:29.032789 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d8ab82a0-0229-4357-9ca0-26b5cec01318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:29.083015 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:29.137172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab82a0-0229-4357-9ca0-26b5cec01318 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:26:29.207201 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648dfad-f7a9-4c05-a69d-99d378d0f663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:26:29.207862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648dfad-f7a9-4c05-a69d-99d378d0f663 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:29.208142 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648dfad-f7a9-4c05-a69d-99d378d0f663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:29.208412 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648dfad-f7a9-4c05-a69d-99d378d0f663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:29.210033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f648dfad-f7a9-4c05-a69d-99d378d0f663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:29.305419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:29.319094 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648dfad-f7a9-4c05-a69d-99d378d0f663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:26:29.320568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648dfad-f7a9-4c05-a69d-99d378d0f663 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:26:29.338460 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 643/1322] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:26:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:26:32.134854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb02d8-a9bd-4e35-bbb3-d75dc93d20dc None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:32.135459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb02d8-a9bd-4e35-bbb3-d75dc93d20dc None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:32.135459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb02d8-a9bd-4e35-bbb3-d75dc93d20dc None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:32.136830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 680/1323] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:32.141989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4249a2-66a2-46c6-99ca-a106c28834c2 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:32.142672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4249a2-66a2-46c6-99ca-a106c28834c2 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:32.142950 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4249a2-66a2-46c6-99ca-a106c28834c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:32.214788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8a4249a2-66a2-46c6-99ca-a106c28834c2 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:32.216049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8a4249a2-66a2-46c6-99ca-a106c28834c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:32.319667 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 644/1324] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:26:32.355060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb02d8-a9bd-4e35-bbb3-d75dc93d20dc None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:26:32.356715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-57eb02d8-a9bd-4e35-bbb3-d75dc93d20dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:32.378156 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:32.464818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb02d8-a9bd-4e35-bbb3-d75dc93d20dc None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:26:32.539270 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fe145-055c-4134-8d7b-7f51e397b8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:26:32.539947 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fe145-055c-4134-8d7b-7f51e397b8fe service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:32.540219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fe145-055c-4134-8d7b-7f51e397b8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:32.540490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fe145-055c-4134-8d7b-7f51e397b8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:32.542170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-038fe145-055c-4134-8d7b-7f51e397b8fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:32.617158 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:32.657019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fe145-055c-4134-8d7b-7f51e397b8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:26:32.658454 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fe145-055c-4134-8d7b-7f51e397b8fe service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:26:32.679056 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 681/1325] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:26:34.867491 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fdad-afb3-474f-b79e-856121e78e90 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:34.868055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fdad-afb3-474f-b79e-856121e78e90 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:34.868055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fdad-afb3-474f-b79e-856121e78e90 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:34.869457 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 645/1326] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:34.874868 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463428b0-eef3-4cb0-9313-03b18596c6bc None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:34.875257 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463428b0-eef3-4cb0-9313-03b18596c6bc None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:34.875428 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463428b0-eef3-4cb0-9313-03b18596c6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:34.939490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-463428b0-eef3-4cb0-9313-03b18596c6bc None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:34.941294 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-463428b0-eef3-4cb0-9313-03b18596c6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:35.038063 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 682/1327] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:26:35.073434 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73fdad-afb3-474f-b79e-856121e78e90 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:26:35.075055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ad73fdad-afb3-474f-b79e-856121e78e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:35.136958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:35.190062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73fdad-afb3-474f-b79e-856121e78e90 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:26:35.266843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32999ebf-fdeb-425d-ba80-a52d5bdef946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:26:35.267508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32999ebf-fdeb-425d-ba80-a52d5bdef946 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:35.267792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32999ebf-fdeb-425d-ba80-a52d5bdef946 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:35.268065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32999ebf-fdeb-425d-ba80-a52d5bdef946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:35.269731 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-32999ebf-fdeb-425d-ba80-a52d5bdef946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:35.392548 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:35.395176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32999ebf-fdeb-425d-ba80-a52d5bdef946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:26:35.397197 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32999ebf-fdeb-425d-ba80-a52d5bdef946 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:26:35.419516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 646/1328] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:26:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:26:37.595274 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac6dd5-b274-41c2-9d65-7afa28c529a2 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:37.595840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac6dd5-b274-41c2-9d65-7afa28c529a2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:37.595840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac6dd5-b274-41c2-9d65-7afa28c529a2 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:37.597751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 683/1329] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:37.602904 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcccfc6-50c1-457d-ac1a-60032af2b9ed None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:37.603335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcccfc6-50c1-457d-ac1a-60032af2b9ed None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:37.603489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcccfc6-50c1-457d-ac1a-60032af2b9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:37.670001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-3dcccfc6-50c1-457d-ac1a-60032af2b9ed None None] MFA Rules not processed for user `e524aa79ee4a4cec95734314eb804eae`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:37.671211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-3dcccfc6-50c1-457d-ac1a-60032af2b9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:37.769383 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 647/1330] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:26:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:26:37.811284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac6dd5-b274-41c2-9d65-7afa28c529a2 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:26:37.812844 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9eac6dd5-b274-41c2-9d65-7afa28c529a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:37.842628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:37.947319 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac6dd5-b274-41c2-9d65-7afa28c529a2 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:26:38.035966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b8b42-580b-4fb0-8da5-1a5c9976cffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:26:38.036615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b8b42-580b-4fb0-8da5-1a5c9976cffa service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:38.036896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b8b42-580b-4fb0-8da5-1a5c9976cffa service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:38.037169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b8b42-580b-4fb0-8da5-1a5c9976cffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:38.038825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f36b8b42-580b-4fb0-8da5-1a5c9976cffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:38.129762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:38.166691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b8b42-580b-4fb0-8da5-1a5c9976cffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:26:38.168180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36b8b42-580b-4fb0-8da5-1a5c9976cffa service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:26:38.189120 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 684/1331] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:26:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:26:40.647241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538bf4e-095a-44db-b83b-efcc90909dc5 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:40.647706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538bf4e-095a-44db-b83b-efcc90909dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:40.647853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538bf4e-095a-44db-b83b-efcc90909dc5 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:40.649126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 648/1332] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:40.654467 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97a0ea-c6ee-4c46-b44b-cb400fd9fc31 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:40.654930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97a0ea-c6ee-4c46-b44b-cb400fd9fc31 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:40.655026 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97a0ea-c6ee-4c46-b44b-cb400fd9fc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:40.724108 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3f97a0ea-c6ee-4c46-b44b-cb400fd9fc31 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:40.725556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3f97a0ea-c6ee-4c46-b44b-cb400fd9fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:40.824155 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 685/1333] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:26:40.861962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538bf4e-095a-44db-b83b-efcc90909dc5 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:26:40.864219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a538bf4e-095a-44db-b83b-efcc90909dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:40.931935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:40.964977 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538bf4e-095a-44db-b83b-efcc90909dc5 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:26:41.038343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe2940-5df7-470b-9bf5-fda85fd10b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:26:41.038987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe2940-5df7-470b-9bf5-fda85fd10b47 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:41.039271 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe2940-5df7-470b-9bf5-fda85fd10b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:41.039575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe2940-5df7-470b-9bf5-fda85fd10b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:41.041235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-97fe2940-5df7-470b-9bf5-fda85fd10b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:41.149630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe2940-5df7-470b-9bf5-fda85fd10b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:26:41.151060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe2940-5df7-470b-9bf5-fda85fd10b47 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:26:41.161542 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:41.170055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 649/1334] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:26:43.328783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555e66c-7f7b-4c99-94bd-2108172e4869 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:43.329326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555e66c-7f7b-4c99-94bd-2108172e4869 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:43.329326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555e66c-7f7b-4c99-94bd-2108172e4869 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:43.330700 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 686/1335] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:43.336304 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb4a66-d051-4b2c-94d3-7863b636b722 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:43.336720 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb4a66-d051-4b2c-94d3-7863b636b722 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:43.336861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb4a66-d051-4b2c-94d3-7863b636b722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:43.402936 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-36fb4a66-d051-4b2c-94d3-7863b636b722 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:43.404199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-36fb4a66-d051-4b2c-94d3-7863b636b722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:43.501662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 650/1336] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:26:43.541562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555e66c-7f7b-4c99-94bd-2108172e4869 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:26:43.543125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4555e66c-7f7b-4c99-94bd-2108172e4869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:43.583141 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:43.648572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555e66c-7f7b-4c99-94bd-2108172e4869 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:26:43.722689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a710ec3-ad94-4128-aeba-2c41c74ce18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:26:43.723332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a710ec3-ad94-4128-aeba-2c41c74ce18a service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:43.723649 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a710ec3-ad94-4128-aeba-2c41c74ce18a service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:43.723925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a710ec3-ad94-4128-aeba-2c41c74ce18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:43.725679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2a710ec3-ad94-4128-aeba-2c41c74ce18a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:43.808891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:43.837569 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a710ec3-ad94-4128-aeba-2c41c74ce18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:26:43.839003 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a710ec3-ad94-4128-aeba-2c41c74ce18a service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:26:43.858222 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 687/1337] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:26:46.311253 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff94da5-6ebd-4fac-81b6-6d80e2dff557 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:46.311825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff94da5-6ebd-4fac-81b6-6d80e2dff557 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:46.311825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff94da5-6ebd-4fac-81b6-6d80e2dff557 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:46.313199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 651/1338] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:46.318904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ba0fb-f972-45f0-acd6-0fe5a7c7faf3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:46.319304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ba0fb-f972-45f0-acd6-0fe5a7c7faf3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:46.319449 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ba0fb-f972-45f0-acd6-0fe5a7c7faf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:46.381875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-367ba0fb-f972-45f0-acd6-0fe5a7c7faf3 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:46.383076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-367ba0fb-f972-45f0-acd6-0fe5a7c7faf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:46.482666 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 688/1339] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:26:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:26:46.519849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff94da5-6ebd-4fac-81b6-6d80e2dff557 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:26:46.521360 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-2ff94da5-6ebd-4fac-81b6-6d80e2dff557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:46.594669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:46.623547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff94da5-6ebd-4fac-81b6-6d80e2dff557 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:26:46.697112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff199fa3-d660-43d0-b8ab-e092941a6a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:26:46.697765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff199fa3-d660-43d0-b8ab-e092941a6a85 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:46.698048 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff199fa3-d660-43d0-b8ab-e092941a6a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:46.698324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff199fa3-d660-43d0-b8ab-e092941a6a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:46.700047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ff199fa3-d660-43d0-b8ab-e092941a6a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:46.811475 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff199fa3-d660-43d0-b8ab-e092941a6a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:26:46.812946 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff199fa3-d660-43d0-b8ab-e092941a6a85 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:26:46.830813 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 652/1340] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:26:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:26:50.913341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462691-79b7-4160-b8e7-cc97da177df1 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:50.913897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462691-79b7-4160-b8e7-cc97da177df1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:50.913897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4462691-79b7-4160-b8e7-cc97da177df1 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:50.915283 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 689/1341] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:50.920682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3a3e0-b5d4-476c-991c-f23e2f22a3df None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:50.921384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3a3e0-b5d4-476c-991c-f23e2f22a3df None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:50.921384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3a3e0-b5d4-476c-991c-f23e2f22a3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:50.929560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:51.002199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-4db3a3e0-b5d4-476c-991c-f23e2f22a3df None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:51.003998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4db3a3e0-b5d4-476c-991c-f23e2f22a3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:51.109572 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 653/1342] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:26:51.149053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4462691-79b7-4160-b8e7-cc97da177df1 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:26:51.151281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f4462691-79b7-4160-b8e7-cc97da177df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:51.202079 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:26:51.250470 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4462691-79b7-4160-b8e7-cc97da177df1 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:26:51.254137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2e897-5a48-492d-95cb-ab23d19407cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:26:51.254774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2e897-5a48-492d-95cb-ab23d19407cd service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:51.255376 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2e897-5a48-492d-95cb-ab23d19407cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:51.255688 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2e897-5a48-492d-95cb-ab23d19407cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:51.265422 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2e897-5a48-492d-95cb-ab23d19407cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:26:51.266844 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2e897-5a48-492d-95cb-ab23d19407cd service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:26:51.277014 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 690/1343] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:26:54.039495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c8c0-c22e-41b8-9329-732fbc6f0b1b None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:54.040007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c8c0-c22e-41b8-9329-732fbc6f0b1b None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:54.040007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332c8c0-c22e-41b8-9329-732fbc6f0b1b None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:54.041502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 654/1344] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:54.046590 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f519-fb84-4981-a142-e899bdeaba28 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:54.047048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f519-fb84-4981-a142-e899bdeaba28 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:54.047223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704f519-fb84-4981-a142-e899bdeaba28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:54.078243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a704f519-fb84-4981-a142-e899bdeaba28 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:54.079781 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a704f519-fb84-4981-a142-e899bdeaba28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:54.166536 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 691/1345] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:26:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:26:54.204123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332c8c0-c22e-41b8-9329-732fbc6f0b1b None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:26:54.215205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332c8c0-c22e-41b8-9329-732fbc6f0b1b None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:26:54.218727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed57f84-2356-4885-82c5-5b19b2229003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:26:54.219390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed57f84-2356-4885-82c5-5b19b2229003 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:54.219707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed57f84-2356-4885-82c5-5b19b2229003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:54.219978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed57f84-2356-4885-82c5-5b19b2229003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:54.230390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed57f84-2356-4885-82c5-5b19b2229003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:26:54.231851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed57f84-2356-4885-82c5-5b19b2229003 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:26:54.242270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 655/1346] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:26:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:26:58.288668 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef1ecc-dd12-4b6b-96f1-f82710dbc389 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:58.289130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef1ecc-dd12-4b6b-96f1-f82710dbc389 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:58.289364 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef1ecc-dd12-4b6b-96f1-f82710dbc389 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:58.290809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 692/1347] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:26:58.296303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802236c2-4471-4960-bc6b-4b3e3474c878 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:58.296738 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802236c2-4471-4960-bc6b-4b3e3474c878 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:58.296857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802236c2-4471-4960-bc6b-4b3e3474c878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:58.314644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-802236c2-4471-4960-bc6b-4b3e3474c878 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:26:58.316439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-802236c2-4471-4960-bc6b-4b3e3474c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:26:58.324475 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 656/1348] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:26:58.361819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef1ecc-dd12-4b6b-96f1-f82710dbc389 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:26:58.374106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef1ecc-dd12-4b6b-96f1-f82710dbc389 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:26:58.378271 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212e99f-ed3c-4778-b569-d6894631fcd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:26:58.379171 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212e99f-ed3c-4778-b569-d6894631fcd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:26:58.379477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212e99f-ed3c-4778-b569-d6894631fcd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:26:58.379772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212e99f-ed3c-4778-b569-d6894631fcd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:26:58.389408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212e99f-ed3c-4778-b569-d6894631fcd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:26:58.390978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212e99f-ed3c-4778-b569-d6894631fcd2 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:26:58.400806 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 693/1349] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:03.501185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24178e6-47c2-4620-ad4a-eb90551124d1 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:03.501726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24178e6-47c2-4620-ad4a-eb90551124d1 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:03.505795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24178e6-47c2-4620-ad4a-eb90551124d1 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:03.507978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 657/1350] 10.222.0.50 () {54 vars in 921 bytes} [Wed Jun 15 10:27:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:03.513118 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6403252-057d-480a-aa77-2ba59f3d94bd None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:03.513589 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6403252-057d-480a-aa77-2ba59f3d94bd None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:03.513589 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6403252-057d-480a-aa77-2ba59f3d94bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:03.610094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c6403252-057d-480a-aa77-2ba59f3d94bd None None] MFA Rules not processed for user `2729cb0b9adb44f7ba5c968b6158a93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:03.611755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c6403252-057d-480a-aa77-2ba59f3d94bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:03.642568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:03.710894 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 694/1351] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Jun 15 10:27:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:07.954778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a58b-bc06-4538-bb21-e911c0f2bd76 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:07.955274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a58b-bc06-4538-bb21-e911c0f2bd76 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:07.955274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a58b-bc06-4538-bb21-e911c0f2bd76 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:07.957029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 658/1352] 10.222.0.50 () {54 vars in 921 bytes} [Wed Jun 15 10:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:07.961952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697e212-135b-4308-91c5-c8e195d7cb8a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:07.962434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697e212-135b-4308-91c5-c8e195d7cb8a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:07.962543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697e212-135b-4308-91c5-c8e195d7cb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:07.982429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8697e212-135b-4308-91c5-c8e195d7cb8a None None] MFA Rules not processed for user `2729cb0b9adb44f7ba5c968b6158a93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:07.983657 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8697e212-135b-4308-91c5-c8e195d7cb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:07.993900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 695/1353] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Jun 15 10:27:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:08.309530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=72 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:09.497964 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53e713-7ad8-4c3a-a099-e0248c3364ea None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:09.498612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53e713-7ad8-4c3a-a099-e0248c3364ea None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:09.498612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53e713-7ad8-4c3a-a099-e0248c3364ea None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:09.499910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 659/1354] 10.222.0.50 () {54 vars in 921 bytes} [Wed Jun 15 10:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:09.505447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a1a8-2055-4017-bd9a-23de163e7dc7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:09.505993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a1a8-2055-4017-bd9a-23de163e7dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:09.505993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a1a8-2055-4017-bd9a-23de163e7dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:09.523781 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5778a1a8-2055-4017-bd9a-23de163e7dc7 None None] MFA Rules not processed for user `2729cb0b9adb44f7ba5c968b6158a93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:09.524945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5778a1a8-2055-4017-bd9a-23de163e7dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:09.533313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 696/1355] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Jun 15 10:27:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:27:13.291599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3373e1-05e0-4098-b67a-17cd596aeb57 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:13.292105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3373e1-05e0-4098-b67a-17cd596aeb57 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:13.292105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3373e1-05e0-4098-b67a-17cd596aeb57 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:13.293579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 660/1356] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:13.301350 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729188e-dbef-4687-a2be-a26b24b4e073 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:13.302162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729188e-dbef-4687-a2be-a26b24b4e073 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:13.302454 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729188e-dbef-4687-a2be-a26b24b4e073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:13.320573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3729188e-dbef-4687-a2be-a26b24b4e073 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:13.321808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3729188e-dbef-4687-a2be-a26b24b4e073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:13.329932 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 697/1357] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:13.387321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d24a0f-4fe0-43c0-b125-027ccf9a275a None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:13.388099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d24a0f-4fe0-43c0-b125-027ccf9a275a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:13.388592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d24a0f-4fe0-43c0-b125-027ccf9a275a None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:13.390714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 661/1358] 10.222.0.50 () {54 vars in 961 bytes} [Wed Jun 15 10:27:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:13.401722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f86e3-9807-4c02-a24a-6ae8de1d46bf None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:13.402345 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f86e3-9807-4c02-a24a-6ae8de1d46bf None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:13.402714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f86e3-9807-4c02-a24a-6ae8de1d46bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:13.454877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b40f86e3-9807-4c02-a24a-6ae8de1d46bf None None] MFA Rules not processed for user `81e9805ec4c44cedb658b7becf768369`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:13.456244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b40f86e3-9807-4c02-a24a-6ae8de1d46bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:13.545608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 698/1359] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Jun 15 10:27:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:13.554477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d24a0f-4fe0-43c0-b125-027ccf9a275a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:13.570057 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d24a0f-4fe0-43c0-b125-027ccf9a275a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:13.575901 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8bf0e-5b92-49cc-992a-799e27269abc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:13.576549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8bf0e-5b92-49cc-992a-799e27269abc service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:13.576897 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8bf0e-5b92-49cc-992a-799e27269abc service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:13.577270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8bf0e-5b92-49cc-992a-799e27269abc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:13.586431 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8bf0e-5b92-49cc-992a-799e27269abc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:13.588187 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8bf0e-5b92-49cc-992a-799e27269abc service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:13.609095 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 662/1360] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:15.993593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c606c-7433-4b6e-aab2-da94aa0add4a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:15.994124 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c606c-7433-4b6e-aab2-da94aa0add4a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:15.994124 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c606c-7433-4b6e-aab2-da94aa0add4a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:15.995735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 699/1361] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:16.001631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499b07f-774d-4ece-9a3e-3bf0430e05ba None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:16.002330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499b07f-774d-4ece-9a3e-3bf0430e05ba None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:16.002330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499b07f-774d-4ece-9a3e-3bf0430e05ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:16.021598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8499b07f-774d-4ece-9a3e-3bf0430e05ba None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:16.022861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8499b07f-774d-4ece-9a3e-3bf0430e05ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:16.034596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 663/1362] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:16.084004 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c606c-7433-4b6e-aab2-da94aa0add4a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:16.100873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c606c-7433-4b6e-aab2-da94aa0add4a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:16.106632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e6f5a-fb9a-42bc-b251-49b4991a825c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:16.107487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e6f5a-fb9a-42bc-b251-49b4991a825c service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:16.107926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e6f5a-fb9a-42bc-b251-49b4991a825c service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:16.108196 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e6f5a-fb9a-42bc-b251-49b4991a825c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:16.121396 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e6f5a-fb9a-42bc-b251-49b4991a825c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:16.123752 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e6f5a-fb9a-42bc-b251-49b4991a825c service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:16.135418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 700/1363] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:18.625539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb9982-81a5-4dde-8fa6-4dfd9f3307d8 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:18.626128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb9982-81a5-4dde-8fa6-4dfd9f3307d8 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:18.626128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb9982-81a5-4dde-8fa6-4dfd9f3307d8 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:18.627685 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 664/1364] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:18.633234 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10e5f1-3979-4ccb-b6a5-25269d218e3f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:18.633691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10e5f1-3979-4ccb-b6a5-25269d218e3f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:18.633816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10e5f1-3979-4ccb-b6a5-25269d218e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:18.659172 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3c10e5f1-3979-4ccb-b6a5-25269d218e3f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:18.660431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3c10e5f1-3979-4ccb-b6a5-25269d218e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:18.673618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 701/1365] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:18.714263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754bb25-6bae-495b-aaa6-0a8c4aac204d None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:18.714551 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754bb25-6bae-495b-aaa6-0a8c4aac204d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:18.714827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754bb25-6bae-495b-aaa6-0a8c4aac204d None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:18.716219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 665/1366] 10.222.0.50 () {54 vars in 961 bytes} [Wed Jun 15 10:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:18.721942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59b0f-a81b-49ae-ad58-d33dcead0aab None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:18.722235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59b0f-a81b-49ae-ad58-d33dcead0aab None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:18.722518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59b0f-a81b-49ae-ad58-d33dcead0aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:18.742437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d7e59b0f-a81b-49ae-ad58-d33dcead0aab None None] MFA Rules not processed for user `81e9805ec4c44cedb658b7becf768369`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:18.743854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d7e59b0f-a81b-49ae-ad58-d33dcead0aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:18.755945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 702/1367] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Jun 15 10:27:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:27:18.769082 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754bb25-6bae-495b-aaa6-0a8c4aac204d None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:18.783219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754bb25-6bae-495b-aaa6-0a8c4aac204d None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:18.789570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c6f5f-7673-48d9-96b4-38a6597e53a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:18.790170 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c6f5f-7673-48d9-96b4-38a6597e53a5 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:18.790628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c6f5f-7673-48d9-96b4-38a6597e53a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:18.791075 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c6f5f-7673-48d9-96b4-38a6597e53a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:18.799447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c6f5f-7673-48d9-96b4-38a6597e53a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:18.801045 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c6f5f-7673-48d9-96b4-38a6597e53a5 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:18.810641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 666/1368] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:21.060503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea11e6-adec-4c33-8b00-9cdb94c20d31 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:21.061060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea11e6-adec-4c33-8b00-9cdb94c20d31 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:21.061060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea11e6-adec-4c33-8b00-9cdb94c20d31 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:21.062432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 703/1369] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:21.068471 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2042f-1c29-4f17-9a21-766c810062f9 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:21.068918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2042f-1c29-4f17-9a21-766c810062f9 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:21.069287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2042f-1c29-4f17-9a21-766c810062f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:21.087951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-54f2042f-1c29-4f17-9a21-766c810062f9 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:21.089368 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-54f2042f-1c29-4f17-9a21-766c810062f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:21.098179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 667/1370] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:21.142690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea11e6-adec-4c33-8b00-9cdb94c20d31 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:21.158150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea11e6-adec-4c33-8b00-9cdb94c20d31 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:21.165118 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad51944-a36f-4cae-867f-f2764b4306a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:21.165895 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad51944-a36f-4cae-867f-f2764b4306a8 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:21.166272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad51944-a36f-4cae-867f-f2764b4306a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:21.166647 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad51944-a36f-4cae-867f-f2764b4306a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:21.176473 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad51944-a36f-4cae-867f-f2764b4306a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:21.178194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad51944-a36f-4cae-867f-f2764b4306a8 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:21.188793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 704/1371] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:21.530333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab348e-1ce9-43b3-8fd2-fdb4d02c981b None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:21.530691 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab348e-1ce9-43b3-8fd2-fdb4d02c981b None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:21.531381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab348e-1ce9-43b3-8fd2-fdb4d02c981b None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:21.533262 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 668/1372] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:27:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:21.541044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545b34a-4d59-4776-929f-7e8693332d94 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:21.542337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545b34a-4d59-4776-929f-7e8693332d94 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:21.542848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545b34a-4d59-4776-929f-7e8693332d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:21.563216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4545b34a-4d59-4776-929f-7e8693332d94 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:21.564527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4545b34a-4d59-4776-929f-7e8693332d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:21.573450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 705/1373] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:21.854456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755e285-9bd3-4032-aab3-f8b8131b7d33 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:21.855039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755e285-9bd3-4032-aab3-f8b8131b7d33 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:21.855569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755e285-9bd3-4032-aab3-f8b8131b7d33 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:21.857050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 669/1374] 10.222.0.50 () {54 vars in 963 bytes} [Wed Jun 15 10:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:21.862628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859456-24d9-4119-b214-9271b26573f6 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:21.863135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859456-24d9-4119-b214-9271b26573f6 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:21.863527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13859456-24d9-4119-b214-9271b26573f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:21.870525 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:21.913746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-13859456-24d9-4119-b214-9271b26573f6 None None] MFA Rules not processed for user `383ef65dd6b14810a7a2a8e06143eca2`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:21.915145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-13859456-24d9-4119-b214-9271b26573f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:21.977735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 706/1375] 10.222.0.50 () {58 vars in 1060 bytes} [Wed Jun 15 10:27:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:21.985178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755e285-9bd3-4032-aab3-f8b8131b7d33 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:21.996947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755e285-9bd3-4032-aab3-f8b8131b7d33 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:22.000573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9949b9-ccf3-4518-89c8-b530278e857c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:22.001318 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9949b9-ccf3-4518-89c8-b530278e857c service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:22.001704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9949b9-ccf3-4518-89c8-b530278e857c service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:22.002074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9949b9-ccf3-4518-89c8-b530278e857c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:22.012077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9949b9-ccf3-4518-89c8-b530278e857c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:22.013643 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9949b9-ccf3-4518-89c8-b530278e857c service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:22.023901 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 670/1376] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:23.420164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f90a-73c8-4be3-a737-d3c27f69f4db None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:23.420716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f90a-73c8-4be3-a737-d3c27f69f4db None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:23.420716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f90a-73c8-4be3-a737-d3c27f69f4db None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:23.422081 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 707/1377] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:23.427919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fea3d5-5f47-48f2-97e4-a17b75787b53 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:23.428359 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fea3d5-5f47-48f2-97e4-a17b75787b53 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:23.428475 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fea3d5-5f47-48f2-97e4-a17b75787b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:23.446825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-42fea3d5-5f47-48f2-97e4-a17b75787b53 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:23.448170 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-42fea3d5-5f47-48f2-97e4-a17b75787b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:23.456130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 671/1378] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:23.501053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3f90a-73c8-4be3-a737-d3c27f69f4db None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:23.515953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3f90a-73c8-4be3-a737-d3c27f69f4db None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:23.522027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5cb6d-6dbe-4515-b180-9cdbc7a06ef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:23.522711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5cb6d-6dbe-4515-b180-9cdbc7a06ef9 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:23.522998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5cb6d-6dbe-4515-b180-9cdbc7a06ef9 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:23.523279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5cb6d-6dbe-4515-b180-9cdbc7a06ef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:23.532895 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5cb6d-6dbe-4515-b180-9cdbc7a06ef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:23.535107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5cb6d-6dbe-4515-b180-9cdbc7a06ef9 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:23.546101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 708/1379] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:25.747730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b9542-cde1-490d-a5ee-60183ae74f84 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:25.748268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b9542-cde1-490d-a5ee-60183ae74f84 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:25.748389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b9542-cde1-490d-a5ee-60183ae74f84 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:25.749674 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 672/1380] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:25.755566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418041d-2998-4943-b6de-3225644c7bc4 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:25.756378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418041d-2998-4943-b6de-3225644c7bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:25.756830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418041d-2998-4943-b6de-3225644c7bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:25.777127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a418041d-2998-4943-b6de-3225644c7bc4 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:25.778343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a418041d-2998-4943-b6de-3225644c7bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:25.790254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 709/1381] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:25.838440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b9542-cde1-490d-a5ee-60183ae74f84 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:25.856021 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b9542-cde1-490d-a5ee-60183ae74f84 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:25.861807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1908a6-a06e-40c2-b6ca-e21b804c1337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:25.862610 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1908a6-a06e-40c2-b6ca-e21b804c1337 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:25.862995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1908a6-a06e-40c2-b6ca-e21b804c1337 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:25.863380 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1908a6-a06e-40c2-b6ca-e21b804c1337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:25.872889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1908a6-a06e-40c2-b6ca-e21b804c1337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:25.874735 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1908a6-a06e-40c2-b6ca-e21b804c1337 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:25.886047 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 673/1382] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:28.063006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6b070-366d-40a2-8098-07fd05b6823c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:28.063497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6b070-366d-40a2-8098-07fd05b6823c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:28.063681 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6b070-366d-40a2-8098-07fd05b6823c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:28.065491 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 710/1383] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:28.071085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f5bc8-47c8-469d-a040-5b02b12abff7 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:28.071589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f5bc8-47c8-469d-a040-5b02b12abff7 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:28.071722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f5bc8-47c8-469d-a040-5b02b12abff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:28.089664 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-5a6f5bc8-47c8-469d-a040-5b02b12abff7 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:28.090862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-5a6f5bc8-47c8-469d-a040-5b02b12abff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:28.099640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 674/1384] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:28.141873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6b070-366d-40a2-8098-07fd05b6823c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:28.156966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6b070-366d-40a2-8098-07fd05b6823c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:28.163006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9674b60-ac45-4c9f-937f-9050da0f7ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:28.163750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9674b60-ac45-4c9f-937f-9050da0f7ea2 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:28.164094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9674b60-ac45-4c9f-937f-9050da0f7ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:28.164436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9674b60-ac45-4c9f-937f-9050da0f7ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:28.174825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9674b60-ac45-4c9f-937f-9050da0f7ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:28.176483 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9674b60-ac45-4c9f-937f-9050da0f7ea2 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:28.186724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 711/1385] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:30.338991 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0472a08-e2bc-413d-8057-6b3a75573936 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:30.339680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0472a08-e2bc-413d-8057-6b3a75573936 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:30.339680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0472a08-e2bc-413d-8057-6b3a75573936 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:30.340953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 675/1386] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:30.347114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed643e4d-0f44-4ba7-a5ca-f64776f3aae0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:30.347596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed643e4d-0f44-4ba7-a5ca-f64776f3aae0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:30.347883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed643e4d-0f44-4ba7-a5ca-f64776f3aae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:30.380211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ed643e4d-0f44-4ba7-a5ca-f64776f3aae0 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:30.381907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ed643e4d-0f44-4ba7-a5ca-f64776f3aae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:30.393101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 712/1387] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:30.448590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0472a08-e2bc-413d-8057-6b3a75573936 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:30.463683 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0472a08-e2bc-413d-8057-6b3a75573936 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:30.469338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3b6f4-8c4a-4db9-8a3a-9d289665124c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:30.469980 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3b6f4-8c4a-4db9-8a3a-9d289665124c service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:30.470263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3b6f4-8c4a-4db9-8a3a-9d289665124c service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:30.470538 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3b6f4-8c4a-4db9-8a3a-9d289665124c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:30.479970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3b6f4-8c4a-4db9-8a3a-9d289665124c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:30.481553 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3b6f4-8c4a-4db9-8a3a-9d289665124c service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:30.491772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 676/1388] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:32.684485 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c724a-6b39-44af-adf0-b398329fbd87 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:32.685283 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c724a-6b39-44af-adf0-b398329fbd87 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:32.685562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c724a-6b39-44af-adf0-b398329fbd87 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:32.687127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 713/1389] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:32.693124 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833ef5d-22be-460f-9669-2c7a86769134 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:32.694049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833ef5d-22be-460f-9669-2c7a86769134 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:32.694049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833ef5d-22be-460f-9669-2c7a86769134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:32.714636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-5833ef5d-22be-460f-9669-2c7a86769134 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:32.715942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-5833ef5d-22be-460f-9669-2c7a86769134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:32.724055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 677/1390] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:32.774680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c724a-6b39-44af-adf0-b398329fbd87 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:32.789173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c724a-6b39-44af-adf0-b398329fbd87 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:32.794631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23184b5-c045-41c9-9e04-365291fa5675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:32.795279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23184b5-c045-41c9-9e04-365291fa5675 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:32.795570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23184b5-c045-41c9-9e04-365291fa5675 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:32.795844 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23184b5-c045-41c9-9e04-365291fa5675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:32.805170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23184b5-c045-41c9-9e04-365291fa5675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:32.806782 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23184b5-c045-41c9-9e04-365291fa5675 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:32.816920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 714/1391] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:27:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:34.977570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56fb99-bf57-4b40-9367-ac8354af4b12 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:34.978086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56fb99-bf57-4b40-9367-ac8354af4b12 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:34.978086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56fb99-bf57-4b40-9367-ac8354af4b12 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:34.979504 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 678/1392] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:27:34.985924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfbf91-13c5-45bf-90d5-8fbd0b1a48ac None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:34.986949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfbf91-13c5-45bf-90d5-8fbd0b1a48ac None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:34.986949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfbf91-13c5-45bf-90d5-8fbd0b1a48ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:35.005418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c1dfbf91-13c5-45bf-90d5-8fbd0b1a48ac None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:35.006638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c1dfbf91-13c5-45bf-90d5-8fbd0b1a48ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:35.014940 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 715/1393] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:35.070516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56fb99-bf57-4b40-9367-ac8354af4b12 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:35.086486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56fb99-bf57-4b40-9367-ac8354af4b12 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:35.093107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9d992-a3f3-4427-9b54-49df2b939c5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:35.093885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9d992-a3f3-4427-9b54-49df2b939c5c service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:35.094239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9d992-a3f3-4427-9b54-49df2b939c5c service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:35.094592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9d992-a3f3-4427-9b54-49df2b939c5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:35.105207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9d992-a3f3-4427-9b54-49df2b939c5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:35.107295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9d992-a3f3-4427-9b54-49df2b939c5c service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:35.120505 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 679/1394] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:37.297293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b19670-5a80-43fe-8143-eaed62050174 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:37.297882 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b19670-5a80-43fe-8143-eaed62050174 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:37.297882 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b19670-5a80-43fe-8143-eaed62050174 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:37.299805 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 716/1395] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:37.305649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079788e1-fcd6-43f8-ae94-c81467735938 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:37.306136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079788e1-fcd6-43f8-ae94-c81467735938 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:37.306242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079788e1-fcd6-43f8-ae94-c81467735938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:37.324441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-079788e1-fcd6-43f8-ae94-c81467735938 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:37.325637 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-079788e1-fcd6-43f8-ae94-c81467735938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:37.333748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 680/1396] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:37.338797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81746191-ef3b-4902-9ef7-e38982849deb None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:37.339086 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81746191-ef3b-4902-9ef7-e38982849deb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:37.339364 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81746191-ef3b-4902-9ef7-e38982849deb None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:37.340768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 717/1397] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:37.345819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdac7f-5911-40bf-9018-45eda9472e36 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:37.346108 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdac7f-5911-40bf-9018-45eda9472e36 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:37.346423 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdac7f-5911-40bf-9018-45eda9472e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:37.365084 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-03fdac7f-5911-40bf-9018-45eda9472e36 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:37.366813 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-03fdac7f-5911-40bf-9018-45eda9472e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:37.374777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 681/1398] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:27:37.380627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81746191-ef3b-4902-9ef7-e38982849deb None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:37.394444 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81746191-ef3b-4902-9ef7-e38982849deb None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:37.400075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810da0e4-c388-442d-939b-8fb0c23617d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:37.400750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da0e4-c388-442d-939b-8fb0c23617d0 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:37.401031 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da0e4-c388-442d-939b-8fb0c23617d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:37.401303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da0e4-c388-442d-939b-8fb0c23617d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:37.410820 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810da0e4-c388-442d-939b-8fb0c23617d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:37.412604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810da0e4-c388-442d-939b-8fb0c23617d0 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:37.422974 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 718/1399] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:37.432121 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09795f-2fb5-445c-8387-746efbb1a3b5 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:37.432411 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09795f-2fb5-445c-8387-746efbb1a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:37.432689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09795f-2fb5-445c-8387-746efbb1a3b5 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:37.434559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 682/1400] 10.222.0.50 () {54 vars in 962 bytes} [Wed Jun 15 10:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:37.440095 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafa999-5460-4d19-a66b-e64df05e0432 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:37.440404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafa999-5460-4d19-a66b-e64df05e0432 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:37.440676 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafa999-5460-4d19-a66b-e64df05e0432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:37.490264 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-aaafa999-5460-4d19-a66b-e64df05e0432 None None] MFA Rules not processed for user `68f1b06364a24554bba9936621127752`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:37.491548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-aaafa999-5460-4d19-a66b-e64df05e0432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:37.547549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:37.572431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 719/1401] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Jun 15 10:27:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:37.580362 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09795f-2fb5-445c-8387-746efbb1a3b5 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:37.591451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09795f-2fb5-445c-8387-746efbb1a3b5 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:37.595026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d5c5a-6073-41c5-bdbb-8fd441e26547 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f1b06364a24554bba9936621127752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:37.596231 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d5c5a-6073-41c5-bdbb-8fd441e26547 service glance] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:37.596525 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d5c5a-6073-41c5-bdbb-8fd441e26547 service glance] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:37.596791 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d5c5a-6073-41c5-bdbb-8fd441e26547 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:37.607595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d5c5a-6073-41c5-bdbb-8fd441e26547 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:37.609070 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d5c5a-6073-41c5-bdbb-8fd441e26547 service glance] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:37.620765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 683/1402] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:38.342385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dd44d-8733-41f4-8a91-61b0ab878456 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:38.342856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dd44d-8733-41f4-8a91-61b0ab878456 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:38.342982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dd44d-8733-41f4-8a91-61b0ab878456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:38.405874 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7a4dd44d-8733-41f4-8a91-61b0ab878456 None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:38.407110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7a4dd44d-8733-41f4-8a91-61b0ab878456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:38.482111 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 720/1403] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:27:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:38.525723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc283d-4029-4548-b6fb-612fc5d43bff None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:38.526277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc283d-4029-4548-b6fb-612fc5d43bff None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:38.526435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc283d-4029-4548-b6fb-612fc5d43bff None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:38.527953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 684/1404] 10.222.0.50 () {54 vars in 942 bytes} [Wed Jun 15 10:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:38.535223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba97fc-c669-4ac9-81e3-13b8450d6be1 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:38.535623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba97fc-c669-4ac9-81e3-13b8450d6be1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:38.536699 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba97fc-c669-4ac9-81e3-13b8450d6be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:38.598200 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2bba97fc-c669-4ac9-81e3-13b8450d6be1 None None] MFA Rules not processed for user `7673b1c4f6184570b0039f9285bf1286`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:38.599646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2bba97fc-c669-4ac9-81e3-13b8450d6be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:38.691667 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 721/1405] 10.222.0.50 () {58 vars in 1039 bytes} [Wed Jun 15 10:27:38 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:27:38.701209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc283d-4029-4548-b6fb-612fc5d43bff None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:38.708807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=64 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:38.716013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc283d-4029-4548-b6fb-612fc5d43bff None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:38.721464 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbd7b2-fafc-4fc9-b32c-c09b38deb290 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:38.722157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbd7b2-fafc-4fc9-b32c-c09b38deb290 service swift] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:38.722461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbd7b2-fafc-4fc9-b32c-c09b38deb290 service swift] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:38.722739 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbd7b2-fafc-4fc9-b32c-c09b38deb290 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:38.730882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbd7b2-fafc-4fc9-b32c-c09b38deb290 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:38.732550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbd7b2-fafc-4fc9-b32c-c09b38deb290 service swift] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:38.741601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 685/1406] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:27:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 10:27:39.638167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aeccd-bcfc-4cca-bc55-604b37588a5a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:39.638742 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aeccd-bcfc-4cca-bc55-604b37588a5a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:39.638742 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926aeccd-bcfc-4cca-bc55-604b37588a5a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:39.645334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 722/1407] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:27:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:27:39.645662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57b307-bfe9-4a49-87ff-3d4d0734833c None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:39.647344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57b307-bfe9-4a49-87ff-3d4d0734833c None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:39.647344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57b307-bfe9-4a49-87ff-3d4d0734833c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:39.668449 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ce57b307-bfe9-4a49-87ff-3d4d0734833c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:27:39.669784 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ce57b307-bfe9-4a49-87ff-3d4d0734833c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:27:39.678837 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 686/1408] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:27:39.731932 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aeccd-bcfc-4cca-bc55-604b37588a5a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:27:39.749488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926aeccd-bcfc-4cca-bc55-604b37588a5a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:27:39.756387 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8409c1f-7973-442a-91ff-8525a5e1699e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:27:39.759292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8409c1f-7973-442a-91ff-8525a5e1699e service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:27:39.759292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8409c1f-7973-442a-91ff-8525a5e1699e service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:27:39.759292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8409c1f-7973-442a-91ff-8525a5e1699e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:27:39.769038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8409c1f-7973-442a-91ff-8525a5e1699e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:27:39.770623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8409c1f-7973-442a-91ff-8525a5e1699e service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:27:39.781172 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 723/1409] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:27:49.664806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=8 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:27:49.776692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:01.817616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d456f-8603-47da-9cb7-86d7ce6054d3 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:01.818500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d456f-8603-47da-9cb7-86d7ce6054d3 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:01.818500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d456f-8603-47da-9cb7-86d7ce6054d3 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:01.820143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 687/1410] 10.222.0.50 () {54 vars in 918 bytes} [Wed Jun 15 10:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:01.825376 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f5cd6-174f-4494-a1b3-e183ca31a1b5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:01.825807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f5cd6-174f-4494-a1b3-e183ca31a1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:01.825902 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f5cd6-174f-4494-a1b3-e183ca31a1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:01.844820 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-540f5cd6-174f-4494-a1b3-e183ca31a1b5 None None] MFA Rules not processed for user `2729cb0b9adb44f7ba5c968b6158a93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:01.846622 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-540f5cd6-174f-4494-a1b3-e183ca31a1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:01.855046 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 724/1411] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Jun 15 10:28:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:01.870316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e59a4-d5c9-4f23-a4f5-3184f1002239 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:01.870864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e59a4-d5c9-4f23-a4f5-3184f1002239 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:01.871140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e59a4-d5c9-4f23-a4f5-3184f1002239 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:01.872549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 688/1412] 10.222.0.50 () {54 vars in 918 bytes} [Wed Jun 15 10:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:01.877550 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4477cb-cadd-4c4b-bf20-b9537bb667a8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:01.877826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4477cb-cadd-4c4b-bf20-b9537bb667a8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:01.878098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4477cb-cadd-4c4b-bf20-b9537bb667a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:01.896121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4e4477cb-cadd-4c4b-bf20-b9537bb667a8 None None] MFA Rules not processed for user `81e9805ec4c44cedb658b7becf768369`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:01.897338 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4e4477cb-cadd-4c4b-bf20-b9537bb667a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:01.906619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 725/1413] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Jun 15 10:28:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:04.527668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800bdc8-5d00-4778-adc3-1e77c349e360 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:04.528204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800bdc8-5d00-4778-adc3-1e77c349e360 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:04.528204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800bdc8-5d00-4778-adc3-1e77c349e360 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:04.529587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 689/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:04.534817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93470ec9-cc46-4c93-8aca-71d412a3dd2a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:04.535238 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93470ec9-cc46-4c93-8aca-71d412a3dd2a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:04.535374 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93470ec9-cc46-4c93-8aca-71d412a3dd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:04.553125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-93470ec9-cc46-4c93-8aca-71d412a3dd2a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:04.554317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-93470ec9-cc46-4c93-8aca-71d412a3dd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:04.562017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 726/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:04.607747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800bdc8-5d00-4778-adc3-1e77c349e360 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:04.624000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800bdc8-5d00-4778-adc3-1e77c349e360 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:04.629353 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3b6b2-68af-479d-b46b-1e28a7d28cea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:04.629990 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b6b2-68af-479d-b46b-1e28a7d28cea service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:04.630268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b6b2-68af-479d-b46b-1e28a7d28cea service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:04.630541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b6b2-68af-479d-b46b-1e28a7d28cea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:04.639325 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3b6b2-68af-479d-b46b-1e28a7d28cea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:04.640939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3b6b2-68af-479d-b46b-1e28a7d28cea service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:04.650852 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 690/1416] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:05.651803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344baa3f-b2c4-4c6a-97f6-734d346050c4 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:05.652662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344baa3f-b2c4-4c6a-97f6-734d346050c4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:05.652662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344baa3f-b2c4-4c6a-97f6-734d346050c4 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:05.653766 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 727/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 10:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:05.659605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e4024-4e37-4da4-a319-98d96604ebb9 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:05.660192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e4024-4e37-4da4-a319-98d96604ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:05.660192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e4024-4e37-4da4-a319-98d96604ebb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:05.682335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-898e4024-4e37-4da4-a319-98d96604ebb9 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:05.684322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-898e4024-4e37-4da4-a319-98d96604ebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:05.693637 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 691/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 10:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:05.845916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344baa3f-b2c4-4c6a-97f6-734d346050c4 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:05.862005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344baa3f-b2c4-4c6a-97f6-734d346050c4 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:05.868807 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eef46-da9d-4ef5-8ab8-87caddfc9bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:05.869526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eef46-da9d-4ef5-8ab8-87caddfc9bf0 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:05.869839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eef46-da9d-4ef5-8ab8-87caddfc9bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:05.870185 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eef46-da9d-4ef5-8ab8-87caddfc9bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:05.880677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678eef46-da9d-4ef5-8ab8-87caddfc9bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:05.882250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678eef46-da9d-4ef5-8ab8-87caddfc9bf0 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:05.893010 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 728/1419] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:06.852168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afeb8b-52db-4e26-94b4-5d310d9a0e4f None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:06.852734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afeb8b-52db-4e26-94b4-5d310d9a0e4f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:06.852734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afeb8b-52db-4e26-94b4-5d310d9a0e4f None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:06.854120 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 692/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 10:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:06.859699 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1763be-58d3-4edd-aaba-d3c27dc0c9c5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:06.860273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1763be-58d3-4edd-aaba-d3c27dc0c9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:06.860273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1763be-58d3-4edd-aaba-d3c27dc0c9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:06.880403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-cf1763be-58d3-4edd-aaba-d3c27dc0c9c5 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:06.881628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cf1763be-58d3-4edd-aaba-d3c27dc0c9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:06.889531 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 729/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 10:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:07.043227 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afeb8b-52db-4e26-94b4-5d310d9a0e4f None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:07.057885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afeb8b-52db-4e26-94b4-5d310d9a0e4f None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:07.063460 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f110f44-a8d1-4666-b5af-fe80fbcbd73b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:07.064681 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f110f44-a8d1-4666-b5af-fe80fbcbd73b service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:07.064965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f110f44-a8d1-4666-b5af-fe80fbcbd73b service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:07.065247 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f110f44-a8d1-4666-b5af-fe80fbcbd73b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:07.073691 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f110f44-a8d1-4666-b5af-fe80fbcbd73b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:07.075295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f110f44-a8d1-4666-b5af-fe80fbcbd73b service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:07.086131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 693/1422] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:08.043553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d13c6-fcc7-4bfa-8809-3e526895d757 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:08.044135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d13c6-fcc7-4bfa-8809-3e526895d757 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:08.044266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d13c6-fcc7-4bfa-8809-3e526895d757 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:08.046639 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 730/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 10:28:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:08.052341 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffb96e-4c38-4229-a39f-df9115f85e32 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:08.052879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffb96e-4c38-4229-a39f-df9115f85e32 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:08.053083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ffb96e-4c38-4229-a39f-df9115f85e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:08.071993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-52ffb96e-4c38-4229-a39f-df9115f85e32 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:08.073275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-52ffb96e-4c38-4229-a39f-df9115f85e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:08.083100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 694/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 10:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:28:08.251399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d13c6-fcc7-4bfa-8809-3e526895d757 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:08.269023 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d13c6-fcc7-4bfa-8809-3e526895d757 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:08.274860 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa09db-bd76-4ed1-8da6-c716c6ff216a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:08.275557 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa09db-bd76-4ed1-8da6-c716c6ff216a service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:08.275844 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa09db-bd76-4ed1-8da6-c716c6ff216a service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:08.276121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa09db-bd76-4ed1-8da6-c716c6ff216a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:08.290978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa09db-bd76-4ed1-8da6-c716c6ff216a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:08.293646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa09db-bd76-4ed1-8da6-c716c6ff216a service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:08.307895 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 731/1425] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:09.270453 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a16eee-0486-42a9-9dac-e93c97864184 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:09.271044 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a16eee-0486-42a9-9dac-e93c97864184 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:09.271044 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a16eee-0486-42a9-9dac-e93c97864184 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:09.272504 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 695/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 10:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:09.277539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1b017-d625-4538-8665-ef23689a6b13 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:09.277965 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1b017-d625-4538-8665-ef23689a6b13 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:09.278092 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1b017-d625-4538-8665-ef23689a6b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:09.296602 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2da1b017-d625-4538-8665-ef23689a6b13 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:09.297812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2da1b017-d625-4538-8665-ef23689a6b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:09.306734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 732/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 10:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:09.460685 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a16eee-0486-42a9-9dac-e93c97864184 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:09.476474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a16eee-0486-42a9-9dac-e93c97864184 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:09.482061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f5305-eb33-4255-90ff-a48daa68ae86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:09.482725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f5305-eb33-4255-90ff-a48daa68ae86 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:09.483006 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f5305-eb33-4255-90ff-a48daa68ae86 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:09.483278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f5305-eb33-4255-90ff-a48daa68ae86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:09.492339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f5305-eb33-4255-90ff-a48daa68ae86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:09.493932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f5305-eb33-4255-90ff-a48daa68ae86 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:09.504650 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 696/1428] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:10.382344 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a7027-c12d-44fb-ad71-4aaa3a6ee454 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:10.383023 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a7027-c12d-44fb-ad71-4aaa3a6ee454 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:10.383023 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a7027-c12d-44fb-ad71-4aaa3a6ee454 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:10.384348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 733/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 10:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:10.389442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44638093-4451-448f-8fef-997819e5ddf1 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:10.389964 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44638093-4451-448f-8fef-997819e5ddf1 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:10.390215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44638093-4451-448f-8fef-997819e5ddf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:10.408724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-44638093-4451-448f-8fef-997819e5ddf1 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:10.409942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-44638093-4451-448f-8fef-997819e5ddf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:10.419364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 697/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 10:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:10.572531 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a7027-c12d-44fb-ad71-4aaa3a6ee454 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:10.587247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a7027-c12d-44fb-ad71-4aaa3a6ee454 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:10.592653 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f8b07-4d1e-45dc-8e27-b404a0a7ba79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:10.593266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f8b07-4d1e-45dc-8e27-b404a0a7ba79 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:10.593543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f8b07-4d1e-45dc-8e27-b404a0a7ba79 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:10.593811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f8b07-4d1e-45dc-8e27-b404a0a7ba79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:10.602480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f8b07-4d1e-45dc-8e27-b404a0a7ba79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:10.604072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f8b07-4d1e-45dc-8e27-b404a0a7ba79 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:10.614087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 734/1431] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:11.467822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf0cb-dd0a-4686-9da0-7160e9c319ca None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:11.468487 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf0cb-dd0a-4686-9da0-7160e9c319ca None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:11.468487 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf0cb-dd0a-4686-9da0-7160e9c319ca None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:11.469739 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 698/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 10:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:11.475072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d04f47-801a-48ed-9795-d8b765cc5dda None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:11.475516 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d04f47-801a-48ed-9795-d8b765cc5dda None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:11.475654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d04f47-801a-48ed-9795-d8b765cc5dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:11.493761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b2d04f47-801a-48ed-9795-d8b765cc5dda None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:11.494948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b2d04f47-801a-48ed-9795-d8b765cc5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:11.503130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 735/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 10:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:11.654275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cf0cb-dd0a-4686-9da0-7160e9c319ca None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:11.669143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cf0cb-dd0a-4686-9da0-7160e9c319ca None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:11.675055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4fad4-264e-4443-b73e-fe66f23b68a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:11.675722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4fad4-264e-4443-b73e-fe66f23b68a9 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:11.676004 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4fad4-264e-4443-b73e-fe66f23b68a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:11.676272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4fad4-264e-4443-b73e-fe66f23b68a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:11.684591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4fad4-264e-4443-b73e-fe66f23b68a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:11.686148 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4fad4-264e-4443-b73e-fe66f23b68a9 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:11.695433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 699/1434] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:12.567078 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e0a61-2593-4da2-8c42-fd4fad8b1b8a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:12.567738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e0a61-2593-4da2-8c42-fd4fad8b1b8a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:12.567738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e0a61-2593-4da2-8c42-fd4fad8b1b8a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:12.569012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 736/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 10:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:12.573914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e50fa5-02f1-4c6c-9758-8483965dcf60 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:12.574561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e50fa5-02f1-4c6c-9758-8483965dcf60 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:12.574561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e50fa5-02f1-4c6c-9758-8483965dcf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:12.592061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-d2e50fa5-02f1-4c6c-9758-8483965dcf60 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:12.593297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d2e50fa5-02f1-4c6c-9758-8483965dcf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:12.601332 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 700/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 10:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:12.755830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e0a61-2593-4da2-8c42-fd4fad8b1b8a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:12.769778 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e0a61-2593-4da2-8c42-fd4fad8b1b8a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:12.775025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575528c0-1ad6-4299-b4c3-d2b74d4f48ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:12.775771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575528c0-1ad6-4299-b4c3-d2b74d4f48ec service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:12.775967 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575528c0-1ad6-4299-b4c3-d2b74d4f48ec service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:12.776248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575528c0-1ad6-4299-b4c3-d2b74d4f48ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:12.784323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575528c0-1ad6-4299-b4c3-d2b74d4f48ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:12.785906 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575528c0-1ad6-4299-b4c3-d2b74d4f48ec service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:12.795597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 737/1437] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:13.653455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedabd3-25d2-40a7-818c-31d8892899d1 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:13.654016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedabd3-25d2-40a7-818c-31d8892899d1 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:13.654131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedabd3-25d2-40a7-818c-31d8892899d1 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:13.655418 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 701/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 10:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:13.660439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0be4d-391d-42a6-a8a1-49a038e0c5d9 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:13.660866 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0be4d-391d-42a6-a8a1-49a038e0c5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:13.660997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0be4d-391d-42a6-a8a1-49a038e0c5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:13.679036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f0c0be4d-391d-42a6-a8a1-49a038e0c5d9 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:13.680485 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f0c0be4d-391d-42a6-a8a1-49a038e0c5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:13.688110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 738/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 10:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:13.847760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedabd3-25d2-40a7-818c-31d8892899d1 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:13.861886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedabd3-25d2-40a7-818c-31d8892899d1 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:13.867205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b188f4-9c0a-4975-8362-143ef54d846c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:13.867870 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b188f4-9c0a-4975-8362-143ef54d846c service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:13.868156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b188f4-9c0a-4975-8362-143ef54d846c service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:13.868435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b188f4-9c0a-4975-8362-143ef54d846c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:13.878418 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b188f4-9c0a-4975-8362-143ef54d846c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:13.880131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b188f4-9c0a-4975-8362-143ef54d846c service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:13.890535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 702/1440] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:15.918680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d8d71-3ef7-40bb-aa1b-5d5a394eb3e5 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:15.919266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d8d71-3ef7-40bb-aa1b-5d5a394eb3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:15.919266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d8d71-3ef7-40bb-aa1b-5d5a394eb3e5 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:15.920615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 739/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:15.935438 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85a09-7e91-4a23-a5ea-7fcfa66c85cf None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:15.935993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85a09-7e91-4a23-a5ea-7fcfa66c85cf None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:15.935993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d85a09-7e91-4a23-a5ea-7fcfa66c85cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:15.953585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-e6d85a09-7e91-4a23-a5ea-7fcfa66c85cf None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:15.954898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-e6d85a09-7e91-4a23-a5ea-7fcfa66c85cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:15.962787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 703/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:16.001919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d8d71-3ef7-40bb-aa1b-5d5a394eb3e5 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:16.013112 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d8d71-3ef7-40bb-aa1b-5d5a394eb3e5 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:16.016750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f344f1-4dcd-4de2-aee8-2f9023496f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:16.017428 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f344f1-4dcd-4de2-aee8-2f9023496f8e service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:16.017710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f344f1-4dcd-4de2-aee8-2f9023496f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:16.017985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f344f1-4dcd-4de2-aee8-2f9023496f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:16.026998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f344f1-4dcd-4de2-aee8-2f9023496f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:16.028460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f344f1-4dcd-4de2-aee8-2f9023496f8e service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:16.038705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 740/1443] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:28:18.459142 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c7423-6db1-4232-b045-c6589ce35376 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:18.459869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c7423-6db1-4232-b045-c6589ce35376 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:18.459869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c7423-6db1-4232-b045-c6589ce35376 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:18.461311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 704/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:18.469020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e02b65-c1af-499b-8e86-4b1b1ca4b840 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:18.469020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e02b65-c1af-499b-8e86-4b1b1ca4b840 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:18.469672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e02b65-c1af-499b-8e86-4b1b1ca4b840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:18.498182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-31e02b65-c1af-499b-8e86-4b1b1ca4b840 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:18.499611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-31e02b65-c1af-499b-8e86-4b1b1ca4b840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:18.509050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 741/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:18.547553 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c7423-6db1-4232-b045-c6589ce35376 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:18.559136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c7423-6db1-4232-b045-c6589ce35376 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:18.562896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d60bd-d2a2-4415-815b-beb9271e1c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:18.563632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d60bd-d2a2-4415-815b-beb9271e1c97 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:18.564634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d60bd-d2a2-4415-815b-beb9271e1c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:18.564987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d60bd-d2a2-4415-815b-beb9271e1c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:18.574889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d60bd-d2a2-4415-815b-beb9271e1c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:18.576377 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d60bd-d2a2-4415-815b-beb9271e1c97 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:18.586666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 705/1446] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:21.109951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0270c5-2a39-4a3d-adf9-3b19966b591e None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:21.110505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0270c5-2a39-4a3d-adf9-3b19966b591e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:21.111296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0270c5-2a39-4a3d-adf9-3b19966b591e None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:21.112776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 742/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:21.118804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471702f-1f55-498d-8d99-0a914325abfe None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:21.120414 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471702f-1f55-498d-8d99-0a914325abfe None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:21.120414 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471702f-1f55-498d-8d99-0a914325abfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:21.138368 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-e471702f-1f55-498d-8d99-0a914325abfe None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:21.139534 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-e471702f-1f55-498d-8d99-0a914325abfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:21.147607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 706/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:28:21.195893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0270c5-2a39-4a3d-adf9-3b19966b591e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:21.198514 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0e0270c5-2a39-4a3d-adf9-3b19966b591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:21.212979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0270c5-2a39-4a3d-adf9-3b19966b591e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:21.216495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1377c5-f7b1-4552-8ccc-7e839cf35d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:21.217094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1377c5-f7b1-4552-8ccc-7e839cf35d4e service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:21.217374 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1377c5-f7b1-4552-8ccc-7e839cf35d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:21.217654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1377c5-f7b1-4552-8ccc-7e839cf35d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:21.227030 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1377c5-f7b1-4552-8ccc-7e839cf35d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:21.228472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1377c5-f7b1-4552-8ccc-7e839cf35d4e service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:21.238478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 743/1449] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:23.569280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117ec82-0d60-4c9a-9061-5ab8f5278529 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:23.569832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117ec82-0d60-4c9a-9061-5ab8f5278529 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:23.569832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117ec82-0d60-4c9a-9061-5ab8f5278529 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:23.571353 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 707/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:23.577296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a78c69-ba47-4d31-b0c6-645b9f1a9de7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:23.578069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a78c69-ba47-4d31-b0c6-645b9f1a9de7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:23.578069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a78c69-ba47-4d31-b0c6-645b9f1a9de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:23.596896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-34a78c69-ba47-4d31-b0c6-645b9f1a9de7 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:23.598062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-34a78c69-ba47-4d31-b0c6-645b9f1a9de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:23.607443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 744/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:28:23.650023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117ec82-0d60-4c9a-9061-5ab8f5278529 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:23.660989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117ec82-0d60-4c9a-9061-5ab8f5278529 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:23.664574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69261330-67a2-4909-8e60-107216b52b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:23.665209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69261330-67a2-4909-8e60-107216b52b8b service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:23.665496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69261330-67a2-4909-8e60-107216b52b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:23.665768 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69261330-67a2-4909-8e60-107216b52b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:23.675555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69261330-67a2-4909-8e60-107216b52b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:23.676997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69261330-67a2-4909-8e60-107216b52b8b service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:23.686868 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 708/1452] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:25.959370 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9988b-470b-4980-ba24-70de32ca372c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:25.959928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9988b-470b-4980-ba24-70de32ca372c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:25.959928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9988b-470b-4980-ba24-70de32ca372c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:25.961230 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 745/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:25.966462 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bca7c-c30c-481d-a74c-ca28bd60976d None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:25.967043 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bca7c-c30c-481d-a74c-ca28bd60976d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:25.967043 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bca7c-c30c-481d-a74c-ca28bd60976d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:25.985198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-348bca7c-c30c-481d-a74c-ca28bd60976d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:25.986444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-348bca7c-c30c-481d-a74c-ca28bd60976d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:25.996551 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 709/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:26.035049 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9988b-470b-4980-ba24-70de32ca372c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:26.046038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9988b-470b-4980-ba24-70de32ca372c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:26.049576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e5b6b-3698-4b27-81e7-a3ff2d1e12b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:26.050211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e5b6b-3698-4b27-81e7-a3ff2d1e12b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:26.050496 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e5b6b-3698-4b27-81e7-a3ff2d1e12b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:26.050758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e5b6b-3698-4b27-81e7-a3ff2d1e12b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:26.059705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e5b6b-3698-4b27-81e7-a3ff2d1e12b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:26.061128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e5b6b-3698-4b27-81e7-a3ff2d1e12b1 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:26.070588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 746/1455] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:28.286251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8964bb-4598-416a-befb-cfb3d528237f None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:28.286807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8964bb-4598-416a-befb-cfb3d528237f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:28.286807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8964bb-4598-416a-befb-cfb3d528237f None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:28.288202 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 710/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:28.293850 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63026019-9009-4167-9f0c-e36b0bff91de None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:28.294371 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63026019-9009-4167-9f0c-e36b0bff91de None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:28.294467 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63026019-9009-4167-9f0c-e36b0bff91de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:28.313227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-63026019-9009-4167-9f0c-e36b0bff91de None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:28.315115 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-63026019-9009-4167-9f0c-e36b0bff91de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:28.323101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 747/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:28:28.361794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8964bb-4598-416a-befb-cfb3d528237f None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:28.373912 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8964bb-4598-416a-befb-cfb3d528237f None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:28.378202 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bcfd5-29e8-43d7-8ece-a32087344e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:28.378847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bcfd5-29e8-43d7-8ece-a32087344e97 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:28.379133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bcfd5-29e8-43d7-8ece-a32087344e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:28.379413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bcfd5-29e8-43d7-8ece-a32087344e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:28.389529 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bcfd5-29e8-43d7-8ece-a32087344e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:28.391087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bcfd5-29e8-43d7-8ece-a32087344e97 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:28.400914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 711/1458] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:30.643785 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2968-1437-487f-9145-8acb3f900452 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:30.644753 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2968-1437-487f-9145-8acb3f900452 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:30.644753 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac2968-1437-487f-9145-8acb3f900452 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:30.645683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 748/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:30.652518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebbe8b-1b7e-402d-8f44-42f0e2e37093 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:30.652990 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebbe8b-1b7e-402d-8f44-42f0e2e37093 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:30.653177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebbe8b-1b7e-402d-8f44-42f0e2e37093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:30.660512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=70 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:30.678445 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-49ebbe8b-1b7e-402d-8f44-42f0e2e37093 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:30.679739 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-49ebbe8b-1b7e-402d-8f44-42f0e2e37093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:30.688145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 712/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:30.728570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac2968-1437-487f-9145-8acb3f900452 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:30.736562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=73 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:30.743417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac2968-1437-487f-9145-8acb3f900452 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:30.747626 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef21ae8-2beb-47cc-bb6e-49622e3dfa41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:30.748270 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef21ae8-2beb-47cc-bb6e-49622e3dfa41 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:30.748558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef21ae8-2beb-47cc-bb6e-49622e3dfa41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:30.748829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef21ae8-2beb-47cc-bb6e-49622e3dfa41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:30.759494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef21ae8-2beb-47cc-bb6e-49622e3dfa41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:30.760937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef21ae8-2beb-47cc-bb6e-49622e3dfa41 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:30.770856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 749/1461] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:28:33.042911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc45bf3-6ab6-43db-bdb1-ddaed720ec79 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:33.043525 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc45bf3-6ab6-43db-bdb1-ddaed720ec79 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:33.043525 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc45bf3-6ab6-43db-bdb1-ddaed720ec79 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:33.044889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 713/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:33.050903 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9f043-98d5-49c5-8964-df7f5c79fb10 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:33.051347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9f043-98d5-49c5-8964-df7f5c79fb10 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:33.051502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9f043-98d5-49c5-8964-df7f5c79fb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:33.070835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4fd9f043-98d5-49c5-8964-df7f5c79fb10 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:33.072071 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4fd9f043-98d5-49c5-8964-df7f5c79fb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:33.080254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 750/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:28:33.119453 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc45bf3-6ab6-43db-bdb1-ddaed720ec79 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:33.131534 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc45bf3-6ab6-43db-bdb1-ddaed720ec79 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:33.136548 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a608f-3038-4e3e-be69-11861e3fc6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:33.137219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a608f-3038-4e3e-be69-11861e3fc6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:33.137474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a608f-3038-4e3e-be69-11861e3fc6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:33.137760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a608f-3038-4e3e-be69-11861e3fc6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:33.148098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a608f-3038-4e3e-be69-11861e3fc6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:33.149654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a608f-3038-4e3e-be69-11861e3fc6e7 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:33.160977 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 714/1464] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:35.527751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb9b68-834c-4819-bf2e-22044a075c26 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:35.528337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb9b68-834c-4819-bf2e-22044a075c26 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:35.528337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb9b68-834c-4819-bf2e-22044a075c26 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:35.529697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 751/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:35.535122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f722a-7302-49f1-820e-a89d0e08363c None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:35.535555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f722a-7302-49f1-820e-a89d0e08363c None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:35.535726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f722a-7302-49f1-820e-a89d0e08363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:35.553145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-6a3f722a-7302-49f1-820e-a89d0e08363c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:35.554441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6a3f722a-7302-49f1-820e-a89d0e08363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:35.562239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 715/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:35.599595 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb9b68-834c-4819-bf2e-22044a075c26 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:35.611362 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb9b68-834c-4819-bf2e-22044a075c26 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:35.615186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f021ed5-4c71-48c6-bd5f-948a850d57de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:35.615867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f021ed5-4c71-48c6-bd5f-948a850d57de service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:35.616147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f021ed5-4c71-48c6-bd5f-948a850d57de service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:35.616422 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f021ed5-4c71-48c6-bd5f-948a850d57de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:35.626924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f021ed5-4c71-48c6-bd5f-948a850d57de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:35.628377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f021ed5-4c71-48c6-bd5f-948a850d57de service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:35.638019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 752/1467] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:28:37.868335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5b813-3fb6-4b15-a271-7c7bf1703724 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:37.868913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5b813-3fb6-4b15-a271-7c7bf1703724 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:37.868913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5b813-3fb6-4b15-a271-7c7bf1703724 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:37.870522 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 716/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:37.876580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e34d1-6da5-4882-9073-6759445e694b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:37.877065 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e34d1-6da5-4882-9073-6759445e694b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:37.877182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e34d1-6da5-4882-9073-6759445e694b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:37.895623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-746e34d1-6da5-4882-9073-6759445e694b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:37.896815 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-746e34d1-6da5-4882-9073-6759445e694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:37.905836 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 753/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:37.943626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5b813-3fb6-4b15-a271-7c7bf1703724 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:37.956383 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5b813-3fb6-4b15-a271-7c7bf1703724 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:37.960778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db7933-e135-404e-b39e-0c41e0fb62d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:37.961456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db7933-e135-404e-b39e-0c41e0fb62d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:37.961737 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db7933-e135-404e-b39e-0c41e0fb62d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:37.962014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db7933-e135-404e-b39e-0c41e0fb62d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:37.973331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db7933-e135-404e-b39e-0c41e0fb62d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:37.974811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db7933-e135-404e-b39e-0c41e0fb62d3 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:37.989030 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 717/1470] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:28:47.890458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=17 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:47.981265 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=17 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:28:58.363363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a76c03-838c-4dcb-beaa-e2f7a15155ca None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:58.363965 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a76c03-838c-4dcb-beaa-e2f7a15155ca None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:58.363965 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a76c03-838c-4dcb-beaa-e2f7a15155ca None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:58.365355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 754/1471] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:58.370649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05d328-2d92-464e-8edc-ffbb349a4b8d None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:58.371321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05d328-2d92-464e-8edc-ffbb349a4b8d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:58.371484 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05d328-2d92-464e-8edc-ffbb349a4b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:58.388755 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-7c05d328-2d92-464e-8edc-ffbb349a4b8d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:58.389943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7c05d328-2d92-464e-8edc-ffbb349a4b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:58.398223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 718/1472] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:28:58.444357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842effd-acb4-449d-815a-13bb55c694bb None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:58.444645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842effd-acb4-449d-815a-13bb55c694bb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:58.444919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842effd-acb4-449d-815a-13bb55c694bb None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:58.446267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 755/1473] 10.222.0.50 () {54 vars in 962 bytes} [Wed Jun 15 10:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:28:58.451089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd16ae-0333-4dcf-a2be-47f0e47b2552 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:58.451375 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd16ae-0333-4dcf-a2be-47f0e47b2552 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:58.451682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd16ae-0333-4dcf-a2be-47f0e47b2552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:58.470366 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-dffd16ae-0333-4dcf-a2be-47f0e47b2552 None None] MFA Rules not processed for user `68f1b06364a24554bba9936621127752`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:28:58.471577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-dffd16ae-0333-4dcf-a2be-47f0e47b2552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:28:58.477979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 719/1474] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Jun 15 10:28:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:28:58.485096 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842effd-acb4-449d-815a-13bb55c694bb None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:28:58.496776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842effd-acb4-449d-815a-13bb55c694bb None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:28:58.500442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249808b-6da1-4e33-8abe-3c08b94df582 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f1b06364a24554bba9936621127752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:28:58.501111 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249808b-6da1-4e33-8abe-3c08b94df582 service glance] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:28:58.501396 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249808b-6da1-4e33-8abe-3c08b94df582 service glance] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:28:58.501674 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249808b-6da1-4e33-8abe-3c08b94df582 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:28:58.511308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249808b-6da1-4e33-8abe-3c08b94df582 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:28:58.512758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249808b-6da1-4e33-8abe-3c08b94df582 service glance] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:28:58.522967 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 756/1475] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:29:00.727898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3914c-df1b-4ae2-b9da-d6bda25fcd79 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:00.728493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3914c-df1b-4ae2-b9da-d6bda25fcd79 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:00.728493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3914c-df1b-4ae2-b9da-d6bda25fcd79 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:00.729890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 720/1476] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:29:00.735638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287e07-fb4b-4c2d-9659-b489b6769593 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:00.736273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287e07-fb4b-4c2d-9659-b489b6769593 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:00.736393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287e07-fb4b-4c2d-9659-b489b6769593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:00.755534 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-87287e07-fb4b-4c2d-9659-b489b6769593 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:29:00.756745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-87287e07-fb4b-4c2d-9659-b489b6769593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:29:00.764648 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 757/1477] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:29:00.789853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3914c-df1b-4ae2-b9da-d6bda25fcd79 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:29:00.802949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3914c-df1b-4ae2-b9da-d6bda25fcd79 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:29:00.807389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633d911-68e9-435e-953e-5cfb06bc85ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:29:00.808060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633d911-68e9-435e-953e-5cfb06bc85ae admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:00.808346 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633d911-68e9-435e-953e-5cfb06bc85ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:00.808621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633d911-68e9-435e-953e-5cfb06bc85ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:00.809349 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633d911-68e9-435e-953e-5cfb06bc85ae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:29:00.811114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: WARNING py.warnings [None req-b633d911-68e9-435e-953e-5cfb06bc85ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:29:00.811114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: warnings.warn(msg) Jun 15 10:29:00.811114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: Jun 15 10:29:00.812274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633d911-68e9-435e-953e-5cfb06bc85ae admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:29:00.831437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 721/1478] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Jun 15 10:29:00 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:29:03.007505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cd6e6-78f6-45aa-a6f8-784a21a4cf78 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:03.008039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cd6e6-78f6-45aa-a6f8-784a21a4cf78 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:03.008039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cd6e6-78f6-45aa-a6f8-784a21a4cf78 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:03.009665 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 758/1479] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:29:03.015105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453406f-ee78-4e00-b9af-fa2280db050d None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:03.015561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453406f-ee78-4e00-b9af-fa2280db050d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:03.015695 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453406f-ee78-4e00-b9af-fa2280db050d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:03.034924 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-f453406f-ee78-4e00-b9af-fa2280db050d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:29:03.036192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f453406f-ee78-4e00-b9af-fa2280db050d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:29:03.044164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 722/1480] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:29:03.087362 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cd6e6-78f6-45aa-a6f8-784a21a4cf78 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:29:03.103486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cd6e6-78f6-45aa-a6f8-784a21a4cf78 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:29:03.108759 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f2736-0e6b-4247-b100-5af60f52a5cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:29:03.109382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f2736-0e6b-4247-b100-5af60f52a5cf service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:03.110288 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f2736-0e6b-4247-b100-5af60f52a5cf service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:03.110568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f2736-0e6b-4247-b100-5af60f52a5cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:03.118685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f2736-0e6b-4247-b100-5af60f52a5cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:29:03.120360 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f2736-0e6b-4247-b100-5af60f52a5cf service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:29:03.130212 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 759/1481] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:29:05.453276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e39c3-816d-4bd3-bb8c-674c8556c0b4 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:05.454417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e39c3-816d-4bd3-bb8c-674c8556c0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:05.454417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e39c3-816d-4bd3-bb8c-674c8556c0b4 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:05.455794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 723/1482] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:29:05.460995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce6e62-2262-4f70-bc7d-3a6ecca5c7c8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:05.461448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce6e62-2262-4f70-bc7d-3a6ecca5c7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:05.461559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce6e62-2262-4f70-bc7d-3a6ecca5c7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:05.479000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-90ce6e62-2262-4f70-bc7d-3a6ecca5c7c8 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:29:05.480227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-90ce6e62-2262-4f70-bc7d-3a6ecca5c7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:29:05.488093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 760/1483] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:29:05.525062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e39c3-816d-4bd3-bb8c-674c8556c0b4 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:29:05.535733 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e39c3-816d-4bd3-bb8c-674c8556c0b4 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:29:05.539206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9c007-9669-4ba5-812b-4c57036b9e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:29:05.539877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9c007-9669-4ba5-812b-4c57036b9e4e service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:05.540158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9c007-9669-4ba5-812b-4c57036b9e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:05.540427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9c007-9669-4ba5-812b-4c57036b9e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:05.549087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9c007-9669-4ba5-812b-4c57036b9e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:29:05.550521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9c007-9669-4ba5-812b-4c57036b9e4e service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:29:05.560018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 724/1484] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:29:07.738913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854845-b842-43ce-bd6a-b8bf1f61e3f1 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:07.739511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854845-b842-43ce-bd6a-b8bf1f61e3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:07.739511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854845-b842-43ce-bd6a-b8bf1f61e3f1 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:07.741052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 761/1485] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:29:07.746341 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4a491-2b76-49ec-8334-de5a825f8dfe None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:07.746741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4a491-2b76-49ec-8334-de5a825f8dfe None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:07.746891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4a491-2b76-49ec-8334-de5a825f8dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:07.764152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-76f4a491-2b76-49ec-8334-de5a825f8dfe None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:29:07.765341 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-76f4a491-2b76-49ec-8334-de5a825f8dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:29:07.773114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 725/1486] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:29:07.810734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854845-b842-43ce-bd6a-b8bf1f61e3f1 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:29:07.821284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854845-b842-43ce-bd6a-b8bf1f61e3f1 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:29:07.824761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5606ea-9433-4db0-a837-01c3bee210cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:29:07.825385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5606ea-9433-4db0-a837-01c3bee210cf service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:07.825661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5606ea-9433-4db0-a837-01c3bee210cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:07.825932 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5606ea-9433-4db0-a837-01c3bee210cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:07.836664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5606ea-9433-4db0-a837-01c3bee210cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:29:07.838094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5606ea-9433-4db0-a837-01c3bee210cf service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:29:07.848171 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 762/1487] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:29:10.086403 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f8bb2-aa30-4948-8a5f-ef4cdc5a16f7 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:10.086943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f8bb2-aa30-4948-8a5f-ef4cdc5a16f7 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:10.086943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f8bb2-aa30-4948-8a5f-ef4cdc5a16f7 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:10.088361 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 726/1488] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:29:10.093440 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713eef-c68a-4d45-904e-3404e01478f9 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:10.093859 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713eef-c68a-4d45-904e-3404e01478f9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:10.094025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713eef-c68a-4d45-904e-3404e01478f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:10.111290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9c713eef-c68a-4d45-904e-3404e01478f9 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:29:10.112582 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9c713eef-c68a-4d45-904e-3404e01478f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:29:10.120368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 763/1489] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:29:10.167722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f8bb2-aa30-4948-8a5f-ef4cdc5a16f7 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:29:10.178287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f8bb2-aa30-4948-8a5f-ef4cdc5a16f7 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:29:10.181727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b195ff9-baea-40b5-8d09-514d226d05d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:29:10.182372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b195ff9-baea-40b5-8d09-514d226d05d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:10.182649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b195ff9-baea-40b5-8d09-514d226d05d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:10.182916 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b195ff9-baea-40b5-8d09-514d226d05d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:10.192312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b195ff9-baea-40b5-8d09-514d226d05d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:29:10.193787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b195ff9-baea-40b5-8d09-514d226d05d6 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:29:10.203965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 727/1490] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:29:12.527382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be9fa8-06d5-4fdc-8564-277207df3690 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:12.528001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be9fa8-06d5-4fdc-8564-277207df3690 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:12.528001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be9fa8-06d5-4fdc-8564-277207df3690 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:12.529306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 764/1491] 10.222.0.50 () {54 vars in 926 bytes} [Wed Jun 15 10:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:29:12.534456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424be9b0-e4f2-47d9-ac4b-8eef6fa207d5 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:12.534859 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424be9b0-e4f2-47d9-ac4b-8eef6fa207d5 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:12.535001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424be9b0-e4f2-47d9-ac4b-8eef6fa207d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:12.552595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-424be9b0-e4f2-47d9-ac4b-8eef6fa207d5 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:29:12.553769 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-424be9b0-e4f2-47d9-ac4b-8eef6fa207d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:29:12.561337 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 728/1492] 10.222.0.50 () {58 vars in 1023 bytes} [Wed Jun 15 10:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:29:12.599221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be9fa8-06d5-4fdc-8564-277207df3690 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:29:12.610286 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be9fa8-06d5-4fdc-8564-277207df3690 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:29:12.613978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d810b-594c-44be-a368-84ff180d3907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:29:12.614606 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d810b-594c-44be-a368-84ff180d3907 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:29:12.614886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d810b-594c-44be-a368-84ff180d3907 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:29:12.615163 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d810b-594c-44be-a368-84ff180d3907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:29:12.624387 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d810b-594c-44be-a368-84ff180d3907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:29:12.626411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d810b-594c-44be-a368-84ff180d3907 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:29:12.635825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 765/1493] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:29:22.547634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=33 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:29:22.631630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=33 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:38.053339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afed13-1df2-4d9a-980e-5734a1cb3d36 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:38.053917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afed13-1df2-4d9a-980e-5734a1cb3d36 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:38.053917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afed13-1df2-4d9a-980e-5734a1cb3d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:38.072234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-66afed13-1df2-4d9a-980e-5734a1cb3d36 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:30:38.073439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-66afed13-1df2-4d9a-980e-5734a1cb3d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:30:38.090243 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 729/1494] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:30:38.099638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea131cad-c332-4544-9699-f66e54d0db43 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:38.100175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea131cad-c332-4544-9699-f66e54d0db43 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:38.100175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea131cad-c332-4544-9699-f66e54d0db43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:38.118538 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ea131cad-c332-4544-9699-f66e54d0db43 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:30:38.119771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ea131cad-c332-4544-9699-f66e54d0db43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:30:38.128427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 766/1495] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:30:38.132999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afed13-1df2-4d9a-980e-5734a1cb3d36 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:30:38.142707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afed13-1df2-4d9a-980e-5734a1cb3d36 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:30:38.147247 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e4997-ea65-4571-bd86-0ba8a49513f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:30:38.147935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e4997-ea65-4571-bd86-0ba8a49513f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:38.148217 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e4997-ea65-4571-bd86-0ba8a49513f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:38.148488 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e4997-ea65-4571-bd86-0ba8a49513f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:38.149206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e4997-ea65-4571-bd86-0ba8a49513f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:30:38.149513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e4997-ea65-4571-bd86-0ba8a49513f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:30:38.150533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: WARNING py.warnings [None req-a64e4997-ea65-4571-bd86-0ba8a49513f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:30:38.150533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: warnings.warn(msg) Jun 15 10:30:38.150533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: Jun 15 10:30:38.151401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e4997-ea65-4571-bd86-0ba8a49513f5 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:30:38.163256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 730/1496] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:30:38.176446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea131cad-c332-4544-9699-f66e54d0db43 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:30:38.186381 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea131cad-c332-4544-9699-f66e54d0db43 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:30:38.192533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f96893-838f-4874-95fb-a23cd1872422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:30:38.193190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f96893-838f-4874-95fb-a23cd1872422 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:38.193474 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f96893-838f-4874-95fb-a23cd1872422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:38.193753 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f96893-838f-4874-95fb-a23cd1872422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:38.194583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f96893-838f-4874-95fb-a23cd1872422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:30:38.196269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: WARNING py.warnings [None req-e6f96893-838f-4874-95fb-a23cd1872422 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:30:38.196269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: warnings.warn(msg) Jun 15 10:30:38.196269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: Jun 15 10:30:38.197619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f96893-838f-4874-95fb-a23cd1872422 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:30:38.241163 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 767/1497] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:30:38 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:30:38.245608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e4997-ea65-4571-bd86-0ba8a49513f5 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:30:38.257508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e4997-ea65-4571-bd86-0ba8a49513f5 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:30:38.316732 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21c2c1-8550-43b5-8d51-7843e7d9fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:30:38.317316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21c2c1-8550-43b5-8d51-7843e7d9fa73 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:38.317592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21c2c1-8550-43b5-8d51-7843e7d9fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:38.317862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21c2c1-8550-43b5-8d51-7843e7d9fa73 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:38.318545 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21c2c1-8550-43b5-8d51-7843e7d9fa73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:30:38.319590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: WARNING py.warnings [None req-5d21c2c1-8550-43b5-8d51-7843e7d9fa73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:30:38.319590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: warnings.warn(msg) Jun 15 10:30:38.319590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: Jun 15 10:30:38.320777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21c2c1-8550-43b5-8d51-7843e7d9fa73 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:30:38.340540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 731/1498] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:30:38 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:30:38.345339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f96893-838f-4874-95fb-a23cd1872422 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:30:38.356504 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f96893-838f-4874-95fb-a23cd1872422 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:30:38.362456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc44ce-cc33-4ce1-8cb0-66c595565905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:30:38.363191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc44ce-cc33-4ce1-8cb0-66c595565905 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:38.363558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc44ce-cc33-4ce1-8cb0-66c595565905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:38.363942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc44ce-cc33-4ce1-8cb0-66c595565905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:38.364745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc44ce-cc33-4ce1-8cb0-66c595565905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:30:38.365798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: WARNING py.warnings [None req-44dc44ce-cc33-4ce1-8cb0-66c595565905 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:30:38.365798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: warnings.warn(msg) Jun 15 10:30:38.365798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: Jun 15 10:30:38.366806 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc44ce-cc33-4ce1-8cb0-66c595565905 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:30:38.381846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 768/1499] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:30:38.385955 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21c2c1-8550-43b5-8d51-7843e7d9fa73 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:30:38.396704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21c2c1-8550-43b5-8d51-7843e7d9fa73 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:30:38.401546 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b24fd-536e-490f-a51e-bf76d96d7c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:30:38.402219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b24fd-536e-490f-a51e-bf76d96d7c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:38.402513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b24fd-536e-490f-a51e-bf76d96d7c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:38.402816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b24fd-536e-490f-a51e-bf76d96d7c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:38.403697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b24fd-536e-490f-a51e-bf76d96d7c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:30:38.405309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: WARNING py.warnings [None req-910b24fd-536e-490f-a51e-bf76d96d7c88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:30:38.405309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: warnings.warn(msg) Jun 15 10:30:38.405309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: Jun 15 10:30:38.406239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b24fd-536e-490f-a51e-bf76d96d7c88 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:30:38.419915 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 732/1500] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:30:38.424971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc44ce-cc33-4ce1-8cb0-66c595565905 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:30:38.440180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc44ce-cc33-4ce1-8cb0-66c595565905 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:30:38.448758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa19da-1bd4-4400-b8cf-526256698f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:30:38.449642 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa19da-1bd4-4400-b8cf-526256698f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:38.449923 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa19da-1bd4-4400-b8cf-526256698f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:38.450197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa19da-1bd4-4400-b8cf-526256698f02 admin admin] PATH_INFO: `/v3/projects/0c027ccfa49c40c99888e7044ff75ca1/users/fb21d8e7a1474766813c187ceb5febf0/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:38.465508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa19da-1bd4-4400-b8cf-526256698f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c027ccfa49c40c99888e7044ff75ca1, user_id=fb21d8e7a1474766813c187ceb5febf0, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:30:38.466546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: WARNING py.warnings [None req-25aa19da-1bd4-4400-b8cf-526256698f02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:30:38.466546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: warnings.warn(msg) Jun 15 10:30:38.466546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: Jun 15 10:30:38.468992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa19da-1bd4-4400-b8cf-526256698f02 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:30:38.492633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 769/1501] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:30:38 2022] PUT /identity/v3/projects/0c027ccfa49c40c99888e7044ff75ca1/users/fb21d8e7a1474766813c187ceb5febf0/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:30:38.504490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bb217-8a33-458c-b405-a0a4f5af32dd None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:38.504780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bb217-8a33-458c-b405-a0a4f5af32dd None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:38.505078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bb217-8a33-458c-b405-a0a4f5af32dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:38.531960 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-d97bb217-8a33-458c-b405-a0a4f5af32dd None None] MFA Rules not processed for user `fb21d8e7a1474766813c187ceb5febf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:30:38.533170 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d97bb217-8a33-458c-b405-a0a4f5af32dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:30:38.610161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 733/1502] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:30:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:30:38.624370 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda81f9-19db-4bf3-b4e9-7056e58ffedd None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:38.624661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda81f9-19db-4bf3-b4e9-7056e58ffedd None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:38.625011 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda81f9-19db-4bf3-b4e9-7056e58ffedd None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:38.626399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 770/1503] 10.222.0.50 () {54 vars in 963 bytes} [Wed Jun 15 10:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:30:38.631821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5d959-aa80-4597-bf35-e3315845dd5f None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:38.632110 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5d959-aa80-4597-bf35-e3315845dd5f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:38.632392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5d959-aa80-4597-bf35-e3315845dd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:38.650623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-acb5d959-aa80-4597-bf35-e3315845dd5f None None] MFA Rules not processed for user `383ef65dd6b14810a7a2a8e06143eca2`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:30:38.651871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-acb5d959-aa80-4597-bf35-e3315845dd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:30:38.705424 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:38.714256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 734/1504] 10.222.0.50 () {58 vars in 1060 bytes} [Wed Jun 15 10:30:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:30:38.722839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda81f9-19db-4bf3-b4e9-7056e58ffedd None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:30:38.734718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda81f9-19db-4bf3-b4e9-7056e58ffedd None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:30:38.738594 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c092cf9-949d-4f93-ade0-5f79eccb4204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:30:38.739234 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c092cf9-949d-4f93-ade0-5f79eccb4204 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:38.739551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c092cf9-949d-4f93-ade0-5f79eccb4204 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:38.739831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c092cf9-949d-4f93-ade0-5f79eccb4204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:38.748801 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c092cf9-949d-4f93-ade0-5f79eccb4204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:30:38.750220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c092cf9-949d-4f93-ade0-5f79eccb4204 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:30:38.759203 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 771/1505] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:30:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:30:38.805659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981d061-ca23-4492-9a19-4cd9712fd80a None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:38.805954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981d061-ca23-4492-9a19-4cd9712fd80a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:38.806235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981d061-ca23-4492-9a19-4cd9712fd80a None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:38.807604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 735/1506] 10.222.0.50 () {52 vars in 829 bytes} [Wed Jun 15 10:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:30:38.811293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c092cf9-949d-4f93-ade0-5f79eccb4204 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:30:38.875170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c092cf9-949d-4f93-ade0-5f79eccb4204 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:30:38.881941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:30:38.882810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:38.883088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:38.883451 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] PATH_INFO: `/v3/users/fb21d8e7a1474766813c187ceb5febf0` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:38.885375 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb21d8e7a1474766813c187ceb5febf0)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:30:38.887342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: WARNING py.warnings [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:30:38.887342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: warnings.warn(msg) Jun 15 10:30:38.887342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: Jun 15 10:30:38.890180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:30:38.965848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb21d8e7a1474766813c187ceb5febf0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:30:38.984784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb21d8e7a1474766813c187ceb5febf0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:30:38.985579 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb21d8e7a1474766813c187ceb5febf0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:30:38.998211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb21d8e7a1474766813c187ceb5febf0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:30:39.002364 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:39.010428 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb21d8e7a1474766813c187ceb5febf0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:30:39.018237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 772/1507] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:30:38 2022] DELETE /identity/v3/users/fb21d8e7a1474766813c187ceb5febf0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:30:39.022824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b530c-ad99-46b0-856c-8cddb008bb37 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:39.023112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b530c-ad99-46b0-856c-8cddb008bb37 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:39.023406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b530c-ad99-46b0-856c-8cddb008bb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:39.042385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-f01b530c-ad99-46b0-856c-8cddb008bb37 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:30:39.044024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f01b530c-ad99-46b0-856c-8cddb008bb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:30:39.110065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 736/1508] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:30:39.120428 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:30:39.122138 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:30:39.184112 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47962f-feae-475c-8577-894db85c4f36 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:30:39.188411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2b3bf-dde7-4b99-9386-c4cea18d4e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:30:39.189051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2b3bf-dde7-4b99-9386-c4cea18d4e93 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:39.189331 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2b3bf-dde7-4b99-9386-c4cea18d4e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:39.189601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2b3bf-dde7-4b99-9386-c4cea18d4e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:39.200832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2b3bf-dde7-4b99-9386-c4cea18d4e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:30:39.202880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2b3bf-dde7-4b99-9386-c4cea18d4e93 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:30:39.213400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 773/1509] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:30:39.607358 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b530c-ad99-46b0-856c-8cddb008bb37 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:30:39.610180 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f01b530c-ad99-46b0-856c-8cddb008bb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:30:39.628917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b530c-ad99-46b0-856c-8cddb008bb37 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:30:39.634022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ec867-502f-473c-abff-2ef99af688fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:30:39.634933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ec867-502f-473c-abff-2ef99af688fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:30:39.635226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ec867-502f-473c-abff-2ef99af688fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:30:39.635413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ec867-502f-473c-abff-2ef99af688fd admin admin] PATH_INFO: `/v3/projects/0c027ccfa49c40c99888e7044ff75ca1` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:30:39.636634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ec867-502f-473c-abff-2ef99af688fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c027ccfa49c40c99888e7044ff75ca1)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:30:39.638818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: WARNING py.warnings [None req-976ec867-502f-473c-abff-2ef99af688fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:30:39.638818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: warnings.warn(msg) Jun 15 10:30:39.638818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: Jun 15 10:30:39.640326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ec867-502f-473c-abff-2ef99af688fd admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:30:39.712763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-976ec867-502f-473c-abff-2ef99af688fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c027ccfa49c40c99888e7044ff75ca1', 'request_id': 'req-976ec867-502f-473c-abff-2ef99af688fd'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:30:39.726724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-976ec867-502f-473c-abff-2ef99af688fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c027ccfa49c40c99888e7044ff75ca1', 'request_id': 'req-976ec867-502f-473c-abff-2ef99af688fd'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:30:39.733462 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-976ec867-502f-473c-abff-2ef99af688fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c027ccfa49c40c99888e7044ff75ca1', 'request_id': 'req-976ec867-502f-473c-abff-2ef99af688fd'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:30:39.749950 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-976ec867-502f-473c-abff-2ef99af688fd admin admin] The token cache is being invalidate because project 0c027ccfa49c40c99888e7044ff75ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:30:39.750239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-976ec867-502f-473c-abff-2ef99af688fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:30:39.750980 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-976ec867-502f-473c-abff-2ef99af688fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:30:39.752638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 737/1510] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:30:39 2022] DELETE /identity/v3/projects/0c027ccfa49c40c99888e7044ff75ca1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:30:49.208324 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:30:49.745970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:26.910411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98420332-1b89-49bd-8594-81ce6fc8345c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:26.911010 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98420332-1b89-49bd-8594-81ce6fc8345c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:26.911010 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98420332-1b89-49bd-8594-81ce6fc8345c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:26.912359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 774/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 10:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 10:32:26.917417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c49916-f8e3-4cdc-8476-40a9cfaa0f34 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:26.917877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c49916-f8e3-4cdc-8476-40a9cfaa0f34 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:26.917983 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c49916-f8e3-4cdc-8476-40a9cfaa0f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:26.936759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-b8c49916-f8e3-4cdc-8476-40a9cfaa0f34 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:32:26.937972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b8c49916-f8e3-4cdc-8476-40a9cfaa0f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:32:26.998128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 738/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 10:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:32:27.178456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98420332-1b89-49bd-8594-81ce6fc8345c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:32:27.180239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-98420332-1b89-49bd-8594-81ce6fc8345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:32:27.260470 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98420332-1b89-49bd-8594-81ce6fc8345c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:32:27.265692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee474d79-d497-4092-9cbd-e7f3c182be15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:32:27.266337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee474d79-d497-4092-9cbd-e7f3c182be15 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:27.266616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee474d79-d497-4092-9cbd-e7f3c182be15 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:27.266888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee474d79-d497-4092-9cbd-e7f3c182be15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:27.275915 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee474d79-d497-4092-9cbd-e7f3c182be15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:32:27.277547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee474d79-d497-4092-9cbd-e7f3c182be15 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:32:27.288152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 775/1513] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:32:28.175531 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a991a-6c44-409f-995d-e1def0508aab None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:28.176112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a991a-6c44-409f-995d-e1def0508aab None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:28.176112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a991a-6c44-409f-995d-e1def0508aab None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:28.177489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 739/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 10:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:32:28.183485 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d37c09-2ea4-48bb-90cc-0588d273b9c7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:28.183485 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d37c09-2ea4-48bb-90cc-0588d273b9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:28.184162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d37c09-2ea4-48bb-90cc-0588d273b9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:28.203313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-02d37c09-2ea4-48bb-90cc-0588d273b9c7 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:32:28.204546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-02d37c09-2ea4-48bb-90cc-0588d273b9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:32:28.212623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 776/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 10:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:32:28.381683 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a991a-6c44-409f-995d-e1def0508aab None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:32:28.399695 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a991a-6c44-409f-995d-e1def0508aab None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:32:28.405322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52681055-f589-4321-ad3d-caa60db8e335 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:32:28.405979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681055-f589-4321-ad3d-caa60db8e335 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:28.406260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681055-f589-4321-ad3d-caa60db8e335 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:28.406526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52681055-f589-4321-ad3d-caa60db8e335 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:28.416629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52681055-f589-4321-ad3d-caa60db8e335 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:32:28.419188 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52681055-f589-4321-ad3d-caa60db8e335 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:32:28.431603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 740/1516] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:32:28.905793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d58b89-fc0f-40ad-9e7d-2400ebfb1166 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:28.906133 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d58b89-fc0f-40ad-9e7d-2400ebfb1166 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:28.906443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d58b89-fc0f-40ad-9e7d-2400ebfb1166 None None] PATH_INFO: `/v3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:28.907819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 777/1517] 10.222.0.75 () {54 vars in 925 bytes} [Wed Jun 15 10:32:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:32:28.915198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8dc0a-13a3-4dc5-bb3f-28e952c68fcf None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:28.915521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8dc0a-13a3-4dc5-bb3f-28e952c68fcf None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:28.915803 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8dc0a-13a3-4dc5-bb3f-28e952c68fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:28.933404 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-5fb8dc0a-13a3-4dc5-bb3f-28e952c68fcf None None] MFA Rules not processed for user `2729cb0b9adb44f7ba5c968b6158a93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:32:28.934611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-5fb8dc0a-13a3-4dc5-bb3f-28e952c68fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:32:28.994827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 741/1518] 10.222.0.75 () {58 vars in 1015 bytes} [Wed Jun 15 10:32:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:32:38.197378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=37 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:38.404187 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb3ad-c6b7-4361-bd60-cb479f9371f7 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:38.404388 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb3ad-c6b7-4361-bd60-cb479f9371f7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:38.404624 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb3ad-c6b7-4361-bd60-cb479f9371f7 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:38.405996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 778/1519] 10.222.0.50 () {54 vars in 960 bytes} [Wed Jun 15 10:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:32:38.411357 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efb15f-a15c-4891-b714-8864b50a8853 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:38.411860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efb15f-a15c-4891-b714-8864b50a8853 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:38.411958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efb15f-a15c-4891-b714-8864b50a8853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:38.430209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-21efb15f-a15c-4891-b714-8864b50a8853 None None] MFA Rules not processed for user `2729cb0b9adb44f7ba5c968b6158a93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:32:38.431427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-21efb15f-a15c-4891-b714-8864b50a8853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:32:38.440575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 742/1520] 10.222.0.50 () {58 vars in 1057 bytes} [Wed Jun 15 10:32:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:32:38.449799 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfb3ad-c6b7-4361-bd60-cb479f9371f7 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:32:38.463926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfb3ad-c6b7-4361-bd60-cb479f9371f7 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:32:38.468800 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b9e8e-0a58-4b5c-ae29-264756cb0dec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2729cb0b9adb44f7ba5c968b6158a93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:32:38.469461 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b9e8e-0a58-4b5c-ae29-264756cb0dec service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:38.469750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b9e8e-0a58-4b5c-ae29-264756cb0dec service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:38.470022 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b9e8e-0a58-4b5c-ae29-264756cb0dec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:38.478379 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b9e8e-0a58-4b5c-ae29-264756cb0dec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:32:38.479975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b9e8e-0a58-4b5c-ae29-264756cb0dec service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:32:38.490073 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 779/1521] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:32:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:32:39.821551 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78444a62-8369-47b1-866e-3d1b9477e7e9 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:39.822084 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78444a62-8369-47b1-866e-3d1b9477e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:39.822084 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78444a62-8369-47b1-866e-3d1b9477e7e9 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:39.823522 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 743/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 10:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:32:39.828409 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319109d3-c3a8-48fa-9f9d-57d0ebe50a0f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:39.828849 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319109d3-c3a8-48fa-9f9d-57d0ebe50a0f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:39.828959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319109d3-c3a8-48fa-9f9d-57d0ebe50a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:39.846612 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-319109d3-c3a8-48fa-9f9d-57d0ebe50a0f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:32:39.847867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-319109d3-c3a8-48fa-9f9d-57d0ebe50a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:32:39.855508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 780/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 10:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:32:40.008843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78444a62-8369-47b1-866e-3d1b9477e7e9 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:32:40.023628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78444a62-8369-47b1-866e-3d1b9477e7e9 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:32:40.029076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f679d5-3972-4440-b861-abe4684519b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:32:40.029713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f679d5-3972-4440-b861-abe4684519b9 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:40.030291 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f679d5-3972-4440-b861-abe4684519b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:40.030291 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f679d5-3972-4440-b861-abe4684519b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:40.038979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f679d5-3972-4440-b861-abe4684519b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:32:40.040612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f679d5-3972-4440-b861-abe4684519b9 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:32:40.050325 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 744/1524] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:32:40.932369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001406c-a444-4cb5-b47f-7e9cd3ae9af0 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:40.933369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001406c-a444-4cb5-b47f-7e9cd3ae9af0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:40.933369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001406c-a444-4cb5-b47f-7e9cd3ae9af0 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:40.934573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 781/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 10:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:32:40.941698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9dba2-6346-4ad1-837e-80573d6ddeaa None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:40.942467 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9dba2-6346-4ad1-837e-80573d6ddeaa None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:40.942644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9dba2-6346-4ad1-837e-80573d6ddeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:40.978891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-7ac9dba2-6346-4ad1-837e-80573d6ddeaa None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:32:40.980501 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7ac9dba2-6346-4ad1-837e-80573d6ddeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:32:40.990867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 745/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 10:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:32:41.151421 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001406c-a444-4cb5-b47f-7e9cd3ae9af0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:32:41.176098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001406c-a444-4cb5-b47f-7e9cd3ae9af0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:32:41.184990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833e805-1a7b-451a-9501-864e4033a9c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:32:41.185567 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833e805-1a7b-451a-9501-864e4033a9c1 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:41.185874 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833e805-1a7b-451a-9501-864e4033a9c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:41.186145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833e805-1a7b-451a-9501-864e4033a9c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:41.195863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833e805-1a7b-451a-9501-864e4033a9c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:32:41.197494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833e805-1a7b-451a-9501-864e4033a9c1 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:32:41.209575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 782/1527] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:32:45.333560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b976-63e6-4f87-9c27-1a83ddb3ec36 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:45.334338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b976-63e6-4f87-9c27-1a83ddb3ec36 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:45.334338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b976-63e6-4f87-9c27-1a83ddb3ec36 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:45.335419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 746/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:32:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:32:45.342288 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aba2e0-6ec3-48f4-a8c6-68eb433aec1d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:45.342831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aba2e0-6ec3-48f4-a8c6-68eb433aec1d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:45.343181 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aba2e0-6ec3-48f4-a8c6-68eb433aec1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:45.372354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-08aba2e0-6ec3-48f4-a8c6-68eb433aec1d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:32:45.374666 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-08aba2e0-6ec3-48f4-a8c6-68eb433aec1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:32:45.389016 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 783/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:32:45.431795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95b976-63e6-4f87-9c27-1a83ddb3ec36 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:32:45.433711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4b95b976-63e6-4f87-9c27-1a83ddb3ec36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:32:45.498319 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95b976-63e6-4f87-9c27-1a83ddb3ec36 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:32:45.502545 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ee306-30d4-4bb3-bcd3-69c9b3e9044e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:32:45.503195 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ee306-30d4-4bb3-bcd3-69c9b3e9044e service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:45.503500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ee306-30d4-4bb3-bcd3-69c9b3e9044e service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:45.504483 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ee306-30d4-4bb3-bcd3-69c9b3e9044e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:45.514038 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ee306-30d4-4bb3-bcd3-69c9b3e9044e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:32:45.515500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ee306-30d4-4bb3-bcd3-69c9b3e9044e service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:32:45.521440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:32:45.527018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 747/1530] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:32:47.700364 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce9c33-9b11-41ee-94c4-17520bbe8400 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:47.700919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce9c33-9b11-41ee-94c4-17520bbe8400 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:47.700919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce9c33-9b11-41ee-94c4-17520bbe8400 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:47.702528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 784/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:32:47.707759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb4925-ca7a-4f90-ae4a-33e3f9b3610b None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:47.708239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb4925-ca7a-4f90-ae4a-33e3f9b3610b None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:47.708338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb4925-ca7a-4f90-ae4a-33e3f9b3610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:47.726594 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-08bb4925-ca7a-4f90-ae4a-33e3f9b3610b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:32:47.727857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-08bb4925-ca7a-4f90-ae4a-33e3f9b3610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:32:47.735912 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 748/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:32:47.771622 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce9c33-9b11-41ee-94c4-17520bbe8400 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:32:47.782244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce9c33-9b11-41ee-94c4-17520bbe8400 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:32:47.786198 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057b32a-edf5-418d-b892-34242d346eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:32:47.786827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057b32a-edf5-418d-b892-34242d346eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:47.787109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057b32a-edf5-418d-b892-34242d346eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:47.787383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057b32a-edf5-418d-b892-34242d346eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:47.796192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057b32a-edf5-418d-b892-34242d346eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:32:47.797607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057b32a-edf5-418d-b892-34242d346eb7 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:32:47.811790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 785/1533] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:32:51.480165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552c8d7-bc12-4bf3-8d6d-0fd122aa52d8 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:51.480744 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552c8d7-bc12-4bf3-8d6d-0fd122aa52d8 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:51.480744 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552c8d7-bc12-4bf3-8d6d-0fd122aa52d8 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:51.482081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 749/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:32:51.487546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a573ed7-466f-4821-8321-7b923c5c46b4 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:51.488015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a573ed7-466f-4821-8321-7b923c5c46b4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:51.488124 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a573ed7-466f-4821-8321-7b923c5c46b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:51.506577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2a573ed7-466f-4821-8321-7b923c5c46b4 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:32:51.507813 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2a573ed7-466f-4821-8321-7b923c5c46b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:32:51.515616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 786/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:32:51.782987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552c8d7-bc12-4bf3-8d6d-0fd122aa52d8 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:32:51.784676 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-2552c8d7-bc12-4bf3-8d6d-0fd122aa52d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:32:51.841080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552c8d7-bc12-4bf3-8d6d-0fd122aa52d8 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:32:51.844874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc4b39-be0d-4701-84b2-5572229ed1e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:32:51.845520 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc4b39-be0d-4701-84b2-5572229ed1e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:51.845802 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc4b39-be0d-4701-84b2-5572229ed1e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:51.846077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc4b39-be0d-4701-84b2-5572229ed1e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:51.854877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc4b39-be0d-4701-84b2-5572229ed1e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:32:51.856339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc4b39-be0d-4701-84b2-5572229ed1e7 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:32:51.866027 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 750/1536] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:32:54.035547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1e974-68db-4c1c-846b-2c685c5206d8 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:54.036078 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1e974-68db-4c1c-846b-2c685c5206d8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:54.036078 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1e974-68db-4c1c-846b-2c685c5206d8 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:54.037412 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 787/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 10:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:32:54.042428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57c829-9122-4b3d-a0f0-fa5ab2d0c72d None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:54.042879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57c829-9122-4b3d-a0f0-fa5ab2d0c72d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:54.042980 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57c829-9122-4b3d-a0f0-fa5ab2d0c72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:54.062318 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-2b57c829-9122-4b3d-a0f0-fa5ab2d0c72d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:32:54.063555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-2b57c829-9122-4b3d-a0f0-fa5ab2d0c72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:32:54.071392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 751/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 10:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:32:54.340103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1e974-68db-4c1c-846b-2c685c5206d8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:32:54.341776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-21d1e974-68db-4c1c-846b-2c685c5206d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:32:54.355196 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1e974-68db-4c1c-846b-2c685c5206d8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:32:54.358785 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57b29b-efb2-44b2-ae8d-3c32f3c5e621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:32:54.359409 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57b29b-efb2-44b2-ae8d-3c32f3c5e621 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:32:54.359714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57b29b-efb2-44b2-ae8d-3c32f3c5e621 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:32:54.359983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57b29b-efb2-44b2-ae8d-3c32f3c5e621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:32:54.369411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57b29b-efb2-44b2-ae8d-3c32f3c5e621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:32:54.370823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57b29b-efb2-44b2-ae8d-3c32f3c5e621 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:32:54.380324 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 788/1539] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:33:04.055721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=32 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:33:04.376208 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=33 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:34.044297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065f05f-31c3-400b-a118-51add055394d None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.044973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065f05f-31c3-400b-a118-51add055394d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.044973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065f05f-31c3-400b-a118-51add055394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.072104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-5065f05f-31c3-400b-a118-51add055394d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.073835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-5065f05f-31c3-400b-a118-51add055394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.082715 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 752/1540] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.094831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be582672-d604-40a6-a8f4-bbdeac075e56 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.096029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be582672-d604-40a6-a8f4-bbdeac075e56 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.096528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be582672-d604-40a6-a8f4-bbdeac075e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.099651 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4cf8-53c8-4357-9ce9-129a632898d0 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.100257 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4cf8-53c8-4357-9ce9-129a632898d0 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.100765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4cf8-53c8-4357-9ce9-129a632898d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.127499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-be582672-d604-40a6-a8f4-bbdeac075e56 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.127769 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-be582672-d604-40a6-a8f4-bbdeac075e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.135766 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-6d2f4cf8-53c8-4357-9ce9-129a632898d0 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.137618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6d2f4cf8-53c8-4357-9ce9-129a632898d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.146265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 789/1541] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.152486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be582672-d604-40a6-a8f4-bbdeac075e56 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.166558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 753/1542] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.171931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be582672-d604-40a6-a8f4-bbdeac075e56 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.176774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9b48-84fe-4fc2-b229-656ab102f946 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.177448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9b48-84fe-4fc2-b229-656ab102f946 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.177943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9b48-84fe-4fc2-b229-656ab102f946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.183499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0ff9c-ae82-45da-b40c-a41528437442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.183499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0ff9c-ae82-45da-b40c-a41528437442 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.183499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0ff9c-ae82-45da-b40c-a41528437442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.183499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0ff9c-ae82-45da-b40c-a41528437442 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.183981 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0ff9c-ae82-45da-b40c-a41528437442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:34:34.183981 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0ff9c-ae82-45da-b40c-a41528437442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.184330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: WARNING py.warnings [None req-dab0ff9c-ae82-45da-b40c-a41528437442 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:34:34.184330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: warnings.warn(msg) Jun 15 10:34:34.184330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: Jun 15 10:34:34.185337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0ff9c-ae82-45da-b40c-a41528437442 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.210986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 790/1543] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:34:34.219507 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0ff9c-ae82-45da-b40c-a41528437442 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.228946 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-1e5a9b48-84fe-4fc2-b229-656ab102f946 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.230699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1e5a9b48-84fe-4fc2-b229-656ab102f946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.235042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0ff9c-ae82-45da-b40c-a41528437442 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.243611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ff147-f2e9-42d5-8d53-91be8f4c6f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.244378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ff147-f2e9-42d5-8d53-91be8f4c6f32 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.244675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ff147-f2e9-42d5-8d53-91be8f4c6f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.244947 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ff147-f2e9-42d5-8d53-91be8f4c6f32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.246084 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ff147-f2e9-42d5-8d53-91be8f4c6f32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.247756 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ff147-f2e9-42d5-8d53-91be8f4c6f32 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.257578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 754/1544] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:34:34.262456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a9b48-84fe-4fc2-b229-656ab102f946 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.278134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a9b48-84fe-4fc2-b229-656ab102f946 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.288840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146d5c7-de24-4fc7-97d1-7178da472bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.290789 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146d5c7-de24-4fc7-97d1-7178da472bde admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.291308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146d5c7-de24-4fc7-97d1-7178da472bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.291892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146d5c7-de24-4fc7-97d1-7178da472bde admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.292874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146d5c7-de24-4fc7-97d1-7178da472bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:34:34.296001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146d5c7-de24-4fc7-97d1-7178da472bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.298557 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146d5c7-de24-4fc7-97d1-7178da472bde admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.319205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 791/1545] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:34:34.320789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08866a4b-1f3b-4dda-b74a-2b63cc6009e5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.321120 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08866a4b-1f3b-4dda-b74a-2b63cc6009e5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.321408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08866a4b-1f3b-4dda-b74a-2b63cc6009e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.330191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 755/1546] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:34:34.331135 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146d5c7-de24-4fc7-97d1-7178da472bde admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.356205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146d5c7-de24-4fc7-97d1-7178da472bde admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.371418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-08866a4b-1f3b-4dda-b74a-2b63cc6009e5 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.377467 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-08866a4b-1f3b-4dda-b74a-2b63cc6009e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.453486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce6fd5-7997-4bb4-9f74-dc5d426f7302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.454617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce6fd5-7997-4bb4-9f74-dc5d426f7302 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.455143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce6fd5-7997-4bb4-9f74-dc5d426f7302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.455699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce6fd5-7997-4bb4-9f74-dc5d426f7302 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.456687 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce6fd5-7997-4bb4-9f74-dc5d426f7302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.458901 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce6fd5-7997-4bb4-9f74-dc5d426f7302 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.473700 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 792/1547] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.474553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08866a4b-1f3b-4dda-b74a-2b63cc6009e5 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.486947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 756/1548] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:34.487175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08866a4b-1f3b-4dda-b74a-2b63cc6009e5 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.488883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728518cd-8d93-4db7-903c-9ac7e18bf2aa None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.489240 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728518cd-8d93-4db7-903c-9ac7e18bf2aa None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.489601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728518cd-8d93-4db7-903c-9ac7e18bf2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.495143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c586b25-3eb8-47bd-984b-b125cd7911af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.495860 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c586b25-3eb8-47bd-984b-b125cd7911af admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.496139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c586b25-3eb8-47bd-984b-b125cd7911af admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.496450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c586b25-3eb8-47bd-984b-b125cd7911af admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.497138 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c586b25-3eb8-47bd-984b-b125cd7911af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.499301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c586b25-3eb8-47bd-984b-b125cd7911af admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.509459 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-728518cd-8d93-4db7-903c-9ac7e18bf2aa None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.510731 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-728518cd-8d93-4db7-903c-9ac7e18bf2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.519056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 757/1549] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.520289 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2268df-6581-4f22-bda6-1715b7dd429b None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.520583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2268df-6581-4f22-bda6-1715b7dd429b None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.520861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2268df-6581-4f22-bda6-1715b7dd429b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.530846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 793/1550] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:34.532386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebedfc-e305-4ab5-ac31-1b425b7216cc None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.532676 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebedfc-e305-4ab5-ac31-1b425b7216cc None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.532944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebedfc-e305-4ab5-ac31-1b425b7216cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.538833 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-5c2268df-6581-4f22-bda6-1715b7dd429b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.540139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-5c2268df-6581-4f22-bda6-1715b7dd429b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.551368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b0ebedfc-e305-4ab5-ac31-1b425b7216cc None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.552588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b0ebedfc-e305-4ab5-ac31-1b425b7216cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.598484 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 758/1551] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.599810 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed374c4-ac36-4389-be7e-8ab7bcd16ca4 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.600099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed374c4-ac36-4389-be7e-8ab7bcd16ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.600384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed374c4-ac36-4389-be7e-8ab7bcd16ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.613895 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 794/1552] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.615192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c52ee-13be-4014-9a21-839858f871f8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.615498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c52ee-13be-4014-9a21-839858f871f8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.615781 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c52ee-13be-4014-9a21-839858f871f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.620597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-aed374c4-ac36-4389-be7e-8ab7bcd16ca4 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.621797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-aed374c4-ac36-4389-be7e-8ab7bcd16ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.630759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 759/1553] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.632505 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fff6d-7b6e-4fcd-b454-68d06e39b44f None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.632862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fff6d-7b6e-4fcd-b454-68d06e39b44f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.633689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fff6d-7b6e-4fcd-b454-68d06e39b44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.642602 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-115c52ee-13be-4014-9a21-839858f871f8 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.644373 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-115c52ee-13be-4014-9a21-839858f871f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.652716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-1c4fff6d-7b6e-4fcd-b454-68d06e39b44f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.653303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 795/1554] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.653979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c52ee-13be-4014-9a21-839858f871f8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.654100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1c4fff6d-7b6e-4fcd-b454-68d06e39b44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.663507 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 760/1555] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.663700 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411b2f0-da3e-4d8f-afb5-0007948575bb None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.663941 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411b2f0-da3e-4d8f-afb5-0007948575bb None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.664084 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c52ee-13be-4014-9a21-839858f871f8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.664182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411b2f0-da3e-4d8f-afb5-0007948575bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.675131 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8e70d-6d82-4dab-ae32-2d0482c86fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.675981 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8e70d-6d82-4dab-ae32-2d0482c86fad admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.676761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8e70d-6d82-4dab-ae32-2d0482c86fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.676761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8e70d-6d82-4dab-ae32-2d0482c86fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.677497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8e70d-6d82-4dab-ae32-2d0482c86fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.679500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8e70d-6d82-4dab-ae32-2d0482c86fad admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.685030 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-7411b2f0-da3e-4d8f-afb5-0007948575bb None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.686256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7411b2f0-da3e-4d8f-afb5-0007948575bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.691710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 796/1556] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:34.692515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8e70d-6d82-4dab-ae32-2d0482c86fad admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.698173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 761/1557] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.698173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d569b0f-1b34-454d-a89b-696b1a5b636a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.698173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d569b0f-1b34-454d-a89b-696b1a5b636a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.698173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d569b0f-1b34-454d-a89b-696b1a5b636a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.703860 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8e70d-6d82-4dab-ae32-2d0482c86fad admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.708460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951924e-001c-4a4a-a145-7830a1ce26f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.709112 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951924e-001c-4a4a-a145-7830a1ce26f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.709388 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951924e-001c-4a4a-a145-7830a1ce26f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.709656 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951924e-001c-4a4a-a145-7830a1ce26f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.710328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951924e-001c-4a4a-a145-7830a1ce26f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.711361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: WARNING py.warnings [None req-4951924e-001c-4a4a-a145-7830a1ce26f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:34:34.711361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: warnings.warn(msg) Jun 15 10:34:34.711361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: Jun 15 10:34:34.712591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951924e-001c-4a4a-a145-7830a1ce26f9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.718002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-7d569b0f-1b34-454d-a89b-696b1a5b636a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.719200 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7d569b0f-1b34-454d-a89b-696b1a5b636a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.728501 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 762/1558] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.729930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede38a1-3d41-4056-b280-986003663f4b None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.730221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede38a1-3d41-4056-b280-986003663f4b None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.730497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede38a1-3d41-4056-b280-986003663f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.737130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 797/1559] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:34.739442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9115b-f9a9-4c69-9494-6a48f134709c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.739828 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9115b-f9a9-4c69-9494-6a48f134709c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.740384 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9115b-f9a9-4c69-9494-6a48f134709c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.747581 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:34.749807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-4ede38a1-3d41-4056-b280-986003663f4b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.751104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4ede38a1-3d41-4056-b280-986003663f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.759518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 763/1560] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.760840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-aef9115b-f9a9-4c69-9494-6a48f134709c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.762011 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-aef9115b-f9a9-4c69-9494-6a48f134709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.764022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede38a1-3d41-4056-b280-986003663f4b None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.770179 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 798/1561] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.771243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e7897-f930-4ccc-a977-27c06fb19e85 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.771623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e7897-f930-4ccc-a977-27c06fb19e85 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.771951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e7897-f930-4ccc-a977-27c06fb19e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.773449 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede38a1-3d41-4056-b280-986003663f4b None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.777986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4742f-1adf-4df2-a023-4385c0ea32d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.778631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4742f-1adf-4df2-a023-4385c0ea32d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.778916 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4742f-1adf-4df2-a023-4385c0ea32d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.780042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4742f-1adf-4df2-a023-4385c0ea32d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.780042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4742f-1adf-4df2-a023-4385c0ea32d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:34:34.780286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4742f-1adf-4df2-a023-4385c0ea32d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.781843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4742f-1adf-4df2-a023-4385c0ea32d5 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.791267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b17e7897-f930-4ccc-a977-27c06fb19e85 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:34.792480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b17e7897-f930-4ccc-a977-27c06fb19e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:34.794062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 764/1562] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:34:34.798038 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4742f-1adf-4df2-a023-4385c0ea32d5 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.803530 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 799/1563] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:34.804293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e7897-f930-4ccc-a977-27c06fb19e85 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.808774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4742f-1adf-4df2-a023-4385c0ea32d5 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.809866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:34.815699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcc7da-635b-4884-81d3-cced191642f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.816241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e7897-f930-4ccc-a977-27c06fb19e85 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.816499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc7da-635b-4884-81d3-cced191642f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.817110 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc7da-635b-4884-81d3-cced191642f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.817690 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcc7da-635b-4884-81d3-cced191642f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.818456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcc7da-635b-4884-81d3-cced191642f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.820425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdcc7da-635b-4884-81d3-cced191642f8 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.821830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33eef7-cd48-404a-a241-d587f22cdeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.822492 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33eef7-cd48-404a-a241-d587f22cdeef admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.822825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33eef7-cd48-404a-a241-d587f22cdeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.823109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33eef7-cd48-404a-a241-d587f22cdeef admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.823864 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33eef7-cd48-404a-a241-d587f22cdeef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:34:34.824173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33eef7-cd48-404a-a241-d587f22cdeef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.825753 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33eef7-cd48-404a-a241-d587f22cdeef admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.831947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 765/1564] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:34.832742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcc7da-635b-4884-81d3-cced191642f8 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.840723 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 800/1565] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:34:34.841473 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33eef7-cd48-404a-a241-d587f22cdeef admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.842939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcc7da-635b-4884-81d3-cced191642f8 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.848149 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210ca8a-c4fd-4468-ba17-1711f7692e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.848814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210ca8a-c4fd-4468-ba17-1711f7692e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.849098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210ca8a-c4fd-4468-ba17-1711f7692e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.849372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210ca8a-c4fd-4468-ba17-1711f7692e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.850099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210ca8a-c4fd-4468-ba17-1711f7692e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:34:34.850403 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210ca8a-c4fd-4468-ba17-1711f7692e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.852546 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210ca8a-c4fd-4468-ba17-1711f7692e89 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.853309 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33eef7-cd48-404a-a241-d587f22cdeef admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.857931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09c52f-3c6f-4d0d-9463-4335ab4e7bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.858576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c52f-3c6f-4d0d-9463-4335ab4e7bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.858858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c52f-3c6f-4d0d-9463-4335ab4e7bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.859134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09c52f-3c6f-4d0d-9463-4335ab4e7bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.859883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09c52f-3c6f-4d0d-9463-4335ab4e7bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.861455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09c52f-3c6f-4d0d-9463-4335ab4e7bd6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.864346 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 766/1566] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:34:34.865206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210ca8a-c4fd-4468-ba17-1711f7692e89 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.875944 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210ca8a-c4fd-4468-ba17-1711f7692e89 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.879610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 801/1567] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:34.879610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09c52f-3c6f-4d0d-9463-4335ab4e7bd6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.880667 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732c100-16b4-413a-a270-4d50640fe516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.881315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732c100-16b4-413a-a270-4d50640fe516 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.881601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732c100-16b4-413a-a270-4d50640fe516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.881900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732c100-16b4-413a-a270-4d50640fe516 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.882624 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732c100-16b4-413a-a270-4d50640fe516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:34:34.882936 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732c100-16b4-413a-a270-4d50640fe516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.884584 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732c100-16b4-413a-a270-4d50640fe516 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.887889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09c52f-3c6f-4d0d-9463-4335ab4e7bd6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.892451 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e3f45-18b7-4ea7-b070-298b02aaa944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.893085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e3f45-18b7-4ea7-b070-298b02aaa944 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.893400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e3f45-18b7-4ea7-b070-298b02aaa944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.893673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e3f45-18b7-4ea7-b070-298b02aaa944 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.894389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e3f45-18b7-4ea7-b070-298b02aaa944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:34:34.894698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e3f45-18b7-4ea7-b070-298b02aaa944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.896294 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e3f45-18b7-4ea7-b070-298b02aaa944 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.902144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 767/1568] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:34:34.902144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732c100-16b4-413a-a270-4d50640fe516 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.908544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732c100-16b4-413a-a270-4d50640fe516 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.913070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 802/1569] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:34:34.913189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273211a4-0f9a-4dd3-9d7f-e9cfafeeac0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.913832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e3f45-18b7-4ea7-b070-298b02aaa944 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.913944 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273211a4-0f9a-4dd3-9d7f-e9cfafeeac0e admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.914213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273211a4-0f9a-4dd3-9d7f-e9cfafeeac0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.915055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273211a4-0f9a-4dd3-9d7f-e9cfafeeac0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.915801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273211a4-0f9a-4dd3-9d7f-e9cfafeeac0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.916821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: WARNING py.warnings [None req-273211a4-0f9a-4dd3-9d7f-e9cfafeeac0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:34:34.916821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: warnings.warn(msg) Jun 15 10:34:34.916821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: Jun 15 10:34:34.917993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273211a4-0f9a-4dd3-9d7f-e9cfafeeac0e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.925350 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e3f45-18b7-4ea7-b070-298b02aaa944 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:34.931246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8c7f3-f72b-4d3a-b645-1a095683675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:34.931921 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8c7f3-f72b-4d3a-b645-1a095683675e admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:34.932202 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8c7f3-f72b-4d3a-b645-1a095683675e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:34.932479 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8c7f3-f72b-4d3a-b645-1a095683675e admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:34.933203 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8c7f3-f72b-4d3a-b645-1a095683675e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:34:34.933558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8c7f3-f72b-4d3a-b645-1a095683675e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:34.935201 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8c7f3-f72b-4d3a-b645-1a095683675e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:34.948597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 768/1570] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:34.948597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273211a4-0f9a-4dd3-9d7f-e9cfafeeac0e admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.958068 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 803/1571] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:34:34.958068 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8c7f3-f72b-4d3a-b645-1a095683675e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:34.966599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8c7f3-f72b-4d3a-b645-1a095683675e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.013220 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273211a4-0f9a-4dd3-9d7f-e9cfafeeac0e admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.018258 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf0653-6e0e-4c96-8a76-a32d0831ffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.019309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf0653-6e0e-4c96-8a76-a32d0831ffbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.019634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf0653-6e0e-4c96-8a76-a32d0831ffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.019909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf0653-6e0e-4c96-8a76-a32d0831ffbc admin admin] PATH_INFO: `/v3/projects/bcd2335cb8ac49098e292f17a835eac3/users/24d4ac4faaed44cbb9c20a5ae20a356a/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.030959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9ff7f-e133-4397-ad32-9a7934a8db89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.031664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9ff7f-e133-4397-ad32-9a7934a8db89 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.031951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9ff7f-e133-4397-ad32-9a7934a8db89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.032235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9ff7f-e133-4397-ad32-9a7934a8db89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.032923 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9ff7f-e133-4397-ad32-9a7934a8db89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.034821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9ff7f-e133-4397-ad32-9a7934a8db89 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.035264 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf0653-6e0e-4c96-8a76-a32d0831ffbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd2335cb8ac49098e292f17a835eac3, user_id=24d4ac4faaed44cbb9c20a5ae20a356a, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.036465 dv-cinder-843493-2-smb devstack@keystone.service[80118]: WARNING py.warnings [None req-e7cf0653-6e0e-4c96-8a76-a32d0831ffbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:34:35.036465 dv-cinder-843493-2-smb devstack@keystone.service[80118]: warnings.warn(msg) Jun 15 10:34:35.036465 dv-cinder-843493-2-smb devstack@keystone.service[80118]: Jun 15 10:34:35.038629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf0653-6e0e-4c96-8a76-a32d0831ffbc admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.056908 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 769/1572] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:34 2022] PUT /identity/v3/projects/bcd2335cb8ac49098e292f17a835eac3/users/24d4ac4faaed44cbb9c20a5ae20a356a/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:35.057982 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf0653-6e0e-4c96-8a76-a32d0831ffbc admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.060758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 804/1573] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:34 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:35.061575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9ff7f-e133-4397-ad32-9a7934a8db89 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.121725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf0653-6e0e-4c96-8a76-a32d0831ffbc admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.133976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9ff7f-e133-4397-ad32-9a7934a8db89 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.138891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a6c70-0077-448f-83ce-0bdcb76d9f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.139645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a6c70-0077-448f-83ce-0bdcb76d9f65 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.139928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a6c70-0077-448f-83ce-0bdcb76d9f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.140233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a6c70-0077-448f-83ce-0bdcb76d9f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.141109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a6c70-0077-448f-83ce-0bdcb76d9f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.142741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a6c70-0077-448f-83ce-0bdcb76d9f65 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.153940 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 805/1574] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:35.154758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a6c70-0077-448f-83ce-0bdcb76d9f65 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.158142 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:35.165603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a6c70-0077-448f-83ce-0bdcb76d9f65 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.170062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faaa74-bb60-44df-b94c-cca43a8364ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.170711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faaa74-bb60-44df-b94c-cca43a8364ce admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.170995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faaa74-bb60-44df-b94c-cca43a8364ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.171269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faaa74-bb60-44df-b94c-cca43a8364ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.172110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faaa74-bb60-44df-b94c-cca43a8364ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.174007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faaa74-bb60-44df-b94c-cca43a8364ce admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.184042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d123f-2f42-4e13-9225-0890f5e71181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.184705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d123f-2f42-4e13-9225-0890f5e71181 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.184984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d123f-2f42-4e13-9225-0890f5e71181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.185253 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d123f-2f42-4e13-9225-0890f5e71181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.185949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d123f-2f42-4e13-9225-0890f5e71181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.187920 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d123f-2f42-4e13-9225-0890f5e71181 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.193728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:35.203512 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 806/1575] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:35 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:35.206916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faaa74-bb60-44df-b94c-cca43a8364ce admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.214860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 770/1576] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:35 2022] POST /identity/v3/projects => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:35.215942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d123f-2f42-4e13-9225-0890f5e71181 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.272654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faaa74-bb60-44df-b94c-cca43a8364ce admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.275666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d123f-2f42-4e13-9225-0890f5e71181 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.277777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97b4d0-7ede-4ca6-9b0c-34d22737e14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.278430 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97b4d0-7ede-4ca6-9b0c-34d22737e14b admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.278708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97b4d0-7ede-4ca6-9b0c-34d22737e14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.278980 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97b4d0-7ede-4ca6-9b0c-34d22737e14b admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.279691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97b4d0-7ede-4ca6-9b0c-34d22737e14b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.280692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e2e3d-a100-481e-93ee-dd0af605f37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.281370 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2e3d-a100-481e-93ee-dd0af605f37d admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.281583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97b4d0-7ede-4ca6-9b0c-34d22737e14b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.281692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2e3d-a100-481e-93ee-dd0af605f37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.281925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2e3d-a100-481e-93ee-dd0af605f37d admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.282710 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e2e3d-a100-481e-93ee-dd0af605f37d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.284820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e2e3d-a100-481e-93ee-dd0af605f37d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.306195 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 771/1577] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:35 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:35.307059 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e2e3d-a100-481e-93ee-dd0af605f37d admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.308228 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 807/1578] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:35 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:35.309960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1465d17-fcd4-466b-bd7c-e2ded1ecdfca None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.310250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1465d17-fcd4-466b-bd7c-e2ded1ecdfca None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.310526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1465d17-fcd4-466b-bd7c-e2ded1ecdfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.317643 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e2e3d-a100-481e-93ee-dd0af605f37d admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.328665 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b1465d17-fcd4-466b-bd7c-e2ded1ecdfca None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:35.329886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b1465d17-fcd4-466b-bd7c-e2ded1ecdfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:35.374193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38377d9-3463-4591-b4e4-04de3cc98048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.374886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38377d9-3463-4591-b4e4-04de3cc98048 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.375167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38377d9-3463-4591-b4e4-04de3cc98048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.375448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38377d9-3463-4591-b4e4-04de3cc98048 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.376161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38377d9-3463-4591-b4e4-04de3cc98048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.378073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38377d9-3463-4591-b4e4-04de3cc98048 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.391861 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 808/1579] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:35.392515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1465d17-fcd4-466b-bd7c-e2ded1ecdfca None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.404034 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1465d17-fcd4-466b-bd7c-e2ded1ecdfca None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.408371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 772/1580] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:35 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:35.409039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38377d9-3463-4591-b4e4-04de3cc98048 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.409355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97b688-110d-419b-b7e4-edb6f6fd6ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.410054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97b688-110d-419b-b7e4-edb6f6fd6ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.410439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97b688-110d-419b-b7e4-edb6f6fd6ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.410896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97b688-110d-419b-b7e4-edb6f6fd6ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.411875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97b688-110d-419b-b7e4-edb6f6fd6ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.414240 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97b688-110d-419b-b7e4-edb6f6fd6ec8 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.435164 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 809/1581] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:35 2022] POST /identity/v3/users => generated 286 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:35.435990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97b688-110d-419b-b7e4-edb6f6fd6ec8 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.447107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97b688-110d-419b-b7e4-edb6f6fd6ec8 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.447707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:35.474906 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38377d9-3463-4591-b4e4-04de3cc98048 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.480181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6b21c-a973-42ac-904e-05f00c2d410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.481069 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6b21c-a973-42ac-904e-05f00c2d410c admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.481347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6b21c-a973-42ac-904e-05f00c2d410c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.481620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6b21c-a973-42ac-904e-05f00c2d410c admin admin] PATH_INFO: `/v3/projects/6a78b477a6324a1781eecb5c90b64915/users/6c036627244c407488b4422dfba275d7/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.495751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6b21c-a973-42ac-904e-05f00c2d410c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a78b477a6324a1781eecb5c90b64915, user_id=6c036627244c407488b4422dfba275d7, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.498406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6b21c-a973-42ac-904e-05f00c2d410c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.508842 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e340a0f-66b5-40bf-8303-e10fb8c63e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.509587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e340a0f-66b5-40bf-8303-e10fb8c63e6b admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.509936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e340a0f-66b5-40bf-8303-e10fb8c63e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.510278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e340a0f-66b5-40bf-8303-e10fb8c63e6b admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.511027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e340a0f-66b5-40bf-8303-e10fb8c63e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.512097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 773/1582] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:35 2022] PUT /identity/v3/projects/6a78b477a6324a1781eecb5c90b64915/users/6c036627244c407488b4422dfba275d7/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:35.512715 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6b21c-a973-42ac-904e-05f00c2d410c admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.513266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e340a0f-66b5-40bf-8303-e10fb8c63e6b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.529779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:35.544538 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 810/1583] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:35 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:35.544538 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e340a0f-66b5-40bf-8303-e10fb8c63e6b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.553262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e340a0f-66b5-40bf-8303-e10fb8c63e6b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.583989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6b21c-a973-42ac-904e-05f00c2d410c admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.589212 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a4ef5-37ee-4ec3-ba29-090464cb18ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.590057 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4ef5-37ee-4ec3-ba29-090464cb18ab admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.590442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4ef5-37ee-4ec3-ba29-090464cb18ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.590745 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4ef5-37ee-4ec3-ba29-090464cb18ab admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.591434 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a4ef5-37ee-4ec3-ba29-090464cb18ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.593399 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a4ef5-37ee-4ec3-ba29-090464cb18ab admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.609676 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7804c3-b45e-484d-8056-f23feced8249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.610442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7804c3-b45e-484d-8056-f23feced8249 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.610724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7804c3-b45e-484d-8056-f23feced8249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.610993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7804c3-b45e-484d-8056-f23feced8249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.611739 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7804c3-b45e-484d-8056-f23feced8249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.613311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7804c3-b45e-484d-8056-f23feced8249 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.614386 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 774/1584] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:35 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:35.614995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a4ef5-37ee-4ec3-ba29-090464cb18ab admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.625515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a4ef5-37ee-4ec3-ba29-090464cb18ab admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.627239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 811/1585] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:35.628089 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7804c3-b45e-484d-8056-f23feced8249 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.630335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48196941-ad6c-4da2-817e-7e9de5a0faca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.631034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48196941-ad6c-4da2-817e-7e9de5a0faca admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.631317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48196941-ad6c-4da2-817e-7e9de5a0faca admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.631626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48196941-ad6c-4da2-817e-7e9de5a0faca admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.632314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48196941-ad6c-4da2-817e-7e9de5a0faca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.634759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48196941-ad6c-4da2-817e-7e9de5a0faca admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.656182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 775/1586] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:35 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:35.660209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48196941-ad6c-4da2-817e-7e9de5a0faca admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.670152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48196941-ad6c-4da2-817e-7e9de5a0faca admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.674865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627068b-adc6-4926-ac44-ff80bc2bc624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.675566 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627068b-adc6-4926-ac44-ff80bc2bc624 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.675873 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627068b-adc6-4926-ac44-ff80bc2bc624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.676166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627068b-adc6-4926-ac44-ff80bc2bc624 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.676839 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627068b-adc6-4926-ac44-ff80bc2bc624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.678738 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627068b-adc6-4926-ac44-ff80bc2bc624 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.690858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7804c3-b45e-484d-8056-f23feced8249 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.694882 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6565eb-5b26-46d7-b8da-f293e2d99327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.696101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6565eb-5b26-46d7-b8da-f293e2d99327 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.696394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6565eb-5b26-46d7-b8da-f293e2d99327 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.696671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6565eb-5b26-46d7-b8da-f293e2d99327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.700512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 776/1587] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:35 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:35.703556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627068b-adc6-4926-ac44-ff80bc2bc624 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.706473 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6565eb-5b26-46d7-b8da-f293e2d99327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.707953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6565eb-5b26-46d7-b8da-f293e2d99327 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.713372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627068b-adc6-4926-ac44-ff80bc2bc624 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.718336 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 812/1588] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:35.718479 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6db67a-9289-414b-add0-f9d8af275020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.719090 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db67a-9289-414b-add0-f9d8af275020 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.719371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db67a-9289-414b-add0-f9d8af275020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.719644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b00529-bfbe-4044-8156-283df4b72ec0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.719788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6db67a-9289-414b-add0-f9d8af275020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.719939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b00529-bfbe-4044-8156-283df4b72ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.720214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b00529-bfbe-4044-8156-283df4b72ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.720378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6db67a-9289-414b-add0-f9d8af275020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.721963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6db67a-9289-414b-add0-f9d8af275020 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.735800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 777/1589] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:35.735800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6db67a-9289-414b-add0-f9d8af275020 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.746975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6db67a-9289-414b-add0-f9d8af275020 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.749442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b8b00529-bfbe-4044-8156-283df4b72ec0 None None] MFA Rules not processed for user `6c036627244c407488b4422dfba275d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:35.750751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b8b00529-bfbe-4044-8156-283df4b72ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:35.755803 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be96ad-111f-4e8e-82e2-52cca419cd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.756486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be96ad-111f-4e8e-82e2-52cca419cd50 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.757365 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be96ad-111f-4e8e-82e2-52cca419cd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.757733 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be96ad-111f-4e8e-82e2-52cca419cd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.759342 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be96ad-111f-4e8e-82e2-52cca419cd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.761177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be96ad-111f-4e8e-82e2-52cca419cd50 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.777329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 778/1590] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:35.777329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be96ad-111f-4e8e-82e2-52cca419cd50 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.786856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be96ad-111f-4e8e-82e2-52cca419cd50 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.792883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8209b-c660-4f4c-a2e7-2c43b0d5e060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.793753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8209b-c660-4f4c-a2e7-2c43b0d5e060 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.794082 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8209b-c660-4f4c-a2e7-2c43b0d5e060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.794302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8209b-c660-4f4c-a2e7-2c43b0d5e060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.795022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8209b-c660-4f4c-a2e7-2c43b0d5e060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.796824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8209b-c660-4f4c-a2e7-2c43b0d5e060 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.808329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 779/1591] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:35.809359 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8209b-c660-4f4c-a2e7-2c43b0d5e060 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.821946 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8209b-c660-4f4c-a2e7-2c43b0d5e060 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.827253 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb701fe-4e7d-4eec-80fb-e935fed0f70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.827982 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb701fe-4e7d-4eec-80fb-e935fed0f70a admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.828268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb701fe-4e7d-4eec-80fb-e935fed0f70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.828572 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb701fe-4e7d-4eec-80fb-e935fed0f70a admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.829337 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb701fe-4e7d-4eec-80fb-e935fed0f70a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.831236 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb701fe-4e7d-4eec-80fb-e935fed0f70a admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.836140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 813/1592] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:35.836140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b00529-bfbe-4044-8156-283df4b72ec0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.851812 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 780/1593] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:35.852026 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b00529-bfbe-4044-8156-283df4b72ec0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.852164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb701fe-4e7d-4eec-80fb-e935fed0f70a admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.856551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94949d45-5814-4f51-a335-03cd3f3b505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.857819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94949d45-5814-4f51-a335-03cd3f3b505e admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.857819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94949d45-5814-4f51-a335-03cd3f3b505e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.858247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94949d45-5814-4f51-a335-03cd3f3b505e admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.859603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94949d45-5814-4f51-a335-03cd3f3b505e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.861446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94949d45-5814-4f51-a335-03cd3f3b505e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.862658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb701fe-4e7d-4eec-80fb-e935fed0f70a admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.869279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c6d56-7038-4549-a4b7-1001be9fb023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.870206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c6d56-7038-4549-a4b7-1001be9fb023 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.870411 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c6d56-7038-4549-a4b7-1001be9fb023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.870794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c6d56-7038-4549-a4b7-1001be9fb023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.871660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c6d56-7038-4549-a4b7-1001be9fb023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.873421 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c6d56-7038-4549-a4b7-1001be9fb023 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.877394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 814/1594] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:35.877394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94949d45-5814-4f51-a335-03cd3f3b505e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.887117 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94949d45-5814-4f51-a335-03cd3f3b505e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.888563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 781/1595] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:35.889543 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c6d56-7038-4549-a4b7-1001be9fb023 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.892352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab692438-75a7-4ec7-be9c-f4c8083dd839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.893395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab692438-75a7-4ec7-be9c-f4c8083dd839 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.893395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab692438-75a7-4ec7-be9c-f4c8083dd839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.893633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab692438-75a7-4ec7-be9c-f4c8083dd839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.894330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab692438-75a7-4ec7-be9c-f4c8083dd839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.896249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab692438-75a7-4ec7-be9c-f4c8083dd839 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.900502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c6d56-7038-4549-a4b7-1001be9fb023 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.905758 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332c135-f1e8-428b-8a7e-995a3faada5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.906551 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332c135-f1e8-428b-8a7e-995a3faada5e admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.906940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332c135-f1e8-428b-8a7e-995a3faada5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.907423 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332c135-f1e8-428b-8a7e-995a3faada5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.908661 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332c135-f1e8-428b-8a7e-995a3faada5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.908782 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 815/1596] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:35.910581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332c135-f1e8-428b-8a7e-995a3faada5e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.912555 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab692438-75a7-4ec7-be9c-f4c8083dd839 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.918424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:35.922140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 782/1597] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:35.924953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab692438-75a7-4ec7-be9c-f4c8083dd839 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.926550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332c135-f1e8-428b-8a7e-995a3faada5e admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.934738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f95f06-1124-4069-b1b4-a0a2d436b8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.936294 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f95f06-1124-4069-b1b4-a0a2d436b8fb admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.936654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f95f06-1124-4069-b1b4-a0a2d436b8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.937034 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f95f06-1124-4069-b1b4-a0a2d436b8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.937905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f95f06-1124-4069-b1b4-a0a2d436b8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.939638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f95f06-1124-4069-b1b4-a0a2d436b8fb admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.940447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332c135-f1e8-428b-8a7e-995a3faada5e admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.946577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636b29c-42bd-4ba9-a752-965bf255aa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.947381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636b29c-42bd-4ba9-a752-965bf255aa5f admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.947790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636b29c-42bd-4ba9-a752-965bf255aa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.948867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636b29c-42bd-4ba9-a752-965bf255aa5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.948993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636b29c-42bd-4ba9-a752-965bf255aa5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.951390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636b29c-42bd-4ba9-a752-965bf255aa5f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:35.955230 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:35.955721 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 816/1598] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:35.956797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f95f06-1124-4069-b1b4-a0a2d436b8fb admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:35.967814 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f95f06-1124-4069-b1b4-a0a2d436b8fb admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:35.973255 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5fa2e-1a28-44d7-9316-16fec1a37a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:35.974146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5fa2e-1a28-44d7-9316-16fec1a37a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:35.974432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5fa2e-1a28-44d7-9316-16fec1a37a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:35.974706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5fa2e-1a28-44d7-9316-16fec1a37a70 admin admin] PATH_INFO: `/v3/projects/b41db46ea7f5484c84b35a033bc0406e/users/e1a8bd6de53c4c308de21fbb21e38062/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:35.991154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5fa2e-1a28-44d7-9316-16fec1a37a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41db46ea7f5484c84b35a033bc0406e, user_id=e1a8bd6de53c4c308de21fbb21e38062, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:35.994410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5fa2e-1a28-44d7-9316-16fec1a37a70 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:36.001031 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 783/1599] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:35 2022] POST /identity/v3/projects => generated 363 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:36.002927 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636b29c-42bd-4ba9-a752-965bf255aa5f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:36.020480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 817/1600] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:35 2022] PUT /identity/v3/projects/b41db46ea7f5484c84b35a033bc0406e/users/e1a8bd6de53c4c308de21fbb21e38062/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:36.021734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5fa2e-1a28-44d7-9316-16fec1a37a70 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:36.081194 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636b29c-42bd-4ba9-a752-965bf255aa5f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:36.100907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5fa2e-1a28-44d7-9316-16fec1a37a70 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:36.106591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dfc1d-e1ba-44e1-a910-9db6c852ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:36.107182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dfc1d-e1ba-44e1-a910-9db6c852ab88 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.107182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dfc1d-e1ba-44e1-a910-9db6c852ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.107449 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dfc1d-e1ba-44e1-a910-9db6c852ab88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.108207 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dfc1d-e1ba-44e1-a910-9db6c852ab88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:36.110082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dfc1d-e1ba-44e1-a910-9db6c852ab88 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:36.122887 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 818/1601] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:36.123746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dfc1d-e1ba-44e1-a910-9db6c852ab88 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:36.135408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dfc1d-e1ba-44e1-a910-9db6c852ab88 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:36.140459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0b24c-d7da-45de-8652-a26874a2a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:36.141381 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0b24c-d7da-45de-8652-a26874a2a60b admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.141668 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0b24c-d7da-45de-8652-a26874a2a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.142098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0b24c-d7da-45de-8652-a26874a2a60b admin admin] PATH_INFO: `/v3/projects/f17bc7b048134c308362f4cf8ae66a8e/users/b4510901d1994262b4255d4dcad78132/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.149973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c749dd5-3532-4f1f-a20f-ee8f45afb962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:36.150803 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c749dd5-3532-4f1f-a20f-ee8f45afb962 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.151433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c749dd5-3532-4f1f-a20f-ee8f45afb962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.151639 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c749dd5-3532-4f1f-a20f-ee8f45afb962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.152355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c749dd5-3532-4f1f-a20f-ee8f45afb962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:36.154091 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c749dd5-3532-4f1f-a20f-ee8f45afb962 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:36.158681 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0b24c-d7da-45de-8652-a26874a2a60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17bc7b048134c308362f4cf8ae66a8e, user_id=b4510901d1994262b4255d4dcad78132, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:36.161588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0b24c-d7da-45de-8652-a26874a2a60b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:36.168235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 784/1602] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:36.168235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c749dd5-3532-4f1f-a20f-ee8f45afb962 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:36.179413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c749dd5-3532-4f1f-a20f-ee8f45afb962 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:36.183561 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 819/1603] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:36 2022] PUT /identity/v3/projects/f17bc7b048134c308362f4cf8ae66a8e/users/b4510901d1994262b4255d4dcad78132/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:36.184528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0b24c-d7da-45de-8652-a26874a2a60b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:36.264973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca107a5-d531-4950-9e99-a3cfcd957608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:36.266097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca107a5-d531-4950-9e99-a3cfcd957608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.266837 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca107a5-d531-4950-9e99-a3cfcd957608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.266837 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca107a5-d531-4950-9e99-a3cfcd957608 admin admin] PATH_INFO: `/v3/projects/5143578952424a79b07f6a7468b528a3/users/76ccc16f729b4042916db8c1183d2379/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.271540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0b24c-d7da-45de-8652-a26874a2a60b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:36.276730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66734905-f3ab-43a4-99fa-1f5011950e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:36.277627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66734905-f3ab-43a4-99fa-1f5011950e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.277898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66734905-f3ab-43a4-99fa-1f5011950e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.278348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66734905-f3ab-43a4-99fa-1f5011950e4e admin admin] PATH_INFO: `/v3/projects/da5267ce7b2b457e87caf15c9b4c5fe4/users/be259bace6f54a38a2a633021c41cf9d/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.289958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca107a5-d531-4950-9e99-a3cfcd957608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5143578952424a79b07f6a7468b528a3, user_id=76ccc16f729b4042916db8c1183d2379, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:36.292796 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca107a5-d531-4950-9e99-a3cfcd957608 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:36.296857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66734905-f3ab-43a4-99fa-1f5011950e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5267ce7b2b457e87caf15c9b4c5fe4, user_id=be259bace6f54a38a2a633021c41cf9d, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:36.300518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66734905-f3ab-43a4-99fa-1f5011950e4e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:36.311727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 785/1604] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:36 2022] PUT /identity/v3/projects/5143578952424a79b07f6a7468b528a3/users/76ccc16f729b4042916db8c1183d2379/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:36.312575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca107a5-d531-4950-9e99-a3cfcd957608 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:36.319795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 820/1605] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:36 2022] PUT /identity/v3/projects/da5267ce7b2b457e87caf15c9b4c5fe4/users/be259bace6f54a38a2a633021c41cf9d/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:36.327643 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:36.330591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c05a2-ff4e-436c-b8f5-9657bfc0d063 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.331073 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c05a2-ff4e-436c-b8f5-9657bfc0d063 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.331449 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c05a2-ff4e-436c-b8f5-9657bfc0d063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.350694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6b5c05a2-ff4e-436c-b8f5-9657bfc0d063 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:36.352798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6b5c05a2-ff4e-436c-b8f5-9657bfc0d063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:36.372677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:36.386480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca107a5-d531-4950-9e99-a3cfcd957608 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:36.428097 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 821/1606] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:36.428597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c05a2-ff4e-436c-b8f5-9657bfc0d063 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:36.439771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c05a2-ff4e-436c-b8f5-9657bfc0d063 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:36.444916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcf72b-76c5-43c7-8628-fcc0666549a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:36.445969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcf72b-76c5-43c7-8628-fcc0666549a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.446255 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcf72b-76c5-43c7-8628-fcc0666549a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.446533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcf72b-76c5-43c7-8628-fcc0666549a1 admin admin] PATH_INFO: `/v3/projects/99b6dce74c1c4c7ea8af0682b9210350/users/abbeca853267434eb1d2fff664f32f41/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.452185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4e886-87ee-4397-b3a2-63d059b9fc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:36.453141 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4e886-87ee-4397-b3a2-63d059b9fc41 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.453483 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4e886-87ee-4397-b3a2-63d059b9fc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.453769 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4e886-87ee-4397-b3a2-63d059b9fc41 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.454471 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4e886-87ee-4397-b3a2-63d059b9fc41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:36.456661 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4e886-87ee-4397-b3a2-63d059b9fc41 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:36.481652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 786/1607] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:36 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:36.482502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4e886-87ee-4397-b3a2-63d059b9fc41 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:36.496160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4e886-87ee-4397-b3a2-63d059b9fc41 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:36.502536 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9542e49-46de-4a59-987c-1eccda2fe94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:36.503587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9542e49-46de-4a59-987c-1eccda2fe94b admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.503935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9542e49-46de-4a59-987c-1eccda2fe94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.504278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9542e49-46de-4a59-987c-1eccda2fe94b admin admin] PATH_INFO: `/v3/projects/017ac13361a94c03bcc32b791a3dde87/users/48b3782374554be9b0ae1e39a575b08f/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.522797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9542e49-46de-4a59-987c-1eccda2fe94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=017ac13361a94c03bcc32b791a3dde87, user_id=48b3782374554be9b0ae1e39a575b08f, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:36.526173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9542e49-46de-4a59-987c-1eccda2fe94b admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:36.544220 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 787/1608] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:36 2022] PUT /identity/v3/projects/017ac13361a94c03bcc32b791a3dde87/users/48b3782374554be9b0ae1e39a575b08f/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:36.545462 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74b15-4ea0-4730-8845-3daae5d1c943 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.545850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74b15-4ea0-4730-8845-3daae5d1c943 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.546195 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74b15-4ea0-4730-8845-3daae5d1c943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.587019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcf72b-76c5-43c7-8628-fcc0666549a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99b6dce74c1c4c7ea8af0682b9210350, user_id=abbeca853267434eb1d2fff664f32f41, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:36.589000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-b1f74b15-4ea0-4730-8845-3daae5d1c943 None None] MFA Rules not processed for user `b4510901d1994262b4255d4dcad78132`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:36.590317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b1f74b15-4ea0-4730-8845-3daae5d1c943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:36.593367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcf72b-76c5-43c7-8628-fcc0666549a1 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:36.616892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 822/1609] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:36 2022] PUT /identity/v3/projects/99b6dce74c1c4c7ea8af0682b9210350/users/abbeca853267434eb1d2fff664f32f41/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:36.618353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a4c2-2594-4d57-b1ad-f7ca9fb10142 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.618611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a4c2-2594-4d57-b1ad-f7ca9fb10142 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.618899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a4c2-2594-4d57-b1ad-f7ca9fb10142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.637541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1ce0a4c2-2594-4d57-b1ad-f7ca9fb10142 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:36.640231 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1ce0a4c2-2594-4d57-b1ad-f7ca9fb10142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:36.699177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 788/1610] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:36.700747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e72d84-2c44-44a0-9ac7-b84dd28ec5c9 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.701041 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e72d84-2c44-44a0-9ac7-b84dd28ec5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.701327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e72d84-2c44-44a0-9ac7-b84dd28ec5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.716804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 823/1611] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:36.717714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0a4c2-2594-4d57-b1ad-f7ca9fb10142 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:36.767023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:36.776104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-49e72d84-2c44-44a0-9ac7-b84dd28ec5c9 None None] MFA Rules not processed for user `be259bace6f54a38a2a633021c41cf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:36.778193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-49e72d84-2c44-44a0-9ac7-b84dd28ec5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:36.804478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0a4c2-2594-4d57-b1ad-f7ca9fb10142 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:36.808525 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e51c8-444c-412f-b953-d17e1eb07cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:36.809186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e51c8-444c-412f-b953-d17e1eb07cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.809467 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e51c8-444c-412f-b953-d17e1eb07cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.809742 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e51c8-444c-412f-b953-d17e1eb07cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.819713 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e51c8-444c-412f-b953-d17e1eb07cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:36.821219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e51c8-444c-412f-b953-d17e1eb07cf9 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:36.832834 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 824/1612] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:36.833562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e51c8-444c-412f-b953-d17e1eb07cf9 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:36.846661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e51c8-444c-412f-b953-d17e1eb07cf9 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:36.853562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87342-6233-409a-91de-d1a06cec7501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:36.854522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87342-6233-409a-91de-d1a06cec7501 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.854672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87342-6233-409a-91de-d1a06cec7501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.854893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87342-6233-409a-91de-d1a06cec7501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.855659 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d87342-6233-409a-91de-d1a06cec7501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:36.857263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d87342-6233-409a-91de-d1a06cec7501 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:36.868508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 825/1613] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:36.869833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61101e-3649-4f55-b0c3-a6b8fdfed4b5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.870129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61101e-3649-4f55-b0c3-a6b8fdfed4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.870568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61101e-3649-4f55-b0c3-a6b8fdfed4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.877176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 789/1614] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:36.878781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dbef7-91fc-4146-93ea-fad182c9780b None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.879165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dbef7-91fc-4146-93ea-fad182c9780b None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.879448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dbef7-91fc-4146-93ea-fad182c9780b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.901852 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-962dbef7-91fc-4146-93ea-fad182c9780b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:36.903498 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-962dbef7-91fc-4146-93ea-fad182c9780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:36.912610 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 790/1615] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:36.913323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2b61101e-3649-4f55-b0c3-a6b8fdfed4b5 None None] MFA Rules not processed for user `48b3782374554be9b0ae1e39a575b08f`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:36.913472 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dbef7-91fc-4146-93ea-fad182c9780b None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:36.915328 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-962dbef7-91fc-4146-93ea-fad182c9780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:36.915442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2b61101e-3649-4f55-b0c3-a6b8fdfed4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:36.937904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:36.938618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dbef7-91fc-4146-93ea-fad182c9780b None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:36.942970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5a5df-9468-447f-bb28-7ebe4de872b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:36.943929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5a5df-9468-447f-bb28-7ebe4de872b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.944384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5a5df-9468-447f-bb28-7ebe4de872b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.944966 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5a5df-9468-447f-bb28-7ebe4de872b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:36.958360 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5a5df-9468-447f-bb28-7ebe4de872b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:36.960317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5a5df-9468-447f-bb28-7ebe4de872b2 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:36.995707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 826/1616] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:36.997823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd8cf8-1f99-4686-b741-3c17da9b7542 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:36.997823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd8cf8-1f99-4686-b741-3c17da9b7542 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:36.999329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 791/1617] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:36.999494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd8cf8-1f99-4686-b741-3c17da9b7542 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:37.002011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5a5df-9468-447f-bb28-7ebe4de872b2 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:37.013572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 827/1618] 10.222.0.50 () {54 vars in 961 bytes} [Wed Jun 15 10:34:36 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:34:37.024302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd8cf8-1f99-4686-b741-3c17da9b7542 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:37.040939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5a5df-9468-447f-bb28-7ebe4de872b2 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:37.054651 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29031ab-3ba3-4c12-bbf5-6dc03d1dcf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:37.055897 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29031ab-3ba3-4c12-bbf5-6dc03d1dcf67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:37.056270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29031ab-3ba3-4c12-bbf5-6dc03d1dcf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:37.056502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29031ab-3ba3-4c12-bbf5-6dc03d1dcf67 admin admin] PATH_INFO: `/v3/projects/90fd212d54c34c7aa7cf6af177d7c260/users/07f7ce072fdc48fda560e8f37cfc7a65/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:37.102645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29031ab-3ba3-4c12-bbf5-6dc03d1dcf67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fd212d54c34c7aa7cf6af177d7c260, user_id=07f7ce072fdc48fda560e8f37cfc7a65, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:37.111977 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29031ab-3ba3-4c12-bbf5-6dc03d1dcf67 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:37.130217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd8cf8-1f99-4686-b741-3c17da9b7542 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:37.135627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05128877-695c-4be7-835c-e1d6f233716c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:37.136670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05128877-695c-4be7-835c-e1d6f233716c service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:37.137273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05128877-695c-4be7-835c-e1d6f233716c service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:37.137559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05128877-695c-4be7-835c-e1d6f233716c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:37.152529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05128877-695c-4be7-835c-e1d6f233716c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:37.154014 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05128877-695c-4be7-835c-e1d6f233716c service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:37.164083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 792/1619] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:36 2022] PUT /identity/v3/projects/90fd212d54c34c7aa7cf6af177d7c260/users/07f7ce072fdc48fda560e8f37cfc7a65/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:37.164083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29031ab-3ba3-4c12-bbf5-6dc03d1dcf67 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:37.180916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 828/1620] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:37.185223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dc2d8-a84f-4d23-a64c-0c2616145671 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:37.185481 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dc2d8-a84f-4d23-a64c-0c2616145671 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:37.185763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dc2d8-a84f-4d23-a64c-0c2616145671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:37.233953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5b6dc2d8-a84f-4d23-a64c-0c2616145671 None None] MFA Rules not processed for user `81e9805ec4c44cedb658b7becf768369`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:37.235908 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5b6dc2d8-a84f-4d23-a64c-0c2616145671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:37.295699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29031ab-3ba3-4c12-bbf5-6dc03d1dcf67 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:37.303865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd267740-d2cc-4b6e-a8b4-d17e7433e399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:37.304650 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd267740-d2cc-4b6e-a8b4-d17e7433e399 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:37.305071 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd267740-d2cc-4b6e-a8b4-d17e7433e399 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:37.305436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd267740-d2cc-4b6e-a8b4-d17e7433e399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:37.368267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 829/1621] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Jun 15 10:34:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:37.380882 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d7c58-7a14-4361-8988-edca5415b034 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:37.381053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d7c58-7a14-4361-8988-edca5415b034 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:37.381417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d7c58-7a14-4361-8988-edca5415b034 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:37.384337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 830/1622] 10.222.0.50 () {54 vars in 961 bytes} [Wed Jun 15 10:34:37 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:34:37.386114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d7c58-7a14-4361-8988-edca5415b034 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:37.448764 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd267740-d2cc-4b6e-a8b4-d17e7433e399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:37.450584 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd267740-d2cc-4b6e-a8b4-d17e7433e399 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:37.468697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 793/1623] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:37.469656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd267740-d2cc-4b6e-a8b4-d17e7433e399 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:37.498239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd267740-d2cc-4b6e-a8b4-d17e7433e399 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:37.515896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f64cd9-aa7d-4d1f-910d-4ebfb766f004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:37.516723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f64cd9-aa7d-4d1f-910d-4ebfb766f004 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:37.517084 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f64cd9-aa7d-4d1f-910d-4ebfb766f004 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:37.517556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f64cd9-aa7d-4d1f-910d-4ebfb766f004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:37.517890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:37.528008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:37.531208 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d7c58-7a14-4361-8988-edca5415b034 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:37.538983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7c935-654f-4d2c-ae1a-bce162204606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:37.540286 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7c935-654f-4d2c-ae1a-bce162204606 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:37.540560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7c935-654f-4d2c-ae1a-bce162204606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:37.540847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7c935-654f-4d2c-ae1a-bce162204606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:37.541756 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7c935-654f-4d2c-ae1a-bce162204606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:37.545597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7c935-654f-4d2c-ae1a-bce162204606 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:37.569471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 831/1624] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:37.581534 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79553fc6-b619-4353-977d-d6905d740623 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:37.581818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79553fc6-b619-4353-977d-d6905d740623 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:37.582100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79553fc6-b619-4353-977d-d6905d740623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:37.621596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-79553fc6-b619-4353-977d-d6905d740623 None None] MFA Rules not processed for user `81e9805ec4c44cedb658b7becf768369`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:37.622651 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-79553fc6-b619-4353-977d-d6905d740623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:37.647203 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 832/1625] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Jun 15 10:34:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:37.647414 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f64cd9-aa7d-4d1f-910d-4ebfb766f004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:37.649072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f64cd9-aa7d-4d1f-910d-4ebfb766f004 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:37.655580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79553fc6-b619-4353-977d-d6905d740623 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:37.675951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 794/1626] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:37.677034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f64cd9-aa7d-4d1f-910d-4ebfb766f004 service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:37.680601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79553fc6-b619-4353-977d-d6905d740623 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:37.699229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f41b9a-c6b0-4431-9406-4db0e7c751ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:37.700646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f41b9a-c6b0-4431-9406-4db0e7c751ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:37.700646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f41b9a-c6b0-4431-9406-4db0e7c751ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:37.700860 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f41b9a-c6b0-4431-9406-4db0e7c751ea admin admin] PATH_INFO: `/v3/projects/90fd212d54c34c7aa7cf6af177d7c260/users/07f7ce072fdc48fda560e8f37cfc7a65/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:37.704371 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f41b9a-c6b0-4431-9406-4db0e7c751ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fd212d54c34c7aa7cf6af177d7c260, user_id=07f7ce072fdc48fda560e8f37cfc7a65, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:37.705066 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f64cd9-aa7d-4d1f-910d-4ebfb766f004 service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:37.707175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f41b9a-c6b0-4431-9406-4db0e7c751ea admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:37.721287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3672edf-364c-4352-8586-7aa09941d33f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:37.722373 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3672edf-364c-4352-8586-7aa09941d33f service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:37.722373 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3672edf-364c-4352-8586-7aa09941d33f service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:37.722662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3672edf-364c-4352-8586-7aa09941d33f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:37.750279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 833/1627] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:37 2022] PUT /identity/v3/projects/90fd212d54c34c7aa7cf6af177d7c260/users/07f7ce072fdc48fda560e8f37cfc7a65/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:37.764192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784ca0a-aa53-412a-89c8-748d4790234a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:37.765607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784ca0a-aa53-412a-89c8-748d4790234a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:37.766633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784ca0a-aa53-412a-89c8-748d4790234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:37.875786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1784ca0a-aa53-412a-89c8-748d4790234a None None] MFA Rules not processed for user `07f7ce072fdc48fda560e8f37cfc7a65`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:37.877150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1784ca0a-aa53-412a-89c8-748d4790234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:37.908199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3672edf-364c-4352-8586-7aa09941d33f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:37.911618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3672edf-364c-4352-8586-7aa09941d33f service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:37.952722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 795/1628] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:38.047636 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 834/1629] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:34:38.056171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3672edf-364c-4352-8586-7aa09941d33f service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:38.146508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3672edf-364c-4352-8586-7aa09941d33f service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:38.208733 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca84a4-4685-49e7-bcee-b36bb0b15ab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:38.209482 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca84a4-4685-49e7-bcee-b36bb0b15ab5 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:38.209780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca84a4-4685-49e7-bcee-b36bb0b15ab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:38.210061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca84a4-4685-49e7-bcee-b36bb0b15ab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:38.222014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca84a4-4685-49e7-bcee-b36bb0b15ab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:38.223724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca84a4-4685-49e7-bcee-b36bb0b15ab5 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:38.235684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 796/1630] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:38 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:38.356682 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef736592-7c65-46e2-869e-468a7cec555b None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:38.357226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef736592-7c65-46e2-869e-468a7cec555b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:38.357508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef736592-7c65-46e2-869e-468a7cec555b None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:38.360000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 835/1631] 10.222.0.50 () {54 vars in 912 bytes} [Wed Jun 15 10:34:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:34:38.368116 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f7ae0-bb69-431c-bf9c-817cfca3a21e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:38.368646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f7ae0-bb69-431c-bf9c-817cfca3a21e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:38.369041 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f7ae0-bb69-431c-bf9c-817cfca3a21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:38.382114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:38.384743 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba921-bc94-4f22-949d-b15ad9c8862c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:38.385297 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba921-bc94-4f22-949d-b15ad9c8862c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:38.385680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba921-bc94-4f22-949d-b15ad9c8862c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:38.388214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 836/1632] 10.222.0.50 () {54 vars in 912 bytes} [Wed Jun 15 10:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:34:38.397423 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f9659-2401-4a34-843a-7c940cd45e1a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:38.397978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f9659-2401-4a34-843a-7c940cd45e1a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:38.398315 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f9659-2401-4a34-843a-7c940cd45e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:38.410793 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ec3f7ae0-bb69-431c-bf9c-817cfca3a21e None None] MFA Rules not processed for user `81e9805ec4c44cedb658b7becf768369`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:38.412482 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ec3f7ae0-bb69-431c-bf9c-817cfca3a21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:38.435530 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-691f9659-2401-4a34-843a-7c940cd45e1a None None] MFA Rules not processed for user `81e9805ec4c44cedb658b7becf768369`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:38.437182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-691f9659-2401-4a34-843a-7c940cd45e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:38.548536 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 837/1633] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:34:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:34:38.550312 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f9659-2401-4a34-843a-7c940cd45e1a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:38.576346 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f9659-2401-4a34-843a-7c940cd45e1a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:38.588074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4164b16-2e62-4f0c-92ed-e3fc67a80e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:38.589337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4164b16-2e62-4f0c-92ed-e3fc67a80e99 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:38.589936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4164b16-2e62-4f0c-92ed-e3fc67a80e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:38.590369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4164b16-2e62-4f0c-92ed-e3fc67a80e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:38.606503 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 797/1634] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:34:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:38.607577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f7ae0-bb69-431c-bf9c-817cfca3a21e None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:38.625352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f7ae0-bb69-431c-bf9c-817cfca3a21e None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:38.630395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b303e-0db6-471f-9b19-48e8fd2e516b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:38.631870 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b303e-0db6-471f-9b19-48e8fd2e516b service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:38.632264 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b303e-0db6-471f-9b19-48e8fd2e516b service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:38.632640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b303e-0db6-471f-9b19-48e8fd2e516b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:38.653702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b303e-0db6-471f-9b19-48e8fd2e516b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:38.661160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b303e-0db6-471f-9b19-48e8fd2e516b service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:38.678681 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 798/1635] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:38.727118 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:38.745593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4164b16-2e62-4f0c-92ed-e3fc67a80e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:38.747931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4164b16-2e62-4f0c-92ed-e3fc67a80e99 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:38.764868 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 838/1636] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:39.352610 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b303e-0db6-471f-9b19-48e8fd2e516b service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:39.364369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b303e-0db6-471f-9b19-48e8fd2e516b service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:39.379036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4f5e1-8b46-4f9d-9e6e-ae0d10293052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:39.380561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4f5e1-8b46-4f9d-9e6e-ae0d10293052 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:39.381270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4f5e1-8b46-4f9d-9e6e-ae0d10293052 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:39.383664 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4f5e1-8b46-4f9d-9e6e-ae0d10293052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:39.420785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4f5e1-8b46-4f9d-9e6e-ae0d10293052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:39.425786 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4f5e1-8b46-4f9d-9e6e-ae0d10293052 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:39.450880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 799/1637] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:40.688560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10721bca-96a2-4f8a-81f2-02ec84a62add None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:40.689406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10721bca-96a2-4f8a-81f2-02ec84a62add None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:40.689850 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10721bca-96a2-4f8a-81f2-02ec84a62add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:40.721732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-10721bca-96a2-4f8a-81f2-02ec84a62add None None] MFA Rules not processed for user `e1a8bd6de53c4c308de21fbb21e38062`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:40.723307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-10721bca-96a2-4f8a-81f2-02ec84a62add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:40.845091 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 839/1638] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:40.862679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10d649-ddb8-45a4-b63d-5bef5de896d1 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:40.863262 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10d649-ddb8-45a4-b63d-5bef5de896d1 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:40.863856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10d649-ddb8-45a4-b63d-5bef5de896d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:40.897553 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-6a10d649-ddb8-45a4-b63d-5bef5de896d1 None None] MFA Rules not processed for user `e1a8bd6de53c4c308de21fbb21e38062`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:40.901053 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6a10d649-ddb8-45a4-b63d-5bef5de896d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:40.919488 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 800/1639] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:40.931363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10721bca-96a2-4f8a-81f2-02ec84a62add None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:40.952769 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10721bca-96a2-4f8a-81f2-02ec84a62add None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:40.962563 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2932c-86ec-4e16-8448-d0216ce09064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:40.964281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2932c-86ec-4e16-8448-d0216ce09064 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:40.964675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2932c-86ec-4e16-8448-d0216ce09064 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:40.965110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2932c-86ec-4e16-8448-d0216ce09064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:40.975521 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2932c-86ec-4e16-8448-d0216ce09064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:40.978200 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2932c-86ec-4e16-8448-d0216ce09064 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:40.989556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 840/1640] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:41.898886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b23fc6-9bdc-4e90-af21-2a35d5cac188 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:41.900030 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b23fc6-9bdc-4e90-af21-2a35d5cac188 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:41.900524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b23fc6-9bdc-4e90-af21-2a35d5cac188 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:41.904682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 801/1641] 10.222.0.50 () {54 vars in 912 bytes} [Wed Jun 15 10:34:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:34:41.911127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d69f01-b37c-44a3-acce-5366b391b3d2 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:41.912308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d69f01-b37c-44a3-acce-5366b391b3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:41.912809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d69f01-b37c-44a3-acce-5366b391b3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:42.003579 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-02d69f01-b37c-44a3-acce-5366b391b3d2 None None] MFA Rules not processed for user `5f2e2038f69f49019a1e528107296223`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:42.007439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-02d69f01-b37c-44a3-acce-5366b391b3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:42.141448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 841/1642] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:34:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:42.185952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b23fc6-9bdc-4e90-af21-2a35d5cac188 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:42.196013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b23fc6-9bdc-4e90-af21-2a35d5cac188 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:42.202732 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f65352-ad63-4bc7-a601-fa41197cb428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:42.204129 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f65352-ad63-4bc7-a601-fa41197cb428 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:42.212456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f65352-ad63-4bc7-a601-fa41197cb428 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:42.213472 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f65352-ad63-4bc7-a601-fa41197cb428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:42.226407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f65352-ad63-4bc7-a601-fa41197cb428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:42.230703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f65352-ad63-4bc7-a601-fa41197cb428 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:42.266494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 802/1643] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:43.252503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d69f01-b37c-44a3-acce-5366b391b3d2 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:43.560767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d69f01-b37c-44a3-acce-5366b391b3d2 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:43.578014 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e3839-2a75-4567-8821-ca8e6c7604c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:43.578998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e3839-2a75-4567-8821-ca8e6c7604c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:43.579349 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e3839-2a75-4567-8821-ca8e6c7604c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:43.579715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e3839-2a75-4567-8821-ca8e6c7604c8 admin admin] PATH_INFO: `/v3/users/b4510901d1994262b4255d4dcad78132` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:43.582730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e3839-2a75-4567-8821-ca8e6c7604c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4510901d1994262b4255d4dcad78132)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:43.600120 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e3839-2a75-4567-8821-ca8e6c7604c8 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:43.605202 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:43.704141 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-687e3839-2a75-4567-8821-ca8e6c7604c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4510901d1994262b4255d4dcad78132'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:43.725105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-687e3839-2a75-4567-8821-ca8e6c7604c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4510901d1994262b4255d4dcad78132'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:43.725831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-687e3839-2a75-4567-8821-ca8e6c7604c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4510901d1994262b4255d4dcad78132'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:43.736795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-687e3839-2a75-4567-8821-ca8e6c7604c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4510901d1994262b4255d4dcad78132'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:43.751435 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-687e3839-2a75-4567-8821-ca8e6c7604c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4510901d1994262b4255d4dcad78132'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:43.780637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 842/1644] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:34:43 2022] DELETE /identity/v3/users/b4510901d1994262b4255d4dcad78132 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:43.785527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41d156-47e6-433f-877b-cf67d0a1511a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:43.786104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41d156-47e6-433f-877b-cf67d0a1511a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:43.786237 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41d156-47e6-433f-877b-cf67d0a1511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:43.845945 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-cd41d156-47e6-433f-877b-cf67d0a1511a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:43.848021 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-cd41d156-47e6-433f-877b-cf67d0a1511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:43.911760 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894a43d-c18e-4c17-a2b1-0a973ad8f18c None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:43.912512 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894a43d-c18e-4c17-a2b1-0a973ad8f18c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:43.913041 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894a43d-c18e-4c17-a2b1-0a973ad8f18c None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:43.916920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 843/1645] 10.222.0.50 () {54 vars in 960 bytes} [Wed Jun 15 10:34:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:34:43.922739 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df441c6-6f86-4fcd-b634-323acb19e42b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:43.923433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df441c6-6f86-4fcd-b634-323acb19e42b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:43.924005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df441c6-6f86-4fcd-b634-323acb19e42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:43.967186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1df441c6-6f86-4fcd-b634-323acb19e42b None None] MFA Rules not processed for user `2729cb0b9adb44f7ba5c968b6158a93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:43.971347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1df441c6-6f86-4fcd-b634-323acb19e42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:44.013764 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 803/1646] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:44.062378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41d156-47e6-433f-877b-cf67d0a1511a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:44.064191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-cd41d156-47e6-433f-877b-cf67d0a1511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:44.142515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 844/1647] 10.222.0.50 () {58 vars in 1057 bytes} [Wed Jun 15 10:34:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:44.153499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df441c6-6f86-4fcd-b634-323acb19e42b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:44.176204 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df441c6-6f86-4fcd-b634-323acb19e42b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:44.192455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821aefc5-54a2-4384-b1ea-d0d63e77a290 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2729cb0b9adb44f7ba5c968b6158a93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:44.196790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aefc5-54a2-4384-b1ea-d0d63e77a290 service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:44.197478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aefc5-54a2-4384-b1ea-d0d63e77a290 service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:44.198490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aefc5-54a2-4384-b1ea-d0d63e77a290 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:44.204656 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-821aefc5-54a2-4384-b1ea-d0d63e77a290 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:44.229624 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41d156-47e6-433f-877b-cf67d0a1511a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:44.237085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821aefc5-54a2-4384-b1ea-d0d63e77a290 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:44.239704 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821aefc5-54a2-4384-b1ea-d0d63e77a290 service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:44.241778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029e8eb-113d-45b4-ba5b-0e0f641217be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:44.246495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e8eb-113d-45b4-ba5b-0e0f641217be service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:44.246872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e8eb-113d-45b4-ba5b-0e0f641217be service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:44.247371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e8eb-113d-45b4-ba5b-0e0f641217be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:44.269234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:44.275705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 845/1648] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:44.276862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029e8eb-113d-45b4-ba5b-0e0f641217be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:44.278616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029e8eb-113d-45b4-ba5b-0e0f641217be service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:44.290969 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 804/1649] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:45.799615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821aefc5-54a2-4384-b1ea-d0d63e77a290 service placement] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:45.801131 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-821aefc5-54a2-4384-b1ea-d0d63e77a290 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:45.853381 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821aefc5-54a2-4384-b1ea-d0d63e77a290 service placement] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:45.869044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5366532-0d65-4bf4-a540-98859034ea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:45.870455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5366532-0d65-4bf4-a540-98859034ea37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:45.870740 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5366532-0d65-4bf4-a540-98859034ea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:45.871019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5366532-0d65-4bf4-a540-98859034ea37 admin admin] PATH_INFO: `/v3/projects/f17bc7b048134c308362f4cf8ae66a8e` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:45.875192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5366532-0d65-4bf4-a540-98859034ea37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17bc7b048134c308362f4cf8ae66a8e)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:45.880813 dv-cinder-843493-2-smb devstack@keystone.service[80117]: WARNING py.warnings [None req-c5366532-0d65-4bf4-a540-98859034ea37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:34:45.880813 dv-cinder-843493-2-smb devstack@keystone.service[80117]: warnings.warn(msg) Jun 15 10:34:45.880813 dv-cinder-843493-2-smb devstack@keystone.service[80117]: Jun 15 10:34:45.885752 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5366532-0d65-4bf4-a540-98859034ea37 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:46.172406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c5366532-0d65-4bf4-a540-98859034ea37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17bc7b048134c308362f4cf8ae66a8e', 'request_id': 'req-c5366532-0d65-4bf4-a540-98859034ea37'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:46.194683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:46.199717 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c5366532-0d65-4bf4-a540-98859034ea37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17bc7b048134c308362f4cf8ae66a8e', 'request_id': 'req-c5366532-0d65-4bf4-a540-98859034ea37'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:46.292782 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c5366532-0d65-4bf4-a540-98859034ea37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17bc7b048134c308362f4cf8ae66a8e', 'request_id': 'req-c5366532-0d65-4bf4-a540-98859034ea37'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:46.370757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c5366532-0d65-4bf4-a540-98859034ea37 admin admin] The token cache is being invalidate because project f17bc7b048134c308362f4cf8ae66a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:34:46.373637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c5366532-0d65-4bf4-a540-98859034ea37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:46.377578 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c5366532-0d65-4bf4-a540-98859034ea37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:46.390483 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1768d2-4b08-47b6-8f50-80ff11db869b None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:46.391003 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1768d2-4b08-47b6-8f50-80ff11db869b None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:46.391322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1768d2-4b08-47b6-8f50-80ff11db869b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:46.392777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 846/1650] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:34:45 2022] DELETE /identity/v3/projects/f17bc7b048134c308362f4cf8ae66a8e => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:46.456443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ce1768d2-4b08-47b6-8f50-80ff11db869b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:46.460483 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ce1768d2-4b08-47b6-8f50-80ff11db869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:46.640489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 805/1651] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:46.647138 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79e44c-8761-4373-b158-7e4897507732 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:46.647432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79e44c-8761-4373-b158-7e4897507732 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:46.647750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79e44c-8761-4373-b158-7e4897507732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:46.722364 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3a79e44c-8761-4373-b158-7e4897507732 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:46.724036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3a79e44c-8761-4373-b158-7e4897507732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:46.745941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 847/1652] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:46.750575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1768d2-4b08-47b6-8f50-80ff11db869b None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:46.767919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1768d2-4b08-47b6-8f50-80ff11db869b None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:46.786654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e940962-be12-4363-b071-99c316e1d093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:46.796198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e940962-be12-4363-b071-99c316e1d093 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:46.796747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e940962-be12-4363-b071-99c316e1d093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:46.797165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e940962-be12-4363-b071-99c316e1d093 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:46.798102 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e940962-be12-4363-b071-99c316e1d093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:34:46.798561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e940962-be12-4363-b071-99c316e1d093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:46.800444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e940962-be12-4363-b071-99c316e1d093 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:46.819128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 806/1653] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:34:46.819777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79e44c-8761-4373-b158-7e4897507732 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:46.839296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79e44c-8761-4373-b158-7e4897507732 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:46.840612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e940962-be12-4363-b071-99c316e1d093 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:46.858320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1e940962-be12-4363-b071-99c316e1d093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:46.872073 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027235a-bb51-4756-9a10-1bcc17c9ad14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:46.872761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027235a-bb51-4756-9a10-1bcc17c9ad14 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:46.873044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027235a-bb51-4756-9a10-1bcc17c9ad14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:46.873317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027235a-bb51-4756-9a10-1bcc17c9ad14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:46.874279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027235a-bb51-4756-9a10-1bcc17c9ad14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:46.876231 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027235a-bb51-4756-9a10-1bcc17c9ad14 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:46.900926 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e940962-be12-4363-b071-99c316e1d093 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:46.932730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a113f-367d-4347-a6da-267c2f616e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:46.934349 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a113f-367d-4347-a6da-267c2f616e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:46.934769 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a113f-367d-4347-a6da-267c2f616e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:46.935995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a113f-367d-4347-a6da-267c2f616e2d admin admin] PATH_INFO: `/v3/users/48b3782374554be9b0ae1e39a575b08f` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:46.939054 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a113f-367d-4347-a6da-267c2f616e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b3782374554be9b0ae1e39a575b08f)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:46.942018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: WARNING py.warnings [None req-715a113f-367d-4347-a6da-267c2f616e2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 10:34:46.942018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: warnings.warn(msg) Jun 15 10:34:46.942018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: Jun 15 10:34:46.946949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a113f-367d-4347-a6da-267c2f616e2d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:46.967656 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 848/1654] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:46 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:46.970011 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027235a-bb51-4756-9a10-1bcc17c9ad14 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:47.137288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-715a113f-367d-4347-a6da-267c2f616e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b3782374554be9b0ae1e39a575b08f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:47.190157 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027235a-bb51-4756-9a10-1bcc17c9ad14 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:47.219723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-715a113f-367d-4347-a6da-267c2f616e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b3782374554be9b0ae1e39a575b08f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:47.220901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911df727-bcf5-46d0-9c52-3e31b1246f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:47.221667 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df727-bcf5-46d0-9c52-3e31b1246f96 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:47.221958 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df727-bcf5-46d0-9c52-3e31b1246f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:47.222226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df727-bcf5-46d0-9c52-3e31b1246f96 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:47.227996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-715a113f-367d-4347-a6da-267c2f616e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b3782374554be9b0ae1e39a575b08f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:47.230593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911df727-bcf5-46d0-9c52-3e31b1246f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:47.232641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911df727-bcf5-46d0-9c52-3e31b1246f96 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:47.246573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-715a113f-367d-4347-a6da-267c2f616e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b3782374554be9b0ae1e39a575b08f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:47.248115 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-715a113f-367d-4347-a6da-267c2f616e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b3782374554be9b0ae1e39a575b08f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:47.304774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 849/1655] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:46 2022] POST /identity/v3/users => generated 288 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:47.321557 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911df727-bcf5-46d0-9c52-3e31b1246f96 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:47.321557 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-911df727-bcf5-46d0-9c52-3e31b1246f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:47.321719 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 807/1656] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:34:46 2022] DELETE /identity/v3/users/48b3782374554be9b0ae1e39a575b08f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:47.325444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212dbe2-0526-45ed-a3f6-a538eb513f53 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:47.325812 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212dbe2-0526-45ed-a3f6-a538eb513f53 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:47.326095 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212dbe2-0526-45ed-a3f6-a538eb513f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:47.349543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911df727-bcf5-46d0-9c52-3e31b1246f96 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:47.370668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-c212dbe2-0526-45ed-a3f6-a538eb513f53 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:47.371983 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c212dbe2-0526-45ed-a3f6-a538eb513f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:47.492497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:47.493180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e652a2-b8d6-44a3-b376-fdb4640d0b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:47.493386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e652a2-b8d6-44a3-b376-fdb4640d0b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:47.493668 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e652a2-b8d6-44a3-b376-fdb4640d0b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:47.493953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e652a2-b8d6-44a3-b376-fdb4640d0b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:47.494688 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e652a2-b8d6-44a3-b376-fdb4640d0b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:47.496500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e652a2-b8d6-44a3-b376-fdb4640d0b25 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:47.528632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 808/1657] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:34:47.531246 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38ce37-33a7-4afb-b4a5-b9c3308c1066 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:47.531583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38ce37-33a7-4afb-b4a5-b9c3308c1066 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:47.531865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38ce37-33a7-4afb-b4a5-b9c3308c1066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:47.533479 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 850/1658] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:47.534430 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e652a2-b8d6-44a3-b376-fdb4640d0b25 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:47.549819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e652a2-b8d6-44a3-b376-fdb4640d0b25 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:47.556553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da86c3-8da8-439b-8bf8-b13eb18260e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:47.557571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da86c3-8da8-439b-8bf8-b13eb18260e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:47.558038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da86c3-8da8-439b-8bf8-b13eb18260e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:47.558466 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da86c3-8da8-439b-8bf8-b13eb18260e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:47.559509 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da86c3-8da8-439b-8bf8-b13eb18260e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:47.561364 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da86c3-8da8-439b-8bf8-b13eb18260e9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:47.590088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 851/1659] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:47.590088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da86c3-8da8-439b-8bf8-b13eb18260e9 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:47.590919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-59da86c3-8da8-439b-8bf8-b13eb18260e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:47.596450 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-1a38ce37-33a7-4afb-b4a5-b9c3308c1066 None None] MFA Rules not processed for user `76ccc16f729b4042916db8c1183d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:47.597841 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1a38ce37-33a7-4afb-b4a5-b9c3308c1066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:47.656576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:47.713888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da86c3-8da8-439b-8bf8-b13eb18260e9 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:47.719643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e6a4-d5b3-4bf9-8d5e-1505bfa2d5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:47.720386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e6a4-d5b3-4bf9-8d5e-1505bfa2d5db service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:47.720744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e6a4-d5b3-4bf9-8d5e-1505bfa2d5db service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:47.721031 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e6a4-d5b3-4bf9-8d5e-1505bfa2d5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:47.760387 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4e6a4-d5b3-4bf9-8d5e-1505bfa2d5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:47.765744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4e6a4-d5b3-4bf9-8d5e-1505bfa2d5db service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:47.774266 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 809/1660] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:47.775335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38ce37-33a7-4afb-b4a5-b9c3308c1066 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:47.801080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38ce37-33a7-4afb-b4a5-b9c3308c1066 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:47.810327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a806b2-5534-42d6-81aa-7273163a9509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:47.816738 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a806b2-5534-42d6-81aa-7273163a9509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:47.817341 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a806b2-5534-42d6-81aa-7273163a9509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:47.817724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a806b2-5534-42d6-81aa-7273163a9509 admin admin] PATH_INFO: `/v3/projects/2dcac4a9ba86442da449c5a6105f3ae7/users/a65b5d5f72b8433ba82a3f6e30c65bc7/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:47.828601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 852/1661] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:47.831489 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77dd8a-ea6e-476f-8d50-be2a0ee0b4c8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:47.831976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77dd8a-ea6e-476f-8d50-be2a0ee0b4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:47.833015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77dd8a-ea6e-476f-8d50-be2a0ee0b4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:47.849741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a806b2-5534-42d6-81aa-7273163a9509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dcac4a9ba86442da449c5a6105f3ae7, user_id=a65b5d5f72b8433ba82a3f6e30c65bc7, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:47.853182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a806b2-5534-42d6-81aa-7273163a9509 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:47.859768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9a77dd8a-ea6e-476f-8d50-be2a0ee0b4c8 None None] MFA Rules not processed for user `76ccc16f729b4042916db8c1183d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:47.861532 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9a77dd8a-ea6e-476f-8d50-be2a0ee0b4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:47.881933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 853/1662] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:47.888613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77dd8a-ea6e-476f-8d50-be2a0ee0b4c8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:47.900429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9a77dd8a-ea6e-476f-8d50-be2a0ee0b4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:47.908696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 810/1663] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:47 2022] PUT /identity/v3/projects/2dcac4a9ba86442da449c5a6105f3ae7/users/a65b5d5f72b8433ba82a3f6e30c65bc7/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:47.922224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f85d2-c53d-40d0-98ad-27904da02626 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:47.922793 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f85d2-c53d-40d0-98ad-27904da02626 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:47.923364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f85d2-c53d-40d0-98ad-27904da02626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:47.998437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-608f85d2-c53d-40d0-98ad-27904da02626 None None] MFA Rules not processed for user `a65b5d5f72b8433ba82a3f6e30c65bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:48.006518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-608f85d2-c53d-40d0-98ad-27904da02626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:48.107970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77dd8a-ea6e-476f-8d50-be2a0ee0b4c8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:48.186626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 811/1664] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:34:48.188025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f85d2-c53d-40d0-98ad-27904da02626 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:48.189215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-608f85d2-c53d-40d0-98ad-27904da02626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:48.248673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b79c5-625a-4196-b009-451a0702d0fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:48.249539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b79c5-625a-4196-b009-451a0702d0fc service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:48.250280 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b79c5-625a-4196-b009-451a0702d0fc service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:48.250280 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b79c5-625a-4196-b009-451a0702d0fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:48.338914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:48.406013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f85d2-c53d-40d0-98ad-27904da02626 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:48.415877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b79c5-625a-4196-b009-451a0702d0fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:48.423638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b79c5-625a-4196-b009-451a0702d0fc service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:48.424926 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbea33b-51c7-42ba-b7fd-2f6d1cd69fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:48.428214 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbea33b-51c7-42ba-b7fd-2f6d1cd69fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:48.428617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbea33b-51c7-42ba-b7fd-2f6d1cd69fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:48.429002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbea33b-51c7-42ba-b7fd-2f6d1cd69fa7 admin admin] PATH_INFO: `/v3/users/6c036627244c407488b4422dfba275d7` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:48.431984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbea33b-51c7-42ba-b7fd-2f6d1cd69fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c036627244c407488b4422dfba275d7)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:48.435042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbea33b-51c7-42ba-b7fd-2f6d1cd69fa7 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:48.485720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 854/1665] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:34:48.488356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b79c5-625a-4196-b009-451a0702d0fc service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:48.495717 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a02b79c5-625a-4196-b009-451a0702d0fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:48.543330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:48.566799 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5bbea33b-51c7-42ba-b7fd-2f6d1cd69fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c036627244c407488b4422dfba275d7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:48.569852 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b79c5-625a-4196-b009-451a0702d0fc service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:48.595210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5bbea33b-51c7-42ba-b7fd-2f6d1cd69fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c036627244c407488b4422dfba275d7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:48.597085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5bbea33b-51c7-42ba-b7fd-2f6d1cd69fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c036627244c407488b4422dfba275d7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:48.604804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d230f-6a44-46eb-8051-20172bbe7f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:48.605491 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d230f-6a44-46eb-8051-20172bbe7f85 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:48.605775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d230f-6a44-46eb-8051-20172bbe7f85 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:48.606259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d230f-6a44-46eb-8051-20172bbe7f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:48.611784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1c2d230f-6a44-46eb-8051-20172bbe7f85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:48.615854 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5bbea33b-51c7-42ba-b7fd-2f6d1cd69fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c036627244c407488b4422dfba275d7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:48.617227 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5bbea33b-51c7-42ba-b7fd-2f6d1cd69fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c036627244c407488b4422dfba275d7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:48.637666 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d230f-6a44-46eb-8051-20172bbe7f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:48.646744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d230f-6a44-46eb-8051-20172bbe7f85 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:48.666288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 812/1666] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:34:48 2022] DELETE /identity/v3/users/6c036627244c407488b4422dfba275d7 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:48.676852 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a3b44-a76c-454a-9920-33a7d0db69a2 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:48.677797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 855/1667] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:48.678386 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a3b44-a76c-454a-9920-33a7d0db69a2 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:48.678775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a3b44-a76c-454a-9920-33a7d0db69a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:48.679140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbe9e8-767b-49bc-91e9-25dd28580aca None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:48.679436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbe9e8-767b-49bc-91e9-25dd28580aca None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:48.679770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbe9e8-767b-49bc-91e9-25dd28580aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:48.717104 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a2cbe9e8-767b-49bc-91e9-25dd28580aca None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:48.719585 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a2cbe9e8-767b-49bc-91e9-25dd28580aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:48.740206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-049a3b44-a76c-454a-9920-33a7d0db69a2 None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:48.743402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-049a3b44-a76c-454a-9920-33a7d0db69a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:48.887847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 813/1668] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:34:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:48.918074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 856/1669] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:48.981451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a3b44-a76c-454a-9920-33a7d0db69a2 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:48.983016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-049a3b44-a76c-454a-9920-33a7d0db69a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:49.111134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a3b44-a76c-454a-9920-33a7d0db69a2 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:49.129473 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2518afd-c086-43cf-b19a-0b52333b7e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:49.130149 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2518afd-c086-43cf-b19a-0b52333b7e63 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:49.130432 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2518afd-c086-43cf-b19a-0b52333b7e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:49.130709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2518afd-c086-43cf-b19a-0b52333b7e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:49.159172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2518afd-c086-43cf-b19a-0b52333b7e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:49.160680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2518afd-c086-43cf-b19a-0b52333b7e63 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:49.177857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbe9e8-767b-49bc-91e9-25dd28580aca None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:49.180468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a2cbe9e8-767b-49bc-91e9-25dd28580aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:49.189312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 814/1670] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:49.220541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2518afd-c086-43cf-b19a-0b52333b7e63 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:49.221997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c2518afd-c086-43cf-b19a-0b52333b7e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:49.267777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2518afd-c086-43cf-b19a-0b52333b7e63 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:49.291001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d62898-edf6-493b-a3ce-8b1cc04f1849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:49.293227 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d62898-edf6-493b-a3ce-8b1cc04f1849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:49.293556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d62898-edf6-493b-a3ce-8b1cc04f1849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:49.293904 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d62898-edf6-493b-a3ce-8b1cc04f1849 admin admin] PATH_INFO: `/v3/projects/017ac13361a94c03bcc32b791a3dde87` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:49.295713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d62898-edf6-493b-a3ce-8b1cc04f1849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017ac13361a94c03bcc32b791a3dde87)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:49.298299 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d62898-edf6-493b-a3ce-8b1cc04f1849 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:49.356401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:49.438575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbe9e8-767b-49bc-91e9-25dd28580aca None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:49.455789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661bfc8-46a5-4101-adb0-ca0538c2aa65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:49.456537 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661bfc8-46a5-4101-adb0-ca0538c2aa65 service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:49.457110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661bfc8-46a5-4101-adb0-ca0538c2aa65 service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:49.457393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661bfc8-46a5-4101-adb0-ca0538c2aa65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:49.488065 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661bfc8-46a5-4101-adb0-ca0538c2aa65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:49.489881 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661bfc8-46a5-4101-adb0-ca0538c2aa65 service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:49.511459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 857/1671] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:34:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 10:34:49.588489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-65d62898-edf6-493b-a3ce-8b1cc04f1849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017ac13361a94c03bcc32b791a3dde87', 'request_id': 'req-65d62898-edf6-493b-a3ce-8b1cc04f1849'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:49.619659 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661bfc8-46a5-4101-adb0-ca0538c2aa65 service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:49.621079 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6661bfc8-46a5-4101-adb0-ca0538c2aa65 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:49.623024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-65d62898-edf6-493b-a3ce-8b1cc04f1849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017ac13361a94c03bcc32b791a3dde87', 'request_id': 'req-65d62898-edf6-493b-a3ce-8b1cc04f1849'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:49.650988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-65d62898-edf6-493b-a3ce-8b1cc04f1849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017ac13361a94c03bcc32b791a3dde87', 'request_id': 'req-65d62898-edf6-493b-a3ce-8b1cc04f1849'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:49.681015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661bfc8-46a5-4101-adb0-ca0538c2aa65 service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:49.683182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-65d62898-edf6-493b-a3ce-8b1cc04f1849 admin admin] The token cache is being invalidate because project 017ac13361a94c03bcc32b791a3dde87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:34:49.683581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-65d62898-edf6-493b-a3ce-8b1cc04f1849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:49.686192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-65d62898-edf6-493b-a3ce-8b1cc04f1849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:49.694477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 815/1672] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:34:49 2022] DELETE /identity/v3/projects/017ac13361a94c03bcc32b791a3dde87 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:34:49.701057 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8f8f8-3bcd-4d16-ae9a-b94aff649a71 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:49.701663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8f8f8-3bcd-4d16-ae9a-b94aff649a71 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:49.702308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8f8f8-3bcd-4d16-ae9a-b94aff649a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:49.794450 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-34e8f8f8-3bcd-4d16-ae9a-b94aff649a71 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:49.800176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-34e8f8f8-3bcd-4d16-ae9a-b94aff649a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:49.942936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0da5f1-36b7-42f5-819a-6c621c2ff5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:49.944218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0da5f1-36b7-42f5-819a-6c621c2ff5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:49.944589 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0da5f1-36b7-42f5-819a-6c621c2ff5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:49.944865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0da5f1-36b7-42f5-819a-6c621c2ff5c9 admin admin] PATH_INFO: `/v3/users/a65b5d5f72b8433ba82a3f6e30c65bc7` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:49.949486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0da5f1-36b7-42f5-819a-6c621c2ff5c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65b5d5f72b8433ba82a3f6e30c65bc7)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:49.960718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0da5f1-36b7-42f5-819a-6c621c2ff5c9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:50.030427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 816/1673] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:50.046450 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9e01f-2391-4e1f-a7a7-3935f74d883c None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:50.047017 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9e01f-2391-4e1f-a7a7-3935f74d883c None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:50.047293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9e01f-2391-4e1f-a7a7-3935f74d883c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:50.074574 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:50.148184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-f3a9e01f-2391-4e1f-a7a7-3935f74d883c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:50.148184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f3a9e01f-2391-4e1f-a7a7-3935f74d883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:50.188842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 817/1674] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:50.191455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1f666-0409-4247-90f5-367e643c001e None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:50.191780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1f666-0409-4247-90f5-367e643c001e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:50.192064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1f666-0409-4247-90f5-367e643c001e None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:50.192405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d0da5f1-36b7-42f5-819a-6c621c2ff5c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65b5d5f72b8433ba82a3f6e30c65bc7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:50.193661 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 818/1675] 10.222.0.50 () {54 vars in 912 bytes} [Wed Jun 15 10:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:34:50.194773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1f666-0409-4247-90f5-367e643c001e None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:50.215555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1f666-0409-4247-90f5-367e643c001e None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:50.227140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f286406-4651-42c8-9ba4-90f4d92e7eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:50.228176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f286406-4651-42c8-9ba4-90f4d92e7eef admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:50.228852 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f286406-4651-42c8-9ba4-90f4d92e7eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:50.229149 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f286406-4651-42c8-9ba4-90f4d92e7eef admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:50.230030 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f286406-4651-42c8-9ba4-90f4d92e7eef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:34:50.230398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f286406-4651-42c8-9ba4-90f4d92e7eef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:50.235758 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f286406-4651-42c8-9ba4-90f4d92e7eef admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:50.249556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d0da5f1-36b7-42f5-819a-6c621c2ff5c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65b5d5f72b8433ba82a3f6e30c65bc7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:50.250593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d0da5f1-36b7-42f5-819a-6c621c2ff5c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65b5d5f72b8433ba82a3f6e30c65bc7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:50.286972 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d0da5f1-36b7-42f5-819a-6c621c2ff5c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65b5d5f72b8433ba82a3f6e30c65bc7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:50.287185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 819/1676] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:34:50.288520 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194e44-5125-4b6b-8531-56bf73bfdaf2 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:50.288520 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194e44-5125-4b6b-8531-56bf73bfdaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:50.288715 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d194e44-5125-4b6b-8531-56bf73bfdaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:50.305792 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3d0da5f1-36b7-42f5-819a-6c621c2ff5c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65b5d5f72b8433ba82a3f6e30c65bc7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:50.324037 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 858/1677] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:34:49 2022] DELETE /identity/v3/users/a65b5d5f72b8433ba82a3f6e30c65bc7 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:50.324990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0da5f1-36b7-42f5-819a-6c621c2ff5c9 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:50.331668 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3d0da5f1-36b7-42f5-819a-6c621c2ff5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:50.349658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-4d194e44-5125-4b6b-8531-56bf73bfdaf2 None None] MFA Rules not processed for user `5f2e2038f69f49019a1e528107296223`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:50.350918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4d194e44-5125-4b6b-8531-56bf73bfdaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:50.569749 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 820/1678] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:34:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:50.572814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fea22-4b71-4778-b7e1-492b139f3e59 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:50.577823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fea22-4b71-4778-b7e1-492b139f3e59 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:50.578137 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fea22-4b71-4778-b7e1-492b139f3e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:50.642989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0da5f1-36b7-42f5-819a-6c621c2ff5c9 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:50.654290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-280fea22-4b71-4778-b7e1-492b139f3e59 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:50.660347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-280fea22-4b71-4778-b7e1-492b139f3e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:50.678458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff4241-867a-4d44-af73-c78122993fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:50.679434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff4241-867a-4d44-af73-c78122993fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:50.680463 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff4241-867a-4d44-af73-c78122993fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:50.681148 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff4241-867a-4d44-af73-c78122993fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:50.695858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff4241-867a-4d44-af73-c78122993fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:50.698050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff4241-867a-4d44-af73-c78122993fe1 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:50.715837 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 821/1679] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:50.717259 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fea22-4b71-4778-b7e1-492b139f3e59 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:50.725827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-280fea22-4b71-4778-b7e1-492b139f3e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:50.777575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fea22-4b71-4778-b7e1-492b139f3e59 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:50.787305 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 859/1680] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:50 2022] POST /identity/v3/projects => generated 379 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:50.788167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff4241-867a-4d44-af73-c78122993fe1 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:50.800272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c1d29-9873-4b20-ada9-3a164d76a359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:50.800958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c1d29-9873-4b20-ada9-3a164d76a359 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:50.801245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c1d29-9873-4b20-ada9-3a164d76a359 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:50.801524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c1d29-9873-4b20-ada9-3a164d76a359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:50.826931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c1d29-9873-4b20-ada9-3a164d76a359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:50.834226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c1d29-9873-4b20-ada9-3a164d76a359 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:50.879816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 822/1681] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:50.882767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c1d29-9873-4b20-ada9-3a164d76a359 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:50.926842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c1d29-9873-4b20-ada9-3a164d76a359 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:50.941759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:50.972153 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff4241-867a-4d44-af73-c78122993fe1 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:50.992179 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb790bf-6204-4c7b-ace6-9504f7f254c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:50.992868 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb790bf-6204-4c7b-ace6-9504f7f254c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:50.993155 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb790bf-6204-4c7b-ace6-9504f7f254c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:50.993442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb790bf-6204-4c7b-ace6-9504f7f254c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:51.145477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:51.147920 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe2124-77ac-4cc3-ae5a-b76713233624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:51.149470 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe2124-77ac-4cc3-ae5a-b76713233624 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:51.149750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe2124-77ac-4cc3-ae5a-b76713233624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:51.150091 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe2124-77ac-4cc3-ae5a-b76713233624 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:51.150803 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe2124-77ac-4cc3-ae5a-b76713233624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:51.153131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe2124-77ac-4cc3-ae5a-b76713233624 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:51.233400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 823/1682] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:50 2022] POST /identity/v3/users => generated 290 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:51.234398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe2124-77ac-4cc3-ae5a-b76713233624 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:51.235876 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb790bf-6204-4c7b-ace6-9504f7f254c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:51.237393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb790bf-6204-4c7b-ace6-9504f7f254c9 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:51.246445 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8dfe2124-77ac-4cc3-ae5a-b76713233624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:51.269642 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 860/1683] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:51.270565 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb790bf-6204-4c7b-ace6-9504f7f254c9 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:51.285550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe2124-77ac-4cc3-ae5a-b76713233624 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:51.301110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb790bf-6204-4c7b-ace6-9504f7f254c9 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:51.307618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3c493-a0b5-4909-9cde-357566518236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:51.308638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c493-a0b5-4909-9cde-357566518236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:51.308921 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c493-a0b5-4909-9cde-357566518236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:51.309200 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3c493-a0b5-4909-9cde-357566518236 admin admin] PATH_INFO: `/v3/users/be259bace6f54a38a2a633021c41cf9d` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:51.311166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3c493-a0b5-4909-9cde-357566518236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be259bace6f54a38a2a633021c41cf9d)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:51.313241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3c493-a0b5-4909-9cde-357566518236 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:51.329587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51230ce-a7fe-4862-8ae7-4b2945e33665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:51.330394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51230ce-a7fe-4862-8ae7-4b2945e33665 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:51.330737 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51230ce-a7fe-4862-8ae7-4b2945e33665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:51.331088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51230ce-a7fe-4862-8ae7-4b2945e33665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:51.334369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51230ce-a7fe-4862-8ae7-4b2945e33665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:51.349543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51230ce-a7fe-4862-8ae7-4b2945e33665 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:51.383942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 861/1684] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:51.401057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51230ce-a7fe-4862-8ae7-4b2945e33665 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:51.417942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51230ce-a7fe-4862-8ae7-4b2945e33665 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:51.450816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cff523-207d-4762-81bf-143fb03a631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:51.451576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cff523-207d-4762-81bf-143fb03a631a admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:51.451803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cff523-207d-4762-81bf-143fb03a631a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:51.452080 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cff523-207d-4762-81bf-143fb03a631a admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:51.452826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cff523-207d-4762-81bf-143fb03a631a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:51.454678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cff523-207d-4762-81bf-143fb03a631a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:51.467639 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-02d3c493-a0b5-4909-9cde-357566518236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be259bace6f54a38a2a633021c41cf9d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:51.495851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 862/1685] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:51.496821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cff523-207d-4762-81bf-143fb03a631a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:51.502003 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-02d3c493-a0b5-4909-9cde-357566518236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be259bace6f54a38a2a633021c41cf9d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:51.503850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-02d3c493-a0b5-4909-9cde-357566518236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be259bace6f54a38a2a633021c41cf9d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:51.528136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-02d3c493-a0b5-4909-9cde-357566518236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be259bace6f54a38a2a633021c41cf9d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:51.530152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-02d3c493-a0b5-4909-9cde-357566518236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be259bace6f54a38a2a633021c41cf9d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:51.534935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cff523-207d-4762-81bf-143fb03a631a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:51.565580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d6ed5-cfb3-4d29-a23c-319f6f3c14cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:51.575366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6ed5-cfb3-4d29-a23c-319f6f3c14cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:51.575366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6ed5-cfb3-4d29-a23c-319f6f3c14cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:51.575366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6ed5-cfb3-4d29-a23c-319f6f3c14cb admin admin] PATH_INFO: `/v3/projects/daa23a95964043d7ba90c72f815d000f/users/800456b73d3f47cdb2242d30285129d3/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:51.607876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 824/1686] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:34:51 2022] DELETE /identity/v3/users/be259bace6f54a38a2a633021c41cf9d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:51.609479 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc187e-a95e-4dac-9ac8-d1188a1ec40f None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:51.609771 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc187e-a95e-4dac-9ac8-d1188a1ec40f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:51.610055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc187e-a95e-4dac-9ac8-d1188a1ec40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:51.661533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d6ed5-cfb3-4d29-a23c-319f6f3c14cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa23a95964043d7ba90c72f815d000f, user_id=800456b73d3f47cdb2242d30285129d3, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:51.674739 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d6ed5-cfb3-4d29-a23c-319f6f3c14cb admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:51.680722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-dbcc187e-a95e-4dac-9ac8-d1188a1ec40f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:51.683551 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-dbcc187e-a95e-4dac-9ac8-d1188a1ec40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:51.753981 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 863/1687] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:51 2022] PUT /identity/v3/projects/daa23a95964043d7ba90c72f815d000f/users/800456b73d3f47cdb2242d30285129d3/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:51.755669 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c3d0f-cd9e-4aa1-8677-fc77d61c990c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:51.756111 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c3d0f-cd9e-4aa1-8677-fc77d61c990c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:51.756397 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c3d0f-cd9e-4aa1-8677-fc77d61c990c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:51.952874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 825/1688] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:51.959742 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-872c3d0f-cd9e-4aa1-8677-fc77d61c990c None None] MFA Rules not processed for user `800456b73d3f47cdb2242d30285129d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:51.967884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-872c3d0f-cd9e-4aa1-8677-fc77d61c990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:52.136282 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc187e-a95e-4dac-9ac8-d1188a1ec40f None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:52.139446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-dbcc187e-a95e-4dac-9ac8-d1188a1ec40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:52.174278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:52.307113 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 864/1689] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 552 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:52.315720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee5874-8569-4d7d-b346-9dcab75364ec None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:52.316534 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee5874-8569-4d7d-b346-9dcab75364ec None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:52.316534 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee5874-8569-4d7d-b346-9dcab75364ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:52.316714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc187e-a95e-4dac-9ac8-d1188a1ec40f None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:52.386206 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6bee5874-8569-4d7d-b346-9dcab75364ec None None] MFA Rules not processed for user `24d4ac4faaed44cbb9c20a5ae20a356a`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:52.387853 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6bee5874-8569-4d7d-b346-9dcab75364ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:52.476367 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51db525-2415-424a-9874-7a1d8f3b7ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:52.479988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51db525-2415-424a-9874-7a1d8f3b7ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:52.484474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51db525-2415-424a-9874-7a1d8f3b7ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:52.484737 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51db525-2415-424a-9874-7a1d8f3b7ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:52.731634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51db525-2415-424a-9874-7a1d8f3b7ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:52.733346 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51db525-2415-424a-9874-7a1d8f3b7ee8 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:52.743308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 865/1690] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:52.744256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee5874-8569-4d7d-b346-9dcab75364ec None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:52.752242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6bee5874-8569-4d7d-b346-9dcab75364ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:52.762352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 826/1691] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:52.763436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51db525-2415-424a-9874-7a1d8f3b7ee8 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:52.767120 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c51db525-2415-424a-9874-7a1d8f3b7ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:52.810415 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee5874-8569-4d7d-b346-9dcab75364ec None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:52.850433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02b604-39fb-4723-9f17-8e887ebc613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:52.853310 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b604-39fb-4723-9f17-8e887ebc613d admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:52.853579 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b604-39fb-4723-9f17-8e887ebc613d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:52.853868 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02b604-39fb-4723-9f17-8e887ebc613d admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:52.854574 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02b604-39fb-4723-9f17-8e887ebc613d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:52.873399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02b604-39fb-4723-9f17-8e887ebc613d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:52.893185 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:52.925288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51db525-2415-424a-9874-7a1d8f3b7ee8 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:52.954258 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b77c0-e6ae-49df-8a49-5ccbb2e8bc54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:52.956011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b77c0-e6ae-49df-8a49-5ccbb2e8bc54 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:52.956941 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b77c0-e6ae-49df-8a49-5ccbb2e8bc54 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:52.960817 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b77c0-e6ae-49df-8a49-5ccbb2e8bc54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:52.960987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 866/1692] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:52 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:52.963968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a027c97-9839-45a1-91d1-4a0295d4fed2 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:52.964406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a027c97-9839-45a1-91d1-4a0295d4fed2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:52.967058 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a027c97-9839-45a1-91d1-4a0295d4fed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:53.000765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b77c0-e6ae-49df-8a49-5ccbb2e8bc54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:53.010079 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b77c0-e6ae-49df-8a49-5ccbb2e8bc54 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:53.053559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 827/1693] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:53.060124 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b77c0-e6ae-49df-8a49-5ccbb2e8bc54 service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:53.065711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2a027c97-9839-45a1-91d1-4a0295d4fed2 None None] MFA Rules not processed for user `76ccc16f729b4042916db8c1183d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:53.065711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2a027c97-9839-45a1-91d1-4a0295d4fed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:53.102354 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:53.135785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b77c0-e6ae-49df-8a49-5ccbb2e8bc54 service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:53.446026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadafe87-6781-4f75-be96-35ab0f46deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:53.449430 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadafe87-6781-4f75-be96-35ab0f46deda admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:53.451398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadafe87-6781-4f75-be96-35ab0f46deda admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:53.452258 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadafe87-6781-4f75-be96-35ab0f46deda admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:53.454433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadafe87-6781-4f75-be96-35ab0f46deda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:53.460472 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadafe87-6781-4f75-be96-35ab0f46deda admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:53.508208 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 867/1694] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 548 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:53.516654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b4397-51de-4590-9be4-dd8e6b695809 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:53.531641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b4397-51de-4590-9be4-dd8e6b695809 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:53.537050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b4397-51de-4590-9be4-dd8e6b695809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:53.546641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 828/1695] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:53 2022] POST /identity/v3/users => generated 297 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:53.548997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadafe87-6781-4f75-be96-35ab0f46deda admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:53.552819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-aadafe87-6781-4f75-be96-35ab0f46deda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:53.589215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadafe87-6781-4f75-be96-35ab0f46deda admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:53.603711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:53.606220 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:53.606605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:53.606946 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] PATH_INFO: `/v3/projects/6a78b477a6324a1781eecb5c90b64915` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:53.608804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a78b477a6324a1781eecb5c90b64915)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:53.611784 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:53.665609 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-438b4397-51de-4590-9be4-dd8e6b695809 None None] MFA Rules not processed for user `5f2e2038f69f49019a1e528107296223`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:53.692034 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-438b4397-51de-4590-9be4-dd8e6b695809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:53.707954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a78b477a6324a1781eecb5c90b64915', 'request_id': 'req-374a03d8-1304-481e-b783-4da6635c50a2'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:53.723458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a78b477a6324a1781eecb5c90b64915', 'request_id': 'req-374a03d8-1304-481e-b783-4da6635c50a2'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:53.739089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a78b477a6324a1781eecb5c90b64915', 'request_id': 'req-374a03d8-1304-481e-b783-4da6635c50a2'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:53.772918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] The token cache is being invalidate because project 6a78b477a6324a1781eecb5c90b64915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:34:53.773349 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:53.775346 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:53.777946 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 829/1696] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:34:53 2022] DELETE /identity/v3/projects/6a78b477a6324a1781eecb5c90b64915 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:53.785410 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:53.795027 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:53.838220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 868/1697] 10.222.0.75 () {58 vars in 1015 bytes} [Wed Jun 15 10:34:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:53.840772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b4397-51de-4590-9be4-dd8e6b695809 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:53.847255 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-438b4397-51de-4590-9be4-dd8e6b695809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:54.125994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a03d8-1304-481e-b783-4da6635c50a2 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:54.149488 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:54.150381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:54.150662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:54.152263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] PATH_INFO: `/v3/projects/2dcac4a9ba86442da449c5a6105f3ae7` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:54.155124 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dcac4a9ba86442da449c5a6105f3ae7)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:54.162416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:54.167975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b4397-51de-4590-9be4-dd8e6b695809 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:54.196309 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d7643-3d94-4984-bdd7-2aa77cca113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:54.197256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d7643-3d94-4984-bdd7-2aa77cca113e admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:54.197463 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d7643-3d94-4984-bdd7-2aa77cca113e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:54.197903 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d7643-3d94-4984-bdd7-2aa77cca113e admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:54.198780 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d7643-3d94-4984-bdd7-2aa77cca113e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:54.202467 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d7643-3d94-4984-bdd7-2aa77cca113e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:54.214787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:54.269172 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 869/1698] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:54.270300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d7643-3d94-4984-bdd7-2aa77cca113e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:54.279393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5e2d7643-3d94-4984-bdd7-2aa77cca113e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:54.289902 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dcac4a9ba86442da449c5a6105f3ae7', 'request_id': 'req-44a63905-6378-4761-a5f4-0c35a95e4542'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:54.315900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dcac4a9ba86442da449c5a6105f3ae7', 'request_id': 'req-44a63905-6378-4761-a5f4-0c35a95e4542'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:54.325431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d7643-3d94-4984-bdd7-2aa77cca113e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:54.330691 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dcac4a9ba86442da449c5a6105f3ae7', 'request_id': 'req-44a63905-6378-4761-a5f4-0c35a95e4542'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:54.366520 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] The token cache is being invalidate because project 2dcac4a9ba86442da449c5a6105f3ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:34:54.366824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:54.368234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:54.373533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 830/1699] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:34:53 2022] DELETE /identity/v3/projects/2dcac4a9ba86442da449c5a6105f3ae7 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:54.373533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:54.377448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:54.466066 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:54.502031 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d89692-3ebe-4a10-b38b-888115c04bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:54.503392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d89692-3ebe-4a10-b38b-888115c04bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:54.504761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d89692-3ebe-4a10-b38b-888115c04bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:54.505122 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d89692-3ebe-4a10-b38b-888115c04bfc admin admin] PATH_INFO: `/v3/users/07f7ce072fdc48fda560e8f37cfc7a65` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:54.506606 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d89692-3ebe-4a10-b38b-888115c04bfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=07f7ce072fdc48fda560e8f37cfc7a65)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:54.508896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d89692-3ebe-4a10-b38b-888115c04bfc admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:54.580615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e0d89692-3ebe-4a10-b38b-888115c04bfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07f7ce072fdc48fda560e8f37cfc7a65'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:54.597292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e0d89692-3ebe-4a10-b38b-888115c04bfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07f7ce072fdc48fda560e8f37cfc7a65'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:54.598507 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e0d89692-3ebe-4a10-b38b-888115c04bfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07f7ce072fdc48fda560e8f37cfc7a65'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:54.605470 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a63905-6378-4761-a5f4-0c35a95e4542 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:54.613630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e0d89692-3ebe-4a10-b38b-888115c04bfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07f7ce072fdc48fda560e8f37cfc7a65'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:54.620683 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1b59c-99af-4397-bd4e-bb97c1bcfd58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:54.623130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1b59c-99af-4397-bd4e-bb97c1bcfd58 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:54.623794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1b59c-99af-4397-bd4e-bb97c1bcfd58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:54.624821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1b59c-99af-4397-bd4e-bb97c1bcfd58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:54.628381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-58c1b59c-99af-4397-bd4e-bb97c1bcfd58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:54.630913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e0d89692-3ebe-4a10-b38b-888115c04bfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07f7ce072fdc48fda560e8f37cfc7a65'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:54.649014 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 870/1700] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:34:54 2022] DELETE /identity/v3/users/07f7ce072fdc48fda560e8f37cfc7a65 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:54.651669 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d89692-3ebe-4a10-b38b-888115c04bfc admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:54.657231 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e0d89692-3ebe-4a10-b38b-888115c04bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:54.667934 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1b59c-99af-4397-bd4e-bb97c1bcfd58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:54.672098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1b59c-99af-4397-bd4e-bb97c1bcfd58 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:54.696657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 831/1701] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:54.702028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812a0d6-0f25-4418-bb98-de63270462e8 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:54.702308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812a0d6-0f25-4418-bb98-de63270462e8 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:54.702594 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812a0d6-0f25-4418-bb98-de63270462e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:54.751306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-d812a0d6-0f25-4418-bb98-de63270462e8 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:54.758524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d812a0d6-0f25-4418-bb98-de63270462e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:54.940399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d89692-3ebe-4a10-b38b-888115c04bfc admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:54.958812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c0127-b3e8-4575-916f-074462666618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:54.961634 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0127-b3e8-4575-916f-074462666618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:54.961771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0127-b3e8-4575-916f-074462666618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:54.962007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c0127-b3e8-4575-916f-074462666618 admin admin] PATH_INFO: `/v3/projects/11fe18069781484f8d72ede097e6e131/users/55cc1e75a31d4b8ab7a700d7382030ba/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:55.031529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c0127-b3e8-4575-916f-074462666618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11fe18069781484f8d72ede097e6e131, user_id=55cc1e75a31d4b8ab7a700d7382030ba, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:55.037285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c0127-b3e8-4575-916f-074462666618 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:55.058156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 832/1702] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:55.067003 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa68ff-de13-4353-ba54-087af92f8f67 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:55.068000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa68ff-de13-4353-ba54-087af92f8f67 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:55.068510 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa68ff-de13-4353-ba54-087af92f8f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:55.083861 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 871/1703] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:54 2022] PUT /identity/v3/projects/11fe18069781484f8d72ede097e6e131/users/55cc1e75a31d4b8ab7a700d7382030ba/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:55.085080 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c0127-b3e8-4575-916f-074462666618 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:55.130442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-0dfa68ff-de13-4353-ba54-087af92f8f67 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:55.136717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-0dfa68ff-de13-4353-ba54-087af92f8f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:55.167723 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:55.222203 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c0127-b3e8-4575-916f-074462666618 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:55.241004 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f45c6d-eb1e-4fac-9a3f-8b2bcd3e94ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:55.243772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45c6d-eb1e-4fac-9a3f-8b2bcd3e94ab admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:55.245424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45c6d-eb1e-4fac-9a3f-8b2bcd3e94ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:55.246233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45c6d-eb1e-4fac-9a3f-8b2bcd3e94ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:55.247865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f45c6d-eb1e-4fac-9a3f-8b2bcd3e94ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:55.249916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f45c6d-eb1e-4fac-9a3f-8b2bcd3e94ab admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:55.297749 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 872/1704] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:55.298449 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f45c6d-eb1e-4fac-9a3f-8b2bcd3e94ab admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:55.327139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:55.341949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f45c6d-eb1e-4fac-9a3f-8b2bcd3e94ab admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:55.353186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597d17e-8aa5-4871-93fa-00fd780873b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:55.355135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597d17e-8aa5-4871-93fa-00fd780873b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:55.355535 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597d17e-8aa5-4871-93fa-00fd780873b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:55.355903 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597d17e-8aa5-4871-93fa-00fd780873b6 admin admin] PATH_INFO: `/v3/projects/11fe18069781484f8d72ede097e6e131/users/55cc1e75a31d4b8ab7a700d7382030ba/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:55.361780 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597d17e-8aa5-4871-93fa-00fd780873b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11fe18069781484f8d72ede097e6e131, user_id=55cc1e75a31d4b8ab7a700d7382030ba, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:55.387208 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597d17e-8aa5-4871-93fa-00fd780873b6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:55.431769 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 873/1705] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:55 2022] PUT /identity/v3/projects/11fe18069781484f8d72ede097e6e131/users/55cc1e75a31d4b8ab7a700d7382030ba/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:55.432821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597d17e-8aa5-4871-93fa-00fd780873b6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:55.433624 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 833/1706] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:55.437482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b597d17e-8aa5-4871-93fa-00fd780873b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:55.444697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2550a0-31f6-4d78-a47b-40f4a0b5907a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:55.445046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2550a0-31f6-4d78-a47b-40f4a0b5907a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:55.445327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2550a0-31f6-4d78-a47b-40f4a0b5907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:55.590336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-4d2550a0-31f6-4d78-a47b-40f4a0b5907a None None] MFA Rules not processed for user `55cc1e75a31d4b8ab7a700d7382030ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:55.591779 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4d2550a0-31f6-4d78-a47b-40f4a0b5907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:55.688106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597d17e-8aa5-4871-93fa-00fd780873b6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:55.692901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:55.693774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:55.694057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:55.694332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] PATH_INFO: `/v3/projects/da5267ce7b2b457e87caf15c9b4c5fe4` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:55.695700 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da5267ce7b2b457e87caf15c9b4c5fe4)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:55.697789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:55.723532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 834/1707] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:34:55.729903 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2550a0-31f6-4d78-a47b-40f4a0b5907a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:55.759283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2550a0-31f6-4d78-a47b-40f4a0b5907a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:55.803847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da5267ce7b2b457e87caf15c9b4c5fe4', 'request_id': 'req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:55.815898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da5267ce7b2b457e87caf15c9b4c5fe4', 'request_id': 'req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:55.833253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da5267ce7b2b457e87caf15c9b4c5fe4', 'request_id': 'req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:55.859577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] The token cache is being invalidate because project da5267ce7b2b457e87caf15c9b4c5fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:34:55.860285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:55.862340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:55.865891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 874/1708] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:34:55 2022] DELETE /identity/v3/projects/da5267ce7b2b457e87caf15c9b4c5fe4 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:55.868307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:55.870272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:55.908933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaaeaa-7b26-42b3-bc3d-8debced76d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:55.909702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaaeaa-7b26-42b3-bc3d-8debced76d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:55.910469 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaaeaa-7b26-42b3-bc3d-8debced76d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:55.910972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaaeaa-7b26-42b3-bc3d-8debced76d6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:55.911830 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efaaeaa-7b26-42b3-bc3d-8debced76d6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:34:55.912209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efaaeaa-7b26-42b3-bc3d-8debced76d6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:55.915752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efaaeaa-7b26-42b3-bc3d-8debced76d6f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:55.956981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 835/1709] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:34:55.958213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4451-3b1a-4b06-af3d-fb527aa54171 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:55.958512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4451-3b1a-4b06-af3d-fb527aa54171 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:55.958796 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a4451-3b1a-4b06-af3d-fb527aa54171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:55.958906 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28b47-ae8a-4d56-abe8-50d1db9142d2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:55.964654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66b768-d7bc-421c-a591-f4914f2f3446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:55.966801 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66b768-d7bc-421c-a591-f4914f2f3446 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:55.967135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66b768-d7bc-421c-a591-f4914f2f3446 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:55.967539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66b768-d7bc-421c-a591-f4914f2f3446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:55.969866 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3e66b768-d7bc-421c-a591-f4914f2f3446 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:55.978320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:56.012046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-5f5a4451-3b1a-4b06-af3d-fb527aa54171 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:56.015193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-5f5a4451-3b1a-4b06-af3d-fb527aa54171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:56.043650 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 836/1710] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:56.045601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a4451-3b1a-4b06-af3d-fb527aa54171 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:56.052914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-5f5a4451-3b1a-4b06-af3d-fb527aa54171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:56.100836 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a4451-3b1a-4b06-af3d-fb527aa54171 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:56.128749 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1d927-6b23-4571-a618-7dc038ede4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:56.131995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d927-6b23-4571-a618-7dc038ede4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:56.132293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d927-6b23-4571-a618-7dc038ede4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:56.132602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d927-6b23-4571-a618-7dc038ede4f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:56.133868 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1d927-6b23-4571-a618-7dc038ede4f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:56.136100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66b768-d7bc-421c-a591-f4914f2f3446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:56.137711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66b768-d7bc-421c-a591-f4914f2f3446 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:56.155749 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1d927-6b23-4571-a618-7dc038ede4f0 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:56.179087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 875/1711] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:56.189921 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb3384-7c7c-43eb-a525-1c6691f7d049 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:56.194296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb3384-7c7c-43eb-a525-1c6691f7d049 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:56.194806 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb3384-7c7c-43eb-a525-1c6691f7d049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:56.275363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 837/1712] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:56 2022] POST /identity/v3/projects => generated 401 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:56.279757 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1d927-6b23-4571-a618-7dc038ede4f0 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:56.280160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2ccb3384-7c7c-43eb-a525-1c6691f7d049 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:56.281793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2ccb3384-7c7c-43eb-a525-1c6691f7d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:56.526153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:56.566032 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 876/1713] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:56.574522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb3384-7c7c-43eb-a525-1c6691f7d049 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:56.609824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1d927-6b23-4571-a618-7dc038ede4f0 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:56.631071 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722643cd-54d5-4d31-9387-f4c03737aa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:56.633525 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722643cd-54d5-4d31-9387-f4c03737aa69 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:56.633875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722643cd-54d5-4d31-9387-f4c03737aa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:56.634172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722643cd-54d5-4d31-9387-f4c03737aa69 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:56.638372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722643cd-54d5-4d31-9387-f4c03737aa69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:56.644095 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722643cd-54d5-4d31-9387-f4c03737aa69 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:56.694245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 838/1714] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:56 2022] POST /identity/v3/users => generated 301 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:56.700079 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722643cd-54d5-4d31-9387-f4c03737aa69 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:56.712461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722643cd-54d5-4d31-9387-f4c03737aa69 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:56.719735 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135989f-ccbd-4b1a-8f44-090830f07854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:56.720949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135989f-ccbd-4b1a-8f44-090830f07854 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:56.721780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135989f-ccbd-4b1a-8f44-090830f07854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:56.722145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135989f-ccbd-4b1a-8f44-090830f07854 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:56.723592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135989f-ccbd-4b1a-8f44-090830f07854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:34:56.724002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135989f-ccbd-4b1a-8f44-090830f07854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:56.726045 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135989f-ccbd-4b1a-8f44-090830f07854 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:56.784297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 839/1715] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:34:56.808059 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135989f-ccbd-4b1a-8f44-090830f07854 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:56.849763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135989f-ccbd-4b1a-8f44-090830f07854 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:56.865222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fc90c-e70e-4adf-b2e8-496ee1692352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:56.867742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fc90c-e70e-4adf-b2e8-496ee1692352 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:56.868485 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fc90c-e70e-4adf-b2e8-496ee1692352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:56.869572 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fc90c-e70e-4adf-b2e8-496ee1692352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:56.872935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fc90c-e70e-4adf-b2e8-496ee1692352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:56.884958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fc90c-e70e-4adf-b2e8-496ee1692352 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:56.924653 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb3384-7c7c-43eb-a525-1c6691f7d049 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:56.934827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd551ecd-87f4-4fe9-91d0-062abdb1c7ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:56.935520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd551ecd-87f4-4fe9-91d0-062abdb1c7ca service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:56.935812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd551ecd-87f4-4fe9-91d0-062abdb1c7ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:56.936112 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd551ecd-87f4-4fe9-91d0-062abdb1c7ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:56.948601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dd551ecd-87f4-4fe9-91d0-062abdb1c7ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:56.961766 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 840/1716] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:56.966500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fc90c-e70e-4adf-b2e8-496ee1692352 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:57.018586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fc90c-e70e-4adf-b2e8-496ee1692352 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:57.042082 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9fc84-a9b9-4b74-8886-7f65419635d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:57.042880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9fc84-a9b9-4b74-8886-7f65419635d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:57.043164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9fc84-a9b9-4b74-8886-7f65419635d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:57.043494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9fc84-a9b9-4b74-8886-7f65419635d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:57.049735 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9fc84-a9b9-4b74-8886-7f65419635d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:57.058370 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9fc84-a9b9-4b74-8886-7f65419635d8 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:57.175566 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 841/1717] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:56 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:57.178363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9fc84-a9b9-4b74-8886-7f65419635d8 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:57.200887 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:57.206554 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd551ecd-87f4-4fe9-91d0-062abdb1c7ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:57.208990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd551ecd-87f4-4fe9-91d0-062abdb1c7ca service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:57.269744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 877/1718] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:34:57.273850 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd551ecd-87f4-4fe9-91d0-062abdb1c7ca service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:57.309056 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd551ecd-87f4-4fe9-91d0-062abdb1c7ca service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:57.428088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9fc84-a9b9-4b74-8886-7f65419635d8 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:57.433406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcedf1-7629-4825-b0cb-acfc368d0832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:57.434801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcedf1-7629-4825-b0cb-acfc368d0832 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:57.435276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcedf1-7629-4825-b0cb-acfc368d0832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:57.436160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcedf1-7629-4825-b0cb-acfc368d0832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:57.437107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcedf1-7629-4825-b0cb-acfc368d0832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:57.439203 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcedf1-7629-4825-b0cb-acfc368d0832 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:57.458540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 842/1719] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:57.461472 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcedf1-7629-4825-b0cb-acfc368d0832 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:57.475606 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcedf1-7629-4825-b0cb-acfc368d0832 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:57.483487 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6902e9-76bd-432a-aee6-2b2d092868b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:57.485158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6902e9-76bd-432a-aee6-2b2d092868b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:57.485632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6902e9-76bd-432a-aee6-2b2d092868b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:57.486136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6902e9-76bd-432a-aee6-2b2d092868b7 admin admin] PATH_INFO: `/v3/projects/502ebd2e4f784fa69f8f88ec3af184fd/users/d4dd02bb307e499a82f258eba058ea7d/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:57.516101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6902e9-76bd-432a-aee6-2b2d092868b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502ebd2e4f784fa69f8f88ec3af184fd, user_id=d4dd02bb307e499a82f258eba058ea7d, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:57.520410 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6902e9-76bd-432a-aee6-2b2d092868b7 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:57.561573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 843/1720] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:57 2022] PUT /identity/v3/projects/502ebd2e4f784fa69f8f88ec3af184fd/users/d4dd02bb307e499a82f258eba058ea7d/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:57.575668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd44833-7176-43e8-ac09-aa8aa9c40608 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:57.576738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b6995-8119-41b4-b28c-244abba66ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:57.577783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b6995-8119-41b4-b28c-244abba66ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:57.578083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd44833-7176-43e8-ac09-aa8aa9c40608 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:57.578362 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd44833-7176-43e8-ac09-aa8aa9c40608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:57.578819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b6995-8119-41b4-b28c-244abba66ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:57.579254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b6995-8119-41b4-b28c-244abba66ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:57.580238 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b6995-8119-41b4-b28c-244abba66ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:57.582447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b6995-8119-41b4-b28c-244abba66ef7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:57.635334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 878/1721] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:57 2022] POST /identity/v3/users => generated 287 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:57.641229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b6995-8119-41b4-b28c-244abba66ef7 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:57.677667 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-abd44833-7176-43e8-ac09-aa8aa9c40608 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:57.682675 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-abd44833-7176-43e8-ac09-aa8aa9c40608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:57.683182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b6995-8119-41b4-b28c-244abba66ef7 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:57.873611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:57.927927 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 844/1722] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:57.940443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e5834-8840-4510-8ab4-c32fd42c3e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:57.941355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5834-8840-4510-8ab4-c32fd42c3e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:57.946289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5834-8840-4510-8ab4-c32fd42c3e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:57.946289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5834-8840-4510-8ab4-c32fd42c3e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:57.946895 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e5834-8840-4510-8ab4-c32fd42c3e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:57.948899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e5834-8840-4510-8ab4-c32fd42c3e95 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:57.991240 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 879/1723] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:57.996229 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd44833-7176-43e8-ac09-aa8aa9c40608 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:58.013502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd44833-7176-43e8-ac09-aa8aa9c40608 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:58.028071 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ac024-c4e5-44b8-b4af-d825ff8a0bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:58.029935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ac024-c4e5-44b8-b4af-d825ff8a0bec admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:58.030882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ac024-c4e5-44b8-b4af-d825ff8a0bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:58.031179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ac024-c4e5-44b8-b4af-d825ff8a0bec admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:58.034296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ac024-c4e5-44b8-b4af-d825ff8a0bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:58.047679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ac024-c4e5-44b8-b4af-d825ff8a0bec admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:58.087239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e5834-8840-4510-8ab4-c32fd42c3e95 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:58.092102 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 845/1724] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:34:58.105476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e5834-8840-4510-8ab4-c32fd42c3e95 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:58.141156 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75f7d4-6b21-47b4-bb5c-92c26ef34df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:58.147340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f7d4-6b21-47b4-bb5c-92c26ef34df8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:58.147669 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f7d4-6b21-47b4-bb5c-92c26ef34df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:58.147949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f7d4-6b21-47b4-bb5c-92c26ef34df8 admin admin] PATH_INFO: `/v3/projects/1a22891e645f4dbd899392f751b299ca/users/971c81de6c3c45749c38f4e59e51e9c6/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:58.182621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ac024-c4e5-44b8-b4af-d825ff8a0bec admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:58.186266 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ae3ac024-c4e5-44b8-b4af-d825ff8a0bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:58.305715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75f7d4-6b21-47b4-bb5c-92c26ef34df8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a22891e645f4dbd899392f751b299ca, user_id=971c81de6c3c45749c38f4e59e51e9c6, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:58.330169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75f7d4-6b21-47b4-bb5c-92c26ef34df8 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:58.382395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 880/1725] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:34:58 2022] PUT /identity/v3/projects/1a22891e645f4dbd899392f751b299ca/users/971c81de6c3c45749c38f4e59e51e9c6/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:58.384037 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75f7d4-6b21-47b4-bb5c-92c26ef34df8 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:58.385506 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ed75f7d4-6b21-47b4-bb5c-92c26ef34df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:58.622765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:58.641012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75f7d4-6b21-47b4-bb5c-92c26ef34df8 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:58.646747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ac024-c4e5-44b8-b4af-d825ff8a0bec admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:58.665677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850a449-8551-4b3f-94a6-6acbf7d7a707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:58.673383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850a449-8551-4b3f-94a6-6acbf7d7a707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:58.673383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850a449-8551-4b3f-94a6-6acbf7d7a707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:58.673383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850a449-8551-4b3f-94a6-6acbf7d7a707 admin admin] PATH_INFO: `/v3/projects/90fd212d54c34c7aa7cf6af177d7c260` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:58.673816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850a449-8551-4b3f-94a6-6acbf7d7a707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90fd212d54c34c7aa7cf6af177d7c260)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:58.680697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850a449-8551-4b3f-94a6-6acbf7d7a707 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:58.783679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81285f51-8f9e-460e-b4a4-faf1419a58ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:58.784929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285f51-8f9e-460e-b4a4-faf1419a58ca service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:58.785536 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285f51-8f9e-460e-b4a4-faf1419a58ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:58.786077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285f51-8f9e-460e-b4a4-faf1419a58ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:58.814286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81285f51-8f9e-460e-b4a4-faf1419a58ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:58.816266 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81285f51-8f9e-460e-b4a4-faf1419a58ca service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:58.897112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 846/1726] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:34:58.900588 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdbe8d-fec5-4c73-a3c2-31713aeae81c None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:58.902347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdbe8d-fec5-4c73-a3c2-31713aeae81c None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:58.902970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdbe8d-fec5-4c73-a3c2-31713aeae81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:58.906727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3850a449-8551-4b3f-94a6-6acbf7d7a707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90fd212d54c34c7aa7cf6af177d7c260', 'request_id': 'req-3850a449-8551-4b3f-94a6-6acbf7d7a707'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:58.925822 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3850a449-8551-4b3f-94a6-6acbf7d7a707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90fd212d54c34c7aa7cf6af177d7c260', 'request_id': 'req-3850a449-8551-4b3f-94a6-6acbf7d7a707'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:58.964547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3850a449-8551-4b3f-94a6-6acbf7d7a707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90fd212d54c34c7aa7cf6af177d7c260', 'request_id': 'req-3850a449-8551-4b3f-94a6-6acbf7d7a707'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:58.981523 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-07fdbe8d-fec5-4c73-a3c2-31713aeae81c None None] MFA Rules not processed for user `971c81de6c3c45749c38f4e59e51e9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:58.983666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-07fdbe8d-fec5-4c73-a3c2-31713aeae81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:59.012008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3850a449-8551-4b3f-94a6-6acbf7d7a707 admin admin] The token cache is being invalidate because project 90fd212d54c34c7aa7cf6af177d7c260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:34:59.015950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3850a449-8551-4b3f-94a6-6acbf7d7a707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:59.017814 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3850a449-8551-4b3f-94a6-6acbf7d7a707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:34:59.025804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 881/1727] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:34:58 2022] DELETE /identity/v3/projects/90fd212d54c34c7aa7cf6af177d7c260 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:34:59.031520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f9740-2e23-4aed-8ddd-4a6aa7b9aae5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:59.031898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f9740-2e23-4aed-8ddd-4a6aa7b9aae5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:59.032205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f9740-2e23-4aed-8ddd-4a6aa7b9aae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:59.106653 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a78f9740-2e23-4aed-8ddd-4a6aa7b9aae5 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:59.113627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a78f9740-2e23-4aed-8ddd-4a6aa7b9aae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:59.243108 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 847/1728] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:59.244407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdbe8d-fec5-4c73-a3c2-31713aeae81c None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:59.252694 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-07fdbe8d-fec5-4c73-a3c2-31713aeae81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:59.366351 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 882/1729] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:59.372575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41ccaf-5c79-4409-a15c-357eaae6c1e5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:59.375210 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41ccaf-5c79-4409-a15c-357eaae6c1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:59.376841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41ccaf-5c79-4409-a15c-357eaae6c1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:59.385610 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:59.444294 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4d41ccaf-5c79-4409-a15c-357eaae6c1e5 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:34:59.449110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4d41ccaf-5c79-4409-a15c-357eaae6c1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:34:59.487832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 883/1730] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:34:59.490246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41ccaf-5c79-4409-a15c-357eaae6c1e5 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:59.500712 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdbe8d-fec5-4c73-a3c2-31713aeae81c None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:59.514389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41ccaf-5c79-4409-a15c-357eaae6c1e5 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:59.517443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80c200-44ad-48d3-a9b5-7dc44b20fc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:59.518456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c200-44ad-48d3-a9b5-7dc44b20fc10 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:59.519883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c200-44ad-48d3-a9b5-7dc44b20fc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:59.521237 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c200-44ad-48d3-a9b5-7dc44b20fc10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:59.525631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80c200-44ad-48d3-a9b5-7dc44b20fc10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:59.528371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80c200-44ad-48d3-a9b5-7dc44b20fc10 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:59.536623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80a0ef-15b8-4572-8936-10c4633cb2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:59.537535 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80a0ef-15b8-4572-8936-10c4633cb2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:59.540146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80a0ef-15b8-4572-8936-10c4633cb2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:59.540977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80a0ef-15b8-4572-8936-10c4633cb2a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:59.542131 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80a0ef-15b8-4572-8936-10c4633cb2a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:34:59.543777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80a0ef-15b8-4572-8936-10c4633cb2a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:59.547631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80a0ef-15b8-4572-8936-10c4633cb2a4 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:59.579591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 884/1731] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:34:59.583832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80a0ef-15b8-4572-8936-10c4633cb2a4 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:59.593063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 848/1732] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:59 2022] POST /identity/v3/projects => generated 371 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:59.594136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80c200-44ad-48d3-a9b5-7dc44b20fc10 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:59.621377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80a0ef-15b8-4572-8936-10c4633cb2a4 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:59.842355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80c200-44ad-48d3-a9b5-7dc44b20fc10 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:34:59.848359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae00e0-55cd-4194-a24c-07a4302142bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:59.850582 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae00e0-55cd-4194-a24c-07a4302142bd admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:59.858802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae00e0-55cd-4194-a24c-07a4302142bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:59.860212 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae00e0-55cd-4194-a24c-07a4302142bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:59.862952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae00e0-55cd-4194-a24c-07a4302142bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:59.866140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae00e0-55cd-4194-a24c-07a4302142bd admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:59.871938 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26e58-78a6-460c-83d3-9aabeb3c4ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:34:59.872763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26e58-78a6-460c-83d3-9aabeb3c4ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:34:59.873148 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26e58-78a6-460c-83d3-9aabeb3c4ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:34:59.873520 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca26e58-78a6-460c-83d3-9aabeb3c4ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:34:59.876269 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca26e58-78a6-460c-83d3-9aabeb3c4ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:34:59.881253 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca26e58-78a6-460c-83d3-9aabeb3c4ee1 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:34:59.927104 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:34:59.969344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 849/1733] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:59 2022] POST /identity/v3/users => generated 292 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:59.972498 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26e58-78a6-460c-83d3-9aabeb3c4ee1 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:34:59.982063 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 885/1734] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:34:59 2022] POST /identity/v3/projects => generated 367 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:34:59.983450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae00e0-55cd-4194-a24c-07a4302142bd admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:00.013876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca26e58-78a6-460c-83d3-9aabeb3c4ee1 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:00.222459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae00e0-55cd-4194-a24c-07a4302142bd admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:00.227809 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e0bb5-d57e-4bf8-b746-9b8cd22c50c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:00.229643 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e0bb5-d57e-4bf8-b746-9b8cd22c50c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:00.241069 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e0bb5-d57e-4bf8-b746-9b8cd22c50c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:00.241069 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e0bb5-d57e-4bf8-b746-9b8cd22c50c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:00.241381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e0bb5-d57e-4bf8-b746-9b8cd22c50c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:00.243300 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e0bb5-d57e-4bf8-b746-9b8cd22c50c8 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:00.244380 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c8aea-ac3a-4150-8494-4793544f6c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:00.245186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c8aea-ac3a-4150-8494-4793544f6c50 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:00.245683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c8aea-ac3a-4150-8494-4793544f6c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:00.246310 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c8aea-ac3a-4150-8494-4793544f6c50 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:00.248249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c8aea-ac3a-4150-8494-4793544f6c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:00.252500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c8aea-ac3a-4150-8494-4793544f6c50 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:00.323411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 886/1735] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:34:59 2022] POST /identity/v3/users => generated 284 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:00.324768 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 850/1736] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:00.333616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c8aea-ac3a-4150-8494-4793544f6c50 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:00.333996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e0bb5-d57e-4bf8-b746-9b8cd22c50c8 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:00.353823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c8aea-ac3a-4150-8494-4793544f6c50 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:00.379698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818fdfb-0c29-41d1-85c3-5715e7f45753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:00.379698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818fdfb-0c29-41d1-85c3-5715e7f45753 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:00.379698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818fdfb-0c29-41d1-85c3-5715e7f45753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:00.379698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818fdfb-0c29-41d1-85c3-5715e7f45753 admin admin] PATH_INFO: `/v3/projects/3442fc53847a4a1d84db06d626843424/users/f64f68974e8f47adbb4a715dd2642725/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:00.396771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818fdfb-0c29-41d1-85c3-5715e7f45753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3442fc53847a4a1d84db06d626843424, user_id=f64f68974e8f47adbb4a715dd2642725, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:00.401880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818fdfb-0c29-41d1-85c3-5715e7f45753 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:00.431990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 887/1737] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:00 2022] PUT /identity/v3/projects/3442fc53847a4a1d84db06d626843424/users/f64f68974e8f47adbb4a715dd2642725/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:00.435396 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818fdfb-0c29-41d1-85c3-5715e7f45753 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:00.437540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e0bb5-d57e-4bf8-b746-9b8cd22c50c8 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:00.592453 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:00.645695 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daadcc-8192-416c-bcae-75973a280d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:00.648126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daadcc-8192-416c-bcae-75973a280d1f admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:00.651873 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daadcc-8192-416c-bcae-75973a280d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:00.652246 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daadcc-8192-416c-bcae-75973a280d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:00.655610 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66daadcc-8192-416c-bcae-75973a280d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:00.661101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66daadcc-8192-416c-bcae-75973a280d1f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:00.683384 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818fdfb-0c29-41d1-85c3-5715e7f45753 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:00.704786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c0a6b-c3cf-46d3-9f73-baa2e1f3d4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:00.705509 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c0a6b-c3cf-46d3-9f73-baa2e1f3d4ec admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:00.705775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c0a6b-c3cf-46d3-9f73-baa2e1f3d4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:00.706055 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c0a6b-c3cf-46d3-9f73-baa2e1f3d4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:00.707193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c0a6b-c3cf-46d3-9f73-baa2e1f3d4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:00.708923 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c0a6b-c3cf-46d3-9f73-baa2e1f3d4ec admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:00.710966 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 851/1738] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:00.712005 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daadcc-8192-416c-bcae-75973a280d1f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:00.748851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daadcc-8192-416c-bcae-75973a280d1f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:00.769129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 888/1739] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:00.770540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c0a6b-c3cf-46d3-9f73-baa2e1f3d4ec admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:00.782496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cfb33-b6de-4499-bbfa-e0a39e1606ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:00.783188 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cfb33-b6de-4499-bbfa-e0a39e1606ca admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:00.783536 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cfb33-b6de-4499-bbfa-e0a39e1606ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:00.783820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cfb33-b6de-4499-bbfa-e0a39e1606ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:00.784849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cfb33-b6de-4499-bbfa-e0a39e1606ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:00.797841 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cfb33-b6de-4499-bbfa-e0a39e1606ca admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:00.807187 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c0a6b-c3cf-46d3-9f73-baa2e1f3d4ec admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:00.828771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb258b-44e3-4c51-a8e9-e2bccd8ce2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:00.831933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb258b-44e3-4c51-a8e9-e2bccd8ce2d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:00.832246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb258b-44e3-4c51-a8e9-e2bccd8ce2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:00.832520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb258b-44e3-4c51-a8e9-e2bccd8ce2d4 admin admin] PATH_INFO: `/v3/projects/3442fc53847a4a1d84db06d626843424/users/f64f68974e8f47adbb4a715dd2642725/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:00.840457 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 852/1740] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:00.853609 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb258b-44e3-4c51-a8e9-e2bccd8ce2d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3442fc53847a4a1d84db06d626843424, user_id=f64f68974e8f47adbb4a715dd2642725, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:00.856822 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb258b-44e3-4c51-a8e9-e2bccd8ce2d4 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:00.862518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8cff2-6c26-434d-8fb5-52ce86a330ce None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:00.862518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8cff2-6c26-434d-8fb5-52ce86a330ce None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:00.862809 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8cff2-6c26-434d-8fb5-52ce86a330ce None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:00.864486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 853/1741] 10.222.0.50 () {54 vars in 921 bytes} [Wed Jun 15 10:35:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:35:00.865228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8cff2-6c26-434d-8fb5-52ce86a330ce None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:00.915516 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 889/1742] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:00 2022] PUT /identity/v3/projects/3442fc53847a4a1d84db06d626843424/users/f64f68974e8f47adbb4a715dd2642725/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:00.917652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8e9a-995c-4a6d-99f6-0a0af0ba21ba None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:00.917945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8e9a-995c-4a6d-99f6-0a0af0ba21ba None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:00.918225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8e9a-995c-4a6d-99f6-0a0af0ba21ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:00.922875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8cff2-6c26-434d-8fb5-52ce86a330ce None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:00.990527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8ade8e9a-995c-4a6d-99f6-0a0af0ba21ba None None] MFA Rules not processed for user `81e9805ec4c44cedb658b7becf768369`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:00.991877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8ade8e9a-995c-4a6d-99f6-0a0af0ba21ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:01.129392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:01.131025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7686ab7-27bb-4991-b0f6-7812e01e113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:01.131997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7686ab7-27bb-4991-b0f6-7812e01e113a admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:01.132275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7686ab7-27bb-4991-b0f6-7812e01e113a admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:01.134716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7686ab7-27bb-4991-b0f6-7812e01e113a admin admin] PATH_INFO: `/v3/projects/bd6e16a4e3ae42d8946643677056c81d/users/4c93387c03ab40778ee7b4b2ed09f76e/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:01.190269 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7686ab7-27bb-4991-b0f6-7812e01e113a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd6e16a4e3ae42d8946643677056c81d, user_id=4c93387c03ab40778ee7b4b2ed09f76e, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:01.193122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7686ab7-27bb-4991-b0f6-7812e01e113a admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:01.259450 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 854/1743] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:00 2022] PUT /identity/v3/projects/bd6e16a4e3ae42d8946643677056c81d/users/4c93387c03ab40778ee7b4b2ed09f76e/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:01.271055 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 890/1744] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Jun 15 10:35:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:01.272572 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1698149-4f9f-472a-bb2a-993b10b80162 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:01.272867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1698149-4f9f-472a-bb2a-993b10b80162 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:01.273181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1698149-4f9f-472a-bb2a-993b10b80162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:01.277102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e5561-7ac1-44d3-8e1d-d4964a4fae7f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:01.277391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e5561-7ac1-44d3-8e1d-d4964a4fae7f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:01.277667 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e5561-7ac1-44d3-8e1d-d4964a4fae7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:01.422842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-d1698149-4f9f-472a-bb2a-993b10b80162 None None] MFA Rules not processed for user `f64f68974e8f47adbb4a715dd2642725`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:01.424711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a75e5561-7ac1-44d3-8e1d-d4964a4fae7f None None] MFA Rules not processed for user `4c93387c03ab40778ee7b4b2ed09f76e`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:01.426340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a75e5561-7ac1-44d3-8e1d-d4964a4fae7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:01.429980 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d1698149-4f9f-472a-bb2a-993b10b80162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:01.752623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 855/1745] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:01.754853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1698149-4f9f-472a-bb2a-993b10b80162 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:01.782593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 891/1746] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:01.782593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e5561-7ac1-44d3-8e1d-d4964a4fae7f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:01.782978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d1698149-4f9f-472a-bb2a-993b10b80162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:01.790475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a75e5561-7ac1-44d3-8e1d-d4964a4fae7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:01.985004 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:02.097370 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e5561-7ac1-44d3-8e1d-d4964a4fae7f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:02.120189 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe989fa-5fb7-4b9b-8087-00376861dda9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:02.120933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe989fa-5fb7-4b9b-8087-00376861dda9 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:02.121220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe989fa-5fb7-4b9b-8087-00376861dda9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:02.121513 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe989fa-5fb7-4b9b-8087-00376861dda9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:02.148950 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1698149-4f9f-472a-bb2a-993b10b80162 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:02.166991 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe989fa-5fb7-4b9b-8087-00376861dda9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:02.169542 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe989fa-5fb7-4b9b-8087-00376861dda9 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:02.181196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670e9df-f62d-4eb8-8978-ded670db53ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:02.181889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e9df-f62d-4eb8-8978-ded670db53ce service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:02.182145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e9df-f62d-4eb8-8978-ded670db53ce service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:02.182449 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e9df-f62d-4eb8-8978-ded670db53ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:02.204930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 892/1747] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:02.222249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe989fa-5fb7-4b9b-8087-00376861dda9 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:02.236152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670e9df-f62d-4eb8-8978-ded670db53ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:02.245917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670e9df-f62d-4eb8-8978-ded670db53ce service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:02.309540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 856/1748] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:02.453216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670e9df-f62d-4eb8-8978-ded670db53ce service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:02.469929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670e9df-f62d-4eb8-8978-ded670db53ce service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:02.497440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a3cfa-0e27-46e6-ba8d-38529bf21ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:02.498092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a3cfa-0e27-46e6-ba8d-38529bf21ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:02.498375 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a3cfa-0e27-46e6-ba8d-38529bf21ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:02.498679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a3cfa-0e27-46e6-ba8d-38529bf21ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:02.589127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe989fa-5fb7-4b9b-8087-00376861dda9 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:02.620328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9478e-2557-46d1-9ae9-b5d34ac1c72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:02.621027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9478e-2557-46d1-9ae9-b5d34ac1c72c admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:02.621314 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9478e-2557-46d1-9ae9-b5d34ac1c72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:02.621590 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9478e-2557-46d1-9ae9-b5d34ac1c72c admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:02.622301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9478e-2557-46d1-9ae9-b5d34ac1c72c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:02.631837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9478e-2557-46d1-9ae9-b5d34ac1c72c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:02.681931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:02.741375 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 893/1749] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:02 2022] POST /identity/v3/projects => generated 369 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:02.743612 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9478e-2557-46d1-9ae9-b5d34ac1c72c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:02.765790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a3cfa-0e27-46e6-ba8d-38529bf21ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:02.768124 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a3cfa-0e27-46e6-ba8d-38529bf21ba9 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:02.805311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 857/1750] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:02.912537 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9478e-2557-46d1-9ae9-b5d34ac1c72c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:02.927835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f0d9-ff4b-4902-af82-6747a5b95eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:02.928459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f0d9-ff4b-4902-af82-6747a5b95eaa admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:02.928891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f0d9-ff4b-4902-af82-6747a5b95eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:02.929176 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f0d9-ff4b-4902-af82-6747a5b95eaa admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:02.930632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0f0d9-ff4b-4902-af82-6747a5b95eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:02.932657 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0f0d9-ff4b-4902-af82-6747a5b95eaa admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:03.004816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 894/1751] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:02 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:03.008994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a3cfa-0e27-46e6-ba8d-38529bf21ba9 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:03.022798 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a3cfa-0e27-46e6-ba8d-38529bf21ba9 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:03.049304 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c59cb9-471a-4f44-8384-916ce0b4f7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:03.053559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c59cb9-471a-4f44-8384-916ce0b4f7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:03.053926 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c59cb9-471a-4f44-8384-916ce0b4f7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:03.054218 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c59cb9-471a-4f44-8384-916ce0b4f7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:03.055593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c59cb9-471a-4f44-8384-916ce0b4f7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:03.056906 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c59cb9-471a-4f44-8384-916ce0b4f7c8 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:03.113118 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f0d9-ff4b-4902-af82-6747a5b95eaa admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:03.125068 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0f0d9-ff4b-4902-af82-6747a5b95eaa admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:03.125751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 858/1752] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:03.153047 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d6c9a-528c-4d9f-b8b8-c6424ec08d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:03.154175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d6c9a-528c-4d9f-b8b8-c6424ec08d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:03.154460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d6c9a-528c-4d9f-b8b8-c6424ec08d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:03.154740 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d6c9a-528c-4d9f-b8b8-c6424ec08d72 admin admin] PATH_INFO: `/v3/projects/49d1c5720e2e498fa8b6c0662e10b44e/users/1b1f8dd7ec59441d8db98f82ed1bc30d/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:03.231977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d6c9a-528c-4d9f-b8b8-c6424ec08d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d1c5720e2e498fa8b6c0662e10b44e, user_id=1b1f8dd7ec59441d8db98f82ed1bc30d, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:03.234946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d6c9a-528c-4d9f-b8b8-c6424ec08d72 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:03.270734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 895/1753] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:03 2022] PUT /identity/v3/projects/49d1c5720e2e498fa8b6c0662e10b44e/users/1b1f8dd7ec59441d8db98f82ed1bc30d/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:03.275440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c59cb9-471a-4f44-8384-916ce0b4f7c8 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:03.286658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c59cb9-471a-4f44-8384-916ce0b4f7c8 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:03.451942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25553c14-feb4-4184-9f17-6ffdf01c5073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:03.452227 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25553c14-feb4-4184-9f17-6ffdf01c5073 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:03.452964 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25553c14-feb4-4184-9f17-6ffdf01c5073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:03.453225 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25553c14-feb4-4184-9f17-6ffdf01c5073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:03.453996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25553c14-feb4-4184-9f17-6ffdf01c5073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:03.457168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25553c14-feb4-4184-9f17-6ffdf01c5073 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:03.491528 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 859/1754] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:03.496708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d6c9a-528c-4d9f-b8b8-c6424ec08d72 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:03.513167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d6c9a-528c-4d9f-b8b8-c6424ec08d72 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:03.521699 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346472b0-f9a0-490a-973b-bfa8eb45c7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:03.522581 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346472b0-f9a0-490a-973b-bfa8eb45c7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:03.522863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346472b0-f9a0-490a-973b-bfa8eb45c7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:03.523715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346472b0-f9a0-490a-973b-bfa8eb45c7d5 admin admin] PATH_INFO: `/v3/projects/49d1c5720e2e498fa8b6c0662e10b44e/users/1b1f8dd7ec59441d8db98f82ed1bc30d/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:03.533833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346472b0-f9a0-490a-973b-bfa8eb45c7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d1c5720e2e498fa8b6c0662e10b44e, user_id=1b1f8dd7ec59441d8db98f82ed1bc30d, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:03.536609 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346472b0-f9a0-490a-973b-bfa8eb45c7d5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:03.560421 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e0003-645d-4055-a7ab-360b5a0a6cb1 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:03.560819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e0003-645d-4055-a7ab-360b5a0a6cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:03.561320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e0003-645d-4055-a7ab-360b5a0a6cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:03.579078 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 896/1755] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:03 2022] PUT /identity/v3/projects/49d1c5720e2e498fa8b6c0662e10b44e/users/1b1f8dd7ec59441d8db98f82ed1bc30d/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:03.591301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c17a8-b334-457a-bcdc-9c37c115b847 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:03.592147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c17a8-b334-457a-bcdc-9c37c115b847 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:03.592438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c17a8-b334-457a-bcdc-9c37c115b847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:03.657472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3b3c17a8-b334-457a-bcdc-9c37c115b847 None None] MFA Rules not processed for user `1b1f8dd7ec59441d8db98f82ed1bc30d`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:03.657472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3b3c17a8-b334-457a-bcdc-9c37c115b847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:03.677100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-a01e0003-645d-4055-a7ab-360b5a0a6cb1 None None] MFA Rules not processed for user `abbeca853267434eb1d2fff664f32f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:03.684289 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a01e0003-645d-4055-a7ab-360b5a0a6cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:03.800244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 897/1756] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:03 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:03.814911 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c17a8-b334-457a-bcdc-9c37c115b847 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:03.829822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:03.969721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 860/1757] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:03.977060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e0003-645d-4055-a7ab-360b5a0a6cb1 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:03.982809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:03.987056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a01e0003-645d-4055-a7ab-360b5a0a6cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:04.088162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c17a8-b334-457a-bcdc-9c37c115b847 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:04.098836 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae6a00-af25-422d-ab7d-ea8122d578d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:04.100433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae6a00-af25-422d-ab7d-ea8122d578d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:04.100724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae6a00-af25-422d-ab7d-ea8122d578d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:04.103705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae6a00-af25-422d-ab7d-ea8122d578d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:04.131196 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae6a00-af25-422d-ab7d-ea8122d578d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:04.133964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae6a00-af25-422d-ab7d-ea8122d578d7 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:04.188133 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 898/1758] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:03 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:04.226668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e0003-645d-4055-a7ab-360b5a0a6cb1 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:04.239078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29f4e5-48b5-4f1a-94e7-a7ed33fa83b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:04.240983 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29f4e5-48b5-4f1a-94e7-a7ed33fa83b8 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:04.241276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29f4e5-48b5-4f1a-94e7-a7ed33fa83b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:04.241658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29f4e5-48b5-4f1a-94e7-a7ed33fa83b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:04.253408 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29f4e5-48b5-4f1a-94e7-a7ed33fa83b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:04.255354 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29f4e5-48b5-4f1a-94e7-a7ed33fa83b8 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:04.271670 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 861/1759] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:04.475334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae6a00-af25-422d-ab7d-ea8122d578d7 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:04.489145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae6a00-af25-422d-ab7d-ea8122d578d7 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:04.501286 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17542519-ade1-4474-a229-6edd6a55d745 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:04.502167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17542519-ade1-4474-a229-6edd6a55d745 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:04.502635 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17542519-ade1-4474-a229-6edd6a55d745 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:04.503076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17542519-ade1-4474-a229-6edd6a55d745 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:04.683679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17542519-ade1-4474-a229-6edd6a55d745 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:04.689966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17542519-ade1-4474-a229-6edd6a55d745 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:04.718768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 899/1760] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:06.513522 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124560c-7fe9-499a-a53c-207fe2158e7a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:06.514086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124560c-7fe9-499a-a53c-207fe2158e7a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:06.514086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124560c-7fe9-499a-a53c-207fe2158e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:06.549862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-a124560c-7fe9-499a-a53c-207fe2158e7a None None] MFA Rules not processed for user `d4dd02bb307e499a82f258eba058ea7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:06.551961 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a124560c-7fe9-499a-a53c-207fe2158e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:06.600298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43f27b-6fdf-4aef-b7e8-c10e7188c218 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:06.600888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43f27b-6fdf-4aef-b7e8-c10e7188c218 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:06.600888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43f27b-6fdf-4aef-b7e8-c10e7188c218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:06.641640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5d43f27b-6fdf-4aef-b7e8-c10e7188c218 None None] MFA Rules not processed for user `24d4ac4faaed44cbb9c20a5ae20a356a`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:06.643661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5d43f27b-6fdf-4aef-b7e8-c10e7188c218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:06.732206 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 900/1761] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:06.754163 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 862/1762] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:06.758804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43f27b-6fdf-4aef-b7e8-c10e7188c218 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:06.760540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5d43f27b-6fdf-4aef-b7e8-c10e7188c218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:06.896764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43f27b-6fdf-4aef-b7e8-c10e7188c218 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:06.906322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33db60-ab8c-42be-bf2b-40e3322f7600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:06.907384 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33db60-ab8c-42be-bf2b-40e3322f7600 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:06.909188 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33db60-ab8c-42be-bf2b-40e3322f7600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:06.909188 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33db60-ab8c-42be-bf2b-40e3322f7600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:06.909188 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33db60-ab8c-42be-bf2b-40e3322f7600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:06.913677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33db60-ab8c-42be-bf2b-40e3322f7600 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:06.942742 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:06.958003 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 901/1763] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:06 2022] POST /identity/v3/projects => generated 405 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:06.962220 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124560c-7fe9-499a-a53c-207fe2158e7a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:06.983907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124560c-7fe9-499a-a53c-207fe2158e7a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:07.165661 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:07.182630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a4d8b-fb07-422b-bea5-6b890dbab2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:07.183881 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a4d8b-fb07-422b-bea5-6b890dbab2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:07.184597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a4d8b-fb07-422b-bea5-6b890dbab2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:07.185385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a4d8b-fb07-422b-bea5-6b890dbab2c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:07.187737 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a4d8b-fb07-422b-bea5-6b890dbab2c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:07.192270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a4d8b-fb07-422b-bea5-6b890dbab2c4 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:07.243201 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 863/1764] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:06 2022] POST /identity/v3/users => generated 309 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:07.245179 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33db60-ab8c-42be-bf2b-40e3322f7600 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:07.263971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33db60-ab8c-42be-bf2b-40e3322f7600 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:07.274475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a908046-77f2-43bf-8baf-6613ad760382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:07.276655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a908046-77f2-43bf-8baf-6613ad760382 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:07.277694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a908046-77f2-43bf-8baf-6613ad760382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:07.278505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a908046-77f2-43bf-8baf-6613ad760382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:07.279903 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a908046-77f2-43bf-8baf-6613ad760382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:07.281965 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a908046-77f2-43bf-8baf-6613ad760382 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:07.307949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a4d8b-fb07-422b-bea5-6b890dbab2c4 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:07.308440 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 902/1765] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:07.323773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a4d8b-fb07-422b-bea5-6b890dbab2c4 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:07.341447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b9cba-aa32-4a62-be7b-31bb7135deb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:07.341447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b9cba-aa32-4a62-be7b-31bb7135deb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:07.341447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b9cba-aa32-4a62-be7b-31bb7135deb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:07.341447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b9cba-aa32-4a62-be7b-31bb7135deb3 admin admin] PATH_INFO: `/v3/projects/1de584dd864f4d8ebc707f74f63a8b86/users/0c9a8a1dffaf4c548bc8ad017b33959d/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:07.378173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b9cba-aa32-4a62-be7b-31bb7135deb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de584dd864f4d8ebc707f74f63a8b86, user_id=0c9a8a1dffaf4c548bc8ad017b33959d, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:07.381106 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b9cba-aa32-4a62-be7b-31bb7135deb3 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:07.421548 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 864/1766] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:07 2022] PUT /identity/v3/projects/1de584dd864f4d8ebc707f74f63a8b86/users/0c9a8a1dffaf4c548bc8ad017b33959d/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:07.423520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a908046-77f2-43bf-8baf-6613ad760382 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:07.447438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a908046-77f2-43bf-8baf-6613ad760382 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:07.620568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702a473-1880-4a27-9c36-a8afd5689db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:07.621271 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702a473-1880-4a27-9c36-a8afd5689db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:07.621557 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702a473-1880-4a27-9c36-a8afd5689db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:07.621837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702a473-1880-4a27-9c36-a8afd5689db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:07.622572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702a473-1880-4a27-9c36-a8afd5689db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:07.626209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702a473-1880-4a27-9c36-a8afd5689db5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:07.652579 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 903/1767] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:07.656338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b9cba-aa32-4a62-be7b-31bb7135deb3 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:07.681319 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702a473-1880-4a27-9c36-a8afd5689db5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:07.683966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2702a473-1880-4a27-9c36-a8afd5689db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:07.685393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b9cba-aa32-4a62-be7b-31bb7135deb3 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:07.691348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fca1c-cd4d-4702-815d-142e10c72b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:07.692532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fca1c-cd4d-4702-815d-142e10c72b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:07.692994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fca1c-cd4d-4702-815d-142e10c72b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:07.693467 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fca1c-cd4d-4702-815d-142e10c72b55 admin admin] PATH_INFO: `/v3/projects/1de584dd864f4d8ebc707f74f63a8b86/users/0c9a8a1dffaf4c548bc8ad017b33959d/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:07.699304 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fca1c-cd4d-4702-815d-142e10c72b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de584dd864f4d8ebc707f74f63a8b86, user_id=0c9a8a1dffaf4c548bc8ad017b33959d, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:07.701596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702a473-1880-4a27-9c36-a8afd5689db5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:07.707654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fca1c-cd4d-4702-815d-142e10c72b55 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:07.732562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a297c-0c60-4955-9f3c-4448b26079ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:07.733487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a297c-0c60-4955-9f3c-4448b26079ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:07.733768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a297c-0c60-4955-9f3c-4448b26079ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:07.734920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a297c-0c60-4955-9f3c-4448b26079ca admin admin] PATH_INFO: `/v3/users/800456b73d3f47cdb2242d30285129d3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:07.737048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a297c-0c60-4955-9f3c-4448b26079ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=800456b73d3f47cdb2242d30285129d3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:07.740639 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 865/1768] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:07 2022] PUT /identity/v3/projects/1de584dd864f4d8ebc707f74f63a8b86/users/0c9a8a1dffaf4c548bc8ad017b33959d/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:07.740793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a297c-0c60-4955-9f3c-4448b26079ca admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:07.934000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c79a297c-0c60-4955-9f3c-4448b26079ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800456b73d3f47cdb2242d30285129d3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:07.959257 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c79a297c-0c60-4955-9f3c-4448b26079ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800456b73d3f47cdb2242d30285129d3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:07.965816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c79a297c-0c60-4955-9f3c-4448b26079ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800456b73d3f47cdb2242d30285129d3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:07.980972 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c79a297c-0c60-4955-9f3c-4448b26079ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800456b73d3f47cdb2242d30285129d3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:08.000038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c79a297c-0c60-4955-9f3c-4448b26079ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800456b73d3f47cdb2242d30285129d3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:08.008462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 904/1769] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:07 2022] DELETE /identity/v3/users/800456b73d3f47cdb2242d30285129d3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:08.013111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463fcb-f4d9-4193-aa92-26aa5f203cbe None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:08.013407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463fcb-f4d9-4193-aa92-26aa5f203cbe None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:08.013712 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1463fcb-f4d9-4193-aa92-26aa5f203cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:08.056678 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-b1463fcb-f4d9-4193-aa92-26aa5f203cbe None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:08.058573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b1463fcb-f4d9-4193-aa92-26aa5f203cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:08.180608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 866/1770] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:08.229179 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a297c-0c60-4955-9f3c-4448b26079ca admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:08.230890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c79a297c-0c60-4955-9f3c-4448b26079ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:08.361603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a297c-0c60-4955-9f3c-4448b26079ca admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:08.367901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435871d-d2f1-4f2b-8b82-e443bf9c5013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:08.368941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435871d-d2f1-4f2b-8b82-e443bf9c5013 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:08.369453 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435871d-d2f1-4f2b-8b82-e443bf9c5013 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:08.369985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435871d-d2f1-4f2b-8b82-e443bf9c5013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:08.389531 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435871d-d2f1-4f2b-8b82-e443bf9c5013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:08.392859 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435871d-d2f1-4f2b-8b82-e443bf9c5013 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:08.401618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:08.411017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 905/1771] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:09.569372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b306f9-ffd4-4c6c-90e9-b36196778d29 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:09.570371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b306f9-ffd4-4c6c-90e9-b36196778d29 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:09.571068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b306f9-ffd4-4c6c-90e9-b36196778d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:09.607933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-b8b306f9-ffd4-4c6c-90e9-b36196778d29 None None] MFA Rules not processed for user `abbeca853267434eb1d2fff664f32f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:09.609388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b8b306f9-ffd4-4c6c-90e9-b36196778d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:09.701056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 867/1772] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:09.717063 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61579f0e-065c-499b-9f06-84aeb6aa7d22 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:09.718088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61579f0e-065c-499b-9f06-84aeb6aa7d22 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:09.718530 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61579f0e-065c-499b-9f06-84aeb6aa7d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:09.739996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b306f9-ffd4-4c6c-90e9-b36196778d29 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:09.744156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b8b306f9-ffd4-4c6c-90e9-b36196778d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:09.769049 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-61579f0e-065c-499b-9f06-84aeb6aa7d22 None None] MFA Rules not processed for user `0c9a8a1dffaf4c548bc8ad017b33959d`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:09.771624 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-61579f0e-065c-499b-9f06-84aeb6aa7d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:09.776615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b306f9-ffd4-4c6c-90e9-b36196778d29 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:09.792899 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1abb9d-fc7a-499d-92c5-14dcda54a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:09.794454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1abb9d-fc7a-499d-92c5-14dcda54a0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:09.798185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1abb9d-fc7a-499d-92c5-14dcda54a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:09.798969 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1abb9d-fc7a-499d-92c5-14dcda54a0d2 admin admin] PATH_INFO: `/v3/users/4c93387c03ab40778ee7b4b2ed09f76e` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:09.800622 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1abb9d-fc7a-499d-92c5-14dcda54a0d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c93387c03ab40778ee7b4b2ed09f76e)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:09.802800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1abb9d-fc7a-499d-92c5-14dcda54a0d2 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:09.895447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:09.898178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 906/1773] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:09 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:09.898978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6e1abb9d-fc7a-499d-92c5-14dcda54a0d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c93387c03ab40778ee7b4b2ed09f76e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:09.914565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6e1abb9d-fc7a-499d-92c5-14dcda54a0d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c93387c03ab40778ee7b4b2ed09f76e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:09.916297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6e1abb9d-fc7a-499d-92c5-14dcda54a0d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c93387c03ab40778ee7b4b2ed09f76e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:09.935716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6e1abb9d-fc7a-499d-92c5-14dcda54a0d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c93387c03ab40778ee7b4b2ed09f76e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:09.936547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6e1abb9d-fc7a-499d-92c5-14dcda54a0d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c93387c03ab40778ee7b4b2ed09f76e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:09.960075 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 868/1774] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:09 2022] DELETE /identity/v3/users/4c93387c03ab40778ee7b4b2ed09f76e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:09.967450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aeb2df-b23a-482e-8345-74cae5794173 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:09.967450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aeb2df-b23a-482e-8345-74cae5794173 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:09.967757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aeb2df-b23a-482e-8345-74cae5794173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:10.002938 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e1aeb2df-b23a-482e-8345-74cae5794173 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:10.008117 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e1aeb2df-b23a-482e-8345-74cae5794173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:10.098442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 907/1775] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:10.114217 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1abb9d-fc7a-499d-92c5-14dcda54a0d2 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:10.117510 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6e1abb9d-fc7a-499d-92c5-14dcda54a0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:10.237570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1abb9d-fc7a-499d-92c5-14dcda54a0d2 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:10.243610 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b6ca1-ba84-4718-9f36-963cc714d5b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:10.246021 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b6ca1-ba84-4718-9f36-963cc714d5b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:10.246439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b6ca1-ba84-4718-9f36-963cc714d5b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:10.247118 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b6ca1-ba84-4718-9f36-963cc714d5b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:10.261353 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b6ca1-ba84-4718-9f36-963cc714d5b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:10.263344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b6ca1-ba84-4718-9f36-963cc714d5b3 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:10.283707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 869/1776] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:10.370960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d445341-95d4-4976-8535-2b5b0e1903b4 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:10.370960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d445341-95d4-4976-8535-2b5b0e1903b4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:10.371282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d445341-95d4-4976-8535-2b5b0e1903b4 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:10.373615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 908/1777] 10.222.0.50 () {54 vars in 921 bytes} [Wed Jun 15 10:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:35:10.400024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214c37-5d5b-4fea-a66e-df4a5fcfcd10 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:10.400314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214c37-5d5b-4fea-a66e-df4a5fcfcd10 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:10.400591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92214c37-5d5b-4fea-a66e-df4a5fcfcd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:10.438530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-92214c37-5d5b-4fea-a66e-df4a5fcfcd10 None None] MFA Rules not processed for user `81e9805ec4c44cedb658b7becf768369`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:10.439776 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-92214c37-5d5b-4fea-a66e-df4a5fcfcd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:10.575880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 870/1778] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Jun 15 10:35:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:10.678520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d445341-95d4-4976-8535-2b5b0e1903b4 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:10.682536 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2d445341-95d4-4976-8535-2b5b0e1903b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:10.708406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d445341-95d4-4976-8535-2b5b0e1903b4 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:10.717816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:10.719167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:10.719388 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:10.719700 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] PATH_INFO: `/v3/projects/bd6e16a4e3ae42d8946643677056c81d` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:10.740882 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd6e16a4e3ae42d8946643677056c81d)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:10.743871 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:10.860461 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd6e16a4e3ae42d8946643677056c81d', 'request_id': 'req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:10.879333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd6e16a4e3ae42d8946643677056c81d', 'request_id': 'req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:10.893290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd6e16a4e3ae42d8946643677056c81d', 'request_id': 'req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:10.913473 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] The token cache is being invalidate because project bd6e16a4e3ae42d8946643677056c81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:10.914342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:10.921142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:10.924257 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 909/1779] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:10 2022] DELETE /identity/v3/projects/bd6e16a4e3ae42d8946643677056c81d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:10.928432 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92214c37-5d5b-4fea-a66e-df4a5fcfcd10 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:10.948239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92214c37-5d5b-4fea-a66e-df4a5fcfcd10 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:11.049038 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:11.054945 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e00c0-8142-43c1-9ea1-6ffc3137dcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:11.056390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e00c0-8142-43c1-9ea1-6ffc3137dcf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:11.057175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e00c0-8142-43c1-9ea1-6ffc3137dcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:11.057449 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e00c0-8142-43c1-9ea1-6ffc3137dcf3 admin admin] PATH_INFO: `/v3/users/1b1f8dd7ec59441d8db98f82ed1bc30d` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:11.059719 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e00c0-8142-43c1-9ea1-6ffc3137dcf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1f8dd7ec59441d8db98f82ed1bc30d)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:11.063355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e00c0-8142-43c1-9ea1-6ffc3137dcf3 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:11.126137 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-869e00c0-8142-43c1-9ea1-6ffc3137dcf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1f8dd7ec59441d8db98f82ed1bc30d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.144177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-869e00c0-8142-43c1-9ea1-6ffc3137dcf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1f8dd7ec59441d8db98f82ed1bc30d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.145020 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-869e00c0-8142-43c1-9ea1-6ffc3137dcf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1f8dd7ec59441d8db98f82ed1bc30d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.154945 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-869e00c0-8142-43c1-9ea1-6ffc3137dcf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1f8dd7ec59441d8db98f82ed1bc30d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.156213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-869e00c0-8142-43c1-9ea1-6ffc3137dcf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1f8dd7ec59441d8db98f82ed1bc30d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.175241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 871/1780] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:10 2022] DELETE /identity/v3/users/1b1f8dd7ec59441d8db98f82ed1bc30d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:11.386419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:11.389279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:11.407053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:11.493810 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e00c0-8142-43c1-9ea1-6ffc3137dcf3 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:11.495307 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-869e00c0-8142-43c1-9ea1-6ffc3137dcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:11.508875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b1ef6-b53d-4150-81b4-a9bb23cb0b85 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:11.608146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb90ead-4ce5-4a4c-be5b-b8a66bd3365b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:11.608811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb90ead-4ce5-4a4c-be5b-b8a66bd3365b service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:11.609453 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb90ead-4ce5-4a4c-be5b-b8a66bd3365b service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:11.609453 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb90ead-4ce5-4a4c-be5b-b8a66bd3365b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:11.611377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bcb90ead-4ce5-4a4c-be5b-b8a66bd3365b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:11.627876 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb90ead-4ce5-4a4c-be5b-b8a66bd3365b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:11.629531 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb90ead-4ce5-4a4c-be5b-b8a66bd3365b service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:11.633269 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e00c0-8142-43c1-9ea1-6ffc3137dcf3 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:11.639572 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45deabc7-cecb-4a09-a137-f500fe3d119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:11.641194 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deabc7-cecb-4a09-a137-f500fe3d119a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:11.641489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deabc7-cecb-4a09-a137-f500fe3d119a admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:11.641593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 910/1781] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:11.642023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deabc7-cecb-4a09-a137-f500fe3d119a admin admin] PATH_INFO: `/v3/projects/daa23a95964043d7ba90c72f815d000f` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:11.642575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb90ead-4ce5-4a4c-be5b-b8a66bd3365b service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:11.643540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45deabc7-cecb-4a09-a137-f500fe3d119a admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa23a95964043d7ba90c72f815d000f)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:11.644170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bcb90ead-4ce5-4a4c-be5b-b8a66bd3365b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:11.645842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45deabc7-cecb-4a09-a137-f500fe3d119a admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:11.663289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb90ead-4ce5-4a4c-be5b-b8a66bd3365b service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:11.674650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:11.675540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:11.675823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:11.676096 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa admin admin] PATH_INFO: `/v3/projects/49d1c5720e2e498fa8b6c0662e10b44e` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:11.677305 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d1c5720e2e498fa8b6c0662e10b44e)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:11.679882 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:11.747939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d1c5720e2e498fa8b6c0662e10b44e', 'request_id': 'req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.754248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d1c5720e2e498fa8b6c0662e10b44e', 'request_id': 'req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.766992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d1c5720e2e498fa8b6c0662e10b44e', 'request_id': 'req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.770068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-45deabc7-cecb-4a09-a137-f500fe3d119a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa23a95964043d7ba90c72f815d000f', 'request_id': 'req-45deabc7-cecb-4a09-a137-f500fe3d119a'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.786501 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa admin admin] The token cache is being invalidate because project 49d1c5720e2e498fa8b6c0662e10b44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:11.786830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.787694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ad5ae47b-a7ee-4be6-9f10-0fe93958ecaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.790530 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 911/1782] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:11 2022] DELETE /identity/v3/projects/49d1c5720e2e498fa8b6c0662e10b44e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:11.791204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-45deabc7-cecb-4a09-a137-f500fe3d119a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa23a95964043d7ba90c72f815d000f', 'request_id': 'req-45deabc7-cecb-4a09-a137-f500fe3d119a'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.792196 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82505ffd-297d-4cc8-81c0-67e9993f6a80 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:11.792728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82505ffd-297d-4cc8-81c0-67e9993f6a80 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:11.793007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82505ffd-297d-4cc8-81c0-67e9993f6a80 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:11.794620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 912/1783] 10.222.0.50 () {54 vars in 921 bytes} [Wed Jun 15 10:35:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:35:11.796262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece1c72-71f9-4007-bd07-af727c9a7597 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:11.796546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece1c72-71f9-4007-bd07-af727c9a7597 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:11.796846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece1c72-71f9-4007-bd07-af727c9a7597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:11.798180 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-45deabc7-cecb-4a09-a137-f500fe3d119a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa23a95964043d7ba90c72f815d000f', 'request_id': 'req-45deabc7-cecb-4a09-a137-f500fe3d119a'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.822917 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5ece1c72-71f9-4007-bd07-af727c9a7597 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:11.825031 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5ece1c72-71f9-4007-bd07-af727c9a7597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:11.828060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-45deabc7-cecb-4a09-a137-f500fe3d119a admin admin] The token cache is being invalidate because project daa23a95964043d7ba90c72f815d000f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:11.828393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-45deabc7-cecb-4a09-a137-f500fe3d119a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.832613 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-45deabc7-cecb-4a09-a137-f500fe3d119a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:11.838322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 872/1784] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:11 2022] DELETE /identity/v3/projects/daa23a95964043d7ba90c72f815d000f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:11.838322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb720a41-4722-40ac-8b5d-1524b5a0398b None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:11.838322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb720a41-4722-40ac-8b5d-1524b5a0398b None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:11.838322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb720a41-4722-40ac-8b5d-1524b5a0398b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:11.840489 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:11.874663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:11.902999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-bb720a41-4722-40ac-8b5d-1524b5a0398b None None] MFA Rules not processed for user `2729cb0b9adb44f7ba5c968b6158a93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:11.904454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-bb720a41-4722-40ac-8b5d-1524b5a0398b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:11.926075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 913/1785] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:11.927344 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece1c72-71f9-4007-bd07-af727c9a7597 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:11.950292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5ece1c72-71f9-4007-bd07-af727c9a7597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:11.976122 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece1c72-71f9-4007-bd07-af727c9a7597 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:11.989319 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc7f51-08f5-4b04-9caf-66924cfa7ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:11.990208 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc7f51-08f5-4b04-9caf-66924cfa7ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:11.990492 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc7f51-08f5-4b04-9caf-66924cfa7ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:11.990787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc7f51-08f5-4b04-9caf-66924cfa7ade admin admin] PATH_INFO: `/v3/users/55cc1e75a31d4b8ab7a700d7382030ba` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:11.995350 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc7f51-08f5-4b04-9caf-66924cfa7ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=55cc1e75a31d4b8ab7a700d7382030ba)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:12.000589 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc7f51-08f5-4b04-9caf-66924cfa7ade admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:12.024806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 873/1786] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Jun 15 10:35:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:12.025900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d69286-0b8a-439a-8ac8-39f226f25e7f None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:12.026173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d69286-0b8a-439a-8ac8-39f226f25e7f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:12.026454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d69286-0b8a-439a-8ac8-39f226f25e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:12.081482 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-b9d69286-0b8a-439a-8ac8-39f226f25e7f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:12.088402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b9d69286-0b8a-439a-8ac8-39f226f25e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:12.107774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 874/1787] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:12.110802 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d69286-0b8a-439a-8ac8-39f226f25e7f None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:12.113268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b9d69286-0b8a-439a-8ac8-39f226f25e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:12.115999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d8fc7f51-08f5-4b04-9caf-66924cfa7ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55cc1e75a31d4b8ab7a700d7382030ba'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:12.148306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d8fc7f51-08f5-4b04-9caf-66924cfa7ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55cc1e75a31d4b8ab7a700d7382030ba'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:12.149272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d8fc7f51-08f5-4b04-9caf-66924cfa7ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55cc1e75a31d4b8ab7a700d7382030ba'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:12.153196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d69286-0b8a-439a-8ac8-39f226f25e7f None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:12.174931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60533d2e-f859-4640-a0ce-6659074b3938 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2729cb0b9adb44f7ba5c968b6158a93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:12.177521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60533d2e-f859-4640-a0ce-6659074b3938 service placement] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:12.177934 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60533d2e-f859-4640-a0ce-6659074b3938 service placement] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:12.179854 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60533d2e-f859-4640-a0ce-6659074b3938 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:12.181359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d8fc7f51-08f5-4b04-9caf-66924cfa7ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55cc1e75a31d4b8ab7a700d7382030ba'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:12.184284 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-60533d2e-f859-4640-a0ce-6659074b3938 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:12.194841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d8fc7f51-08f5-4b04-9caf-66924cfa7ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55cc1e75a31d4b8ab7a700d7382030ba'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:12.204203 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 914/1788] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:11 2022] DELETE /identity/v3/users/55cc1e75a31d4b8ab7a700d7382030ba => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:12.205470 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc7f51-08f5-4b04-9caf-66924cfa7ade admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:12.207431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d8fc7f51-08f5-4b04-9caf-66924cfa7ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:12.220724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60533d2e-f859-4640-a0ce-6659074b3938 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:12.222487 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60533d2e-f859-4640-a0ce-6659074b3938 service placement] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:12.248394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 875/1789] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:12.383572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc7f51-08f5-4b04-9caf-66924cfa7ade admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:12.389901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76468ac9-6e6f-45ef-9b64-5944167f3882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:12.390803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76468ac9-6e6f-45ef-9b64-5944167f3882 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:12.391236 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76468ac9-6e6f-45ef-9b64-5944167f3882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:12.391742 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76468ac9-6e6f-45ef-9b64-5944167f3882 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:12.392699 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76468ac9-6e6f-45ef-9b64-5944167f3882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:12.393113 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76468ac9-6e6f-45ef-9b64-5944167f3882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:12.395126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76468ac9-6e6f-45ef-9b64-5944167f3882 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:12.415393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 915/1790] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:12.418820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60533d2e-f859-4640-a0ce-6659074b3938 service placement] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:12.439736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60533d2e-f859-4640-a0ce-6659074b3938 service placement] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:12.457421 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14360cd0-4b13-47ba-b7c6-051ddd71e887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:12.458118 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360cd0-4b13-47ba-b7c6-051ddd71e887 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:12.458599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360cd0-4b13-47ba-b7c6-051ddd71e887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:12.458983 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360cd0-4b13-47ba-b7c6-051ddd71e887 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:12.459708 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14360cd0-4b13-47ba-b7c6-051ddd71e887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:12.462217 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14360cd0-4b13-47ba-b7c6-051ddd71e887 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:12.523010 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 876/1791] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:12 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:12.524234 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76468ac9-6e6f-45ef-9b64-5944167f3882 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:12.535639 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76468ac9-6e6f-45ef-9b64-5944167f3882 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:12.559680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:12.634200 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c50fcf-3ec0-456a-9fd3-8edf6f8f5f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:12.635307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c50fcf-3ec0-456a-9fd3-8edf6f8f5f98 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:12.635779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c50fcf-3ec0-456a-9fd3-8edf6f8f5f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:12.636493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c50fcf-3ec0-456a-9fd3-8edf6f8f5f98 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:12.637364 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c50fcf-3ec0-456a-9fd3-8edf6f8f5f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:12.643310 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c50fcf-3ec0-456a-9fd3-8edf6f8f5f98 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:12.674919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 916/1792] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:12 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:12.678775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14360cd0-4b13-47ba-b7c6-051ddd71e887 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:12.697387 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14360cd0-4b13-47ba-b7c6-051ddd71e887 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:12.703863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97efcef-0822-44b4-89e3-bedf0dae3e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:12.704662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97efcef-0822-44b4-89e3-bedf0dae3e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:12.705809 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97efcef-0822-44b4-89e3-bedf0dae3e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:12.706534 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97efcef-0822-44b4-89e3-bedf0dae3e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:12.708142 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97efcef-0822-44b4-89e3-bedf0dae3e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:12.710113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97efcef-0822-44b4-89e3-bedf0dae3e37 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:12.734369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 877/1793] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:12.744347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c50fcf-3ec0-456a-9fd3-8edf6f8f5f98 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:12.766262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c50fcf-3ec0-456a-9fd3-8edf6f8f5f98 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:12.780108 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242352e-c81e-4c16-b793-b2a760ab0492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:12.780872 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242352e-c81e-4c16-b793-b2a760ab0492 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:12.781166 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242352e-c81e-4c16-b793-b2a760ab0492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:12.781447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242352e-c81e-4c16-b793-b2a760ab0492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:12.783597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242352e-c81e-4c16-b793-b2a760ab0492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:12.786675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242352e-c81e-4c16-b793-b2a760ab0492 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:12.815357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 917/1794] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:12.817729 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97efcef-0822-44b4-89e3-bedf0dae3e37 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:12.829330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97efcef-0822-44b4-89e3-bedf0dae3e37 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:12.837871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d83d61-c57e-4878-bc6d-aae816fc13e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:12.839216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d83d61-c57e-4878-bc6d-aae816fc13e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:12.839863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d83d61-c57e-4878-bc6d-aae816fc13e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:12.840478 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d83d61-c57e-4878-bc6d-aae816fc13e7 admin admin] PATH_INFO: `/v3/projects/a3268fcde4e44c71885a782bce23e4cf/users/dbdf7b0a607b4bfa9d374b76c1a09e97/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:12.861395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d83d61-c57e-4878-bc6d-aae816fc13e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3268fcde4e44c71885a782bce23e4cf, user_id=dbdf7b0a607b4bfa9d374b76c1a09e97, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:12.864801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d83d61-c57e-4878-bc6d-aae816fc13e7 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:12.881046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 878/1795] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:12 2022] PUT /identity/v3/projects/a3268fcde4e44c71885a782bce23e4cf/users/dbdf7b0a607b4bfa9d374b76c1a09e97/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:12.891895 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494324a-1e7d-4257-aa36-cf1c6f1428dd None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:12.892410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494324a-1e7d-4257-aa36-cf1c6f1428dd None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:12.892885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494324a-1e7d-4257-aa36-cf1c6f1428dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:12.941957 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e494324a-1e7d-4257-aa36-cf1c6f1428dd None None] MFA Rules not processed for user `dbdf7b0a607b4bfa9d374b76c1a09e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:12.943921 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e494324a-1e7d-4257-aa36-cf1c6f1428dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:13.083506 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 918/1796] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:13.084341 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d83d61-c57e-4878-bc6d-aae816fc13e7 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:13.240049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d83d61-c57e-4878-bc6d-aae816fc13e7 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:13.248206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7310925-326b-4e01-8444-fe7c2a9b2ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:13.248989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310925-326b-4e01-8444-fe7c2a9b2ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:13.249603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310925-326b-4e01-8444-fe7c2a9b2ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:13.249988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310925-326b-4e01-8444-fe7c2a9b2ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:13.250766 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7310925-326b-4e01-8444-fe7c2a9b2ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:13.253763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7310925-326b-4e01-8444-fe7c2a9b2ff3 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:13.289490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 879/1797] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:13 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:13.293446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494324a-1e7d-4257-aa36-cf1c6f1428dd None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:13.308544 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494324a-1e7d-4257-aa36-cf1c6f1428dd None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:13.421368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494af30-c000-4bde-a1de-b415a75a8146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:13.422178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494af30-c000-4bde-a1de-b415a75a8146 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:13.422559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494af30-c000-4bde-a1de-b415a75a8146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:13.422937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494af30-c000-4bde-a1de-b415a75a8146 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:13.423801 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494af30-c000-4bde-a1de-b415a75a8146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:13.425835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494af30-c000-4bde-a1de-b415a75a8146 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:13.463357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 919/1798] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:13 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:13.464864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7310925-326b-4e01-8444-fe7c2a9b2ff3 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:13.477285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7310925-326b-4e01-8444-fe7c2a9b2ff3 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:13.482610 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85c3a-d654-47ff-b87f-d790d10093b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:13.483389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85c3a-d654-47ff-b87f-d790d10093b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:13.483765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85c3a-d654-47ff-b87f-d790d10093b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:13.484033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85c3a-d654-47ff-b87f-d790d10093b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:13.484849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c85c3a-d654-47ff-b87f-d790d10093b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:13.488841 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c85c3a-d654-47ff-b87f-d790d10093b2 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:13.489426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:13.505048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494af30-c000-4bde-a1de-b415a75a8146 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:13.511452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 880/1799] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:13.518992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494af30-c000-4bde-a1de-b415a75a8146 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:13.525389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a38a-1393-45ca-ac48-0c5ced42166b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:13.526311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a38a-1393-45ca-ac48-0c5ced42166b admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:13.526784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a38a-1393-45ca-ac48-0c5ced42166b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:13.527065 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a38a-1393-45ca-ac48-0c5ced42166b admin admin] PATH_INFO: `/v3/projects/a25d555d40bf4bc595901d466ec8aedb/users/b19f31a6af6245b69e4fb57c34544e16/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:13.549648 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a38a-1393-45ca-ac48-0c5ced42166b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25d555d40bf4bc595901d466ec8aedb, user_id=b19f31a6af6245b69e4fb57c34544e16, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:13.552363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a38a-1393-45ca-ac48-0c5ced42166b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:13.556207 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:13.576093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85c3a-d654-47ff-b87f-d790d10093b2 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:13.576295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 920/1800] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:13 2022] PUT /identity/v3/projects/a25d555d40bf4bc595901d466ec8aedb/users/b19f31a6af6245b69e4fb57c34544e16/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:13.586339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85c3a-d654-47ff-b87f-d790d10093b2 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:13.682204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2d5fd-f26e-407d-a5e6-3122315df80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:13.694401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d5fd-f26e-407d-a5e6-3122315df80e admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:13.694930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d5fd-f26e-407d-a5e6-3122315df80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:13.697872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d5fd-f26e-407d-a5e6-3122315df80e admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:13.699166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2d5fd-f26e-407d-a5e6-3122315df80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:13.712981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2d5fd-f26e-407d-a5e6-3122315df80e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:13.737121 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 881/1801] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:13.738407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a38a-1393-45ca-ac48-0c5ced42166b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:13.760393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a38a-1393-45ca-ac48-0c5ced42166b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:13.783563 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c795d-a0ba-44aa-8111-8155f8504911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:13.785707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c795d-a0ba-44aa-8111-8155f8504911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:13.788045 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c795d-a0ba-44aa-8111-8155f8504911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:13.788510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c795d-a0ba-44aa-8111-8155f8504911 admin admin] PATH_INFO: `/v3/projects/a25d555d40bf4bc595901d466ec8aedb/users/b19f31a6af6245b69e4fb57c34544e16/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:13.794245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c795d-a0ba-44aa-8111-8155f8504911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25d555d40bf4bc595901d466ec8aedb, user_id=b19f31a6af6245b69e4fb57c34544e16, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:13.802153 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c795d-a0ba-44aa-8111-8155f8504911 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:13.847603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 921/1802] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:13 2022] PUT /identity/v3/projects/a25d555d40bf4bc595901d466ec8aedb/users/b19f31a6af6245b69e4fb57c34544e16/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:13.847804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e4496-22f6-473f-8ba4-4a447bf32f78 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:13.847804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e4496-22f6-473f-8ba4-4a447bf32f78 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:13.847804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e4496-22f6-473f-8ba4-4a447bf32f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:13.905373 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8e1e4496-22f6-473f-8ba4-4a447bf32f78 None None] MFA Rules not processed for user `b19f31a6af6245b69e4fb57c34544e16`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:13.906781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8e1e4496-22f6-473f-8ba4-4a447bf32f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:14.111330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 882/1803] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:14.127160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c795d-a0ba-44aa-8111-8155f8504911 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:14.129862 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4e9c795d-a0ba-44aa-8111-8155f8504911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:14.249501 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c795d-a0ba-44aa-8111-8155f8504911 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:14.267966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e4678-c37c-41ab-a6e5-4eea29b32dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:14.268508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e4678-c37c-41ab-a6e5-4eea29b32dce service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:14.268795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e4678-c37c-41ab-a6e5-4eea29b32dce service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:14.269075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e4678-c37c-41ab-a6e5-4eea29b32dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:14.307763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e4678-c37c-41ab-a6e5-4eea29b32dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:14.307763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e4678-c37c-41ab-a6e5-4eea29b32dce service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:14.340822 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 922/1804] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:14.412989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e4496-22f6-473f-8ba4-4a447bf32f78 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:14.553687 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e4678-c37c-41ab-a6e5-4eea29b32dce service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:14.557383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2c2e4678-c37c-41ab-a6e5-4eea29b32dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:14.564422 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e4496-22f6-473f-8ba4-4a447bf32f78 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:14.583497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effffc9e-4d4e-44a4-9035-cba287cd63ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:14.586782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effffc9e-4d4e-44a4-9035-cba287cd63ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:14.587523 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effffc9e-4d4e-44a4-9035-cba287cd63ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:14.588015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e4678-c37c-41ab-a6e5-4eea29b32dce service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:14.588145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effffc9e-4d4e-44a4-9035-cba287cd63ed admin admin] PATH_INFO: `/v3/users/dbdf7b0a607b4bfa9d374b76c1a09e97` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:14.589677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effffc9e-4d4e-44a4-9035-cba287cd63ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbdf7b0a607b4bfa9d374b76c1a09e97)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:14.593693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effffc9e-4d4e-44a4-9035-cba287cd63ed admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:14.611138 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1ccb9-ef85-452f-951c-dc149b7a4698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:14.614131 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1ccb9-ef85-452f-951c-dc149b7a4698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:14.616163 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1ccb9-ef85-452f-951c-dc149b7a4698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:14.617318 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1ccb9-ef85-452f-951c-dc149b7a4698 admin admin] PATH_INFO: `/v3/projects/11fe18069781484f8d72ede097e6e131` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:14.635359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1ccb9-ef85-452f-951c-dc149b7a4698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11fe18069781484f8d72ede097e6e131)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:14.642398 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1ccb9-ef85-452f-951c-dc149b7a4698 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:14.653411 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:14.722014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-effffc9e-4d4e-44a4-9035-cba287cd63ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbdf7b0a607b4bfa9d374b76c1a09e97'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:14.742713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-effffc9e-4d4e-44a4-9035-cba287cd63ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbdf7b0a607b4bfa9d374b76c1a09e97'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:14.743748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-effffc9e-4d4e-44a4-9035-cba287cd63ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbdf7b0a607b4bfa9d374b76c1a09e97'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:14.773819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-effffc9e-4d4e-44a4-9035-cba287cd63ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbdf7b0a607b4bfa9d374b76c1a09e97'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:14.775025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-effffc9e-4d4e-44a4-9035-cba287cd63ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbdf7b0a607b4bfa9d374b76c1a09e97'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:14.795413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 883/1805] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:14 2022] DELETE /identity/v3/users/dbdf7b0a607b4bfa9d374b76c1a09e97 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:14.797558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2929-cc1a-4347-a319-bea86ed01c14 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:14.798178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2929-cc1a-4347-a319-bea86ed01c14 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:14.798644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2929-cc1a-4347-a319-bea86ed01c14 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:14.800890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 884/1806] 10.222.0.50 () {54 vars in 921 bytes} [Wed Jun 15 10:35:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:35:14.801721 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a9c1ccb9-ef85-452f-951c-dc149b7a4698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11fe18069781484f8d72ede097e6e131', 'request_id': 'req-a9c1ccb9-ef85-452f-951c-dc149b7a4698'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:14.802497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a2929-cc1a-4347-a319-bea86ed01c14 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:14.805091 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-873a2929-cc1a-4347-a319-bea86ed01c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:14.812424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a9c1ccb9-ef85-452f-951c-dc149b7a4698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11fe18069781484f8d72ede097e6e131', 'request_id': 'req-a9c1ccb9-ef85-452f-951c-dc149b7a4698'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:14.821576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a9c1ccb9-ef85-452f-951c-dc149b7a4698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11fe18069781484f8d72ede097e6e131', 'request_id': 'req-a9c1ccb9-ef85-452f-951c-dc149b7a4698'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:14.834253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a9c1ccb9-ef85-452f-951c-dc149b7a4698 admin admin] The token cache is being invalidate because project 11fe18069781484f8d72ede097e6e131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:14.834558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a9c1ccb9-ef85-452f-951c-dc149b7a4698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:14.835205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a9c1ccb9-ef85-452f-951c-dc149b7a4698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:14.837534 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 923/1807] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:14 2022] DELETE /identity/v3/projects/11fe18069781484f8d72ede097e6e131 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:14.838981 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97bcbb-3f63-4ce0-94bb-7fa4f49ee0a2 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:14.839265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97bcbb-3f63-4ce0-94bb-7fa4f49ee0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:14.839568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97bcbb-3f63-4ce0-94bb-7fa4f49ee0a2 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:14.840859 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 924/1808] 10.222.0.50 () {54 vars in 921 bytes} [Wed Jun 15 10:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:35:14.842273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607b209-612d-45c4-be20-3945ac01640f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:14.842701 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607b209-612d-45c4-be20-3945ac01640f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:14.843167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607b209-612d-45c4-be20-3945ac01640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:14.866851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4607b209-612d-45c4-be20-3945ac01640f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:14.868165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4607b209-612d-45c4-be20-3945ac01640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:14.896133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a2929-cc1a-4347-a319-bea86ed01c14 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:14.904495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa310e4-6063-4f5f-b138-5395f89a26c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:14.905707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa310e4-6063-4f5f-b138-5395f89a26c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:14.906143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa310e4-6063-4f5f-b138-5395f89a26c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:14.906489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa310e4-6063-4f5f-b138-5395f89a26c6 admin admin] PATH_INFO: `/v3/users/d4dd02bb307e499a82f258eba058ea7d` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:14.908886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa310e4-6063-4f5f-b138-5395f89a26c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4dd02bb307e499a82f258eba058ea7d)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:14.912134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa310e4-6063-4f5f-b138-5395f89a26c6 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:14.951819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 925/1809] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:14.953399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c67aec-8ec1-4ed4-bf17-4fc61ea4c1b9 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:14.953690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c67aec-8ec1-4ed4-bf17-4fc61ea4c1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:14.954087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c67aec-8ec1-4ed4-bf17-4fc61ea4c1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:14.979507 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a9c67aec-8ec1-4ed4-bf17-4fc61ea4c1b9 None None] MFA Rules not processed for user `2729cb0b9adb44f7ba5c968b6158a93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:14.981073 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a9c67aec-8ec1-4ed4-bf17-4fc61ea4c1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:14.985857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:14.990874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ffa310e4-6063-4f5f-b138-5395f89a26c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4dd02bb307e499a82f258eba058ea7d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.005409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ffa310e4-6063-4f5f-b138-5395f89a26c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4dd02bb307e499a82f258eba058ea7d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.006159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ffa310e4-6063-4f5f-b138-5395f89a26c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4dd02bb307e499a82f258eba058ea7d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.018269 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ffa310e4-6063-4f5f-b138-5395f89a26c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4dd02bb307e499a82f258eba058ea7d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.018952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ffa310e4-6063-4f5f-b138-5395f89a26c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4dd02bb307e499a82f258eba058ea7d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.042568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 885/1810] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:14 2022] DELETE /identity/v3/users/d4dd02bb307e499a82f258eba058ea7d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:15.042568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5dc5f5-4021-48ca-b063-8e1b2dc8e050 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.042568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5dc5f5-4021-48ca-b063-8e1b2dc8e050 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.042568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5dc5f5-4021-48ca-b063-8e1b2dc8e050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.059948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-cd5dc5f5-4021-48ca-b063-8e1b2dc8e050 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:15.061175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-cd5dc5f5-4021-48ca-b063-8e1b2dc8e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:15.081372 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 926/1811] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Jun 15 10:35:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:15.082836 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102b6d5-c47d-403d-9cc1-402444b01f80 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.083125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102b6d5-c47d-403d-9cc1-402444b01f80 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.083403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102b6d5-c47d-403d-9cc1-402444b01f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.090294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:15.109383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e102b6d5-c47d-403d-9cc1-402444b01f80 None None] MFA Rules not processed for user `81e9805ec4c44cedb658b7becf768369`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:15.110715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e102b6d5-c47d-403d-9cc1-402444b01f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:15.148875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 886/1812] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:15.156642 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5dc5f5-4021-48ca-b063-8e1b2dc8e050 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:15.159088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-cd5dc5f5-4021-48ca-b063-8e1b2dc8e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:15.205521 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 927/1813] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Jun 15 10:35:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:15.206602 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102b6d5-c47d-403d-9cc1-402444b01f80 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:15.208888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e102b6d5-c47d-403d-9cc1-402444b01f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:15.233872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5dc5f5-4021-48ca-b063-8e1b2dc8e050 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:15.237624 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807ff6f-7a28-4264-892b-d53c9304dbc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:15.238310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ff6f-7a28-4264-892b-d53c9304dbc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.238588 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ff6f-7a28-4264-892b-d53c9304dbc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.238862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ff6f-7a28-4264-892b-d53c9304dbc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.240680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b807ff6f-7a28-4264-892b-d53c9304dbc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:15.268568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807ff6f-7a28-4264-892b-d53c9304dbc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:15.270955 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807ff6f-7a28-4264-892b-d53c9304dbc7 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:15.284169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 887/1814] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:15.285359 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c335821-f813-47e6-abc7-532447e4f09e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.285653 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c335821-f813-47e6-abc7-532447e4f09e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.285915 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c335821-f813-47e6-abc7-532447e4f09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.313573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-1c335821-f813-47e6-abc7-532447e4f09e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:15.314952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1c335821-f813-47e6-abc7-532447e4f09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:15.324995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 888/1815] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:15.325825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c335821-f813-47e6-abc7-532447e4f09e None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:15.327163 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1c335821-f813-47e6-abc7-532447e4f09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:15.344942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c335821-f813-47e6-abc7-532447e4f09e None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:15.351984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba2727-5701-4dbc-9fb0-4568ee85d908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:15.352965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba2727-5701-4dbc-9fb0-4568ee85d908 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.353487 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba2727-5701-4dbc-9fb0-4568ee85d908 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.353593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102b6d5-c47d-403d-9cc1-402444b01f80 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:15.353773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba2727-5701-4dbc-9fb0-4568ee85d908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.359191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5467f2-5b8f-4b45-94a7-792396df6939 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2729cb0b9adb44f7ba5c968b6158a93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:15.359889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5467f2-5b8f-4b45-94a7-792396df6939 service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.360172 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5467f2-5b8f-4b45-94a7-792396df6939 service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.360446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5467f2-5b8f-4b45-94a7-792396df6939 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.364518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba2727-5701-4dbc-9fb0-4568ee85d908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:15.366446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba2727-5701-4dbc-9fb0-4568ee85d908 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:15.369755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5467f2-5b8f-4b45-94a7-792396df6939 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:15.371328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5467f2-5b8f-4b45-94a7-792396df6939 service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:15.385184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 889/1816] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:15.386777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba2727-5701-4dbc-9fb0-4568ee85d908 service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:15.389679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-39ba2727-5701-4dbc-9fb0-4568ee85d908 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:15.391823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 928/1817] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:15.393931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5467f2-5b8f-4b45-94a7-792396df6939 service placement] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:15.416462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5467f2-5b8f-4b45-94a7-792396df6939 service placement] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:15.422379 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba2727-5701-4dbc-9fb0-4568ee85d908 service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:15.429397 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797eeb42-a778-41de-a2b5-aac586906954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:15.430614 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797eeb42-a778-41de-a2b5-aac586906954 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.430983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797eeb42-a778-41de-a2b5-aac586906954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.431764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797eeb42-a778-41de-a2b5-aac586906954 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.433292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797eeb42-a778-41de-a2b5-aac586906954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:15.433639 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797eeb42-a778-41de-a2b5-aac586906954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:15.436755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797eeb42-a778-41de-a2b5-aac586906954 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:15.442141 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:15.448502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.448725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.448913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] PATH_INFO: `/v3/projects/502ebd2e4f784fa69f8f88ec3af184fd` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.450586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=502ebd2e4f784fa69f8f88ec3af184fd)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:15.455506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:15.461936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 929/1818] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:15.468290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797eeb42-a778-41de-a2b5-aac586906954 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:15.491503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797eeb42-a778-41de-a2b5-aac586906954 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:15.501841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e698a3d-d3ad-4640-8e3c-6b0bbb6f508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:15.502744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e698a3d-d3ad-4640-8e3c-6b0bbb6f508e admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.503135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e698a3d-d3ad-4640-8e3c-6b0bbb6f508e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.503640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e698a3d-d3ad-4640-8e3c-6b0bbb6f508e admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.504601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e698a3d-d3ad-4640-8e3c-6b0bbb6f508e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:15.506630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e698a3d-d3ad-4640-8e3c-6b0bbb6f508e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:15.524481 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:15.557700 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502ebd2e4f784fa69f8f88ec3af184fd', 'request_id': 'req-f764fe51-1b93-48db-a993-2f871daf12c2'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.578570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 930/1819] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:15 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:15.579943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e698a3d-d3ad-4640-8e3c-6b0bbb6f508e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:15.586268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502ebd2e4f784fa69f8f88ec3af184fd', 'request_id': 'req-f764fe51-1b93-48db-a993-2f871daf12c2'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.600803 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502ebd2e4f784fa69f8f88ec3af184fd', 'request_id': 'req-f764fe51-1b93-48db-a993-2f871daf12c2'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.621939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] The token cache is being invalidate because project 502ebd2e4f784fa69f8f88ec3af184fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:15.622296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.622986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.629735 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 890/1820] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:15 2022] DELETE /identity/v3/projects/502ebd2e4f784fa69f8f88ec3af184fd => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:15.630749 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:15.633037 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:15.696167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:15.720537 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e698a3d-d3ad-4640-8e3c-6b0bbb6f508e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:15.727422 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d78e5-c0ff-433d-b535-f083a5e8eff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:15.728136 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d78e5-c0ff-433d-b535-f083a5e8eff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.728415 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d78e5-c0ff-433d-b535-f083a5e8eff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.728780 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d78e5-c0ff-433d-b535-f083a5e8eff3 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.729529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d78e5-c0ff-433d-b535-f083a5e8eff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:15.732729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d78e5-c0ff-433d-b535-f083a5e8eff3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:15.769093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 931/1821] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:15 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:15.771415 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d78e5-c0ff-433d-b535-f083a5e8eff3 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:15.777867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764fe51-1b93-48db-a993-2f871daf12c2 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:15.779631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d31d78e5-c0ff-433d-b535-f083a5e8eff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:15.784540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619e5cb-e71a-4159-a2ad-25dacdc54f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:15.785554 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619e5cb-e71a-4159-a2ad-25dacdc54f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.785937 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619e5cb-e71a-4159-a2ad-25dacdc54f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.786311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619e5cb-e71a-4159-a2ad-25dacdc54f9b admin admin] PATH_INFO: `/v3/users/0c9a8a1dffaf4c548bc8ad017b33959d` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.787792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619e5cb-e71a-4159-a2ad-25dacdc54f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c9a8a1dffaf4c548bc8ad017b33959d)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:15.790311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619e5cb-e71a-4159-a2ad-25dacdc54f9b admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:15.794825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d78e5-c0ff-433d-b535-f083a5e8eff3 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:15.802042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e8f2b-58ac-4ce8-87d2-e776459dcc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:15.802692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e8f2b-58ac-4ce8-87d2-e776459dcc33 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.803236 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e8f2b-58ac-4ce8-87d2-e776459dcc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.803617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e8f2b-58ac-4ce8-87d2-e776459dcc33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.805032 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e8f2b-58ac-4ce8-87d2-e776459dcc33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:15.806871 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e8f2b-58ac-4ce8-87d2-e776459dcc33 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:15.820901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 932/1822] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:15.826652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e8f2b-58ac-4ce8-87d2-e776459dcc33 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:15.841288 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e8f2b-58ac-4ce8-87d2-e776459dcc33 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:15.847561 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8670-63f0-4697-a9f0-e501f415910b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:15.848326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8670-63f0-4697-a9f0-e501f415910b admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.848665 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8670-63f0-4697-a9f0-e501f415910b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.848952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8670-63f0-4697-a9f0-e501f415910b admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.850139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab8670-63f0-4697-a9f0-e501f415910b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:15.852086 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab8670-63f0-4697-a9f0-e501f415910b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:15.867113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c619e5cb-e71a-4159-a2ad-25dacdc54f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c9a8a1dffaf4c548bc8ad017b33959d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.875623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 933/1823] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:15.879364 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8670-63f0-4697-a9f0-e501f415910b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:15.884388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c619e5cb-e71a-4159-a2ad-25dacdc54f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c9a8a1dffaf4c548bc8ad017b33959d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.885187 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c619e5cb-e71a-4159-a2ad-25dacdc54f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c9a8a1dffaf4c548bc8ad017b33959d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.891547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8670-63f0-4697-a9f0-e501f415910b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:15.894382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c619e5cb-e71a-4159-a2ad-25dacdc54f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c9a8a1dffaf4c548bc8ad017b33959d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.895216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c619e5cb-e71a-4159-a2ad-25dacdc54f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c9a8a1dffaf4c548bc8ad017b33959d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:15.896906 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d762cb-f299-4906-94dc-2f05d8028695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:15.898268 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d762cb-f299-4906-94dc-2f05d8028695 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.898479 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d762cb-f299-4906-94dc-2f05d8028695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.898988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d762cb-f299-4906-94dc-2f05d8028695 admin admin] PATH_INFO: `/v3/projects/d3dd6aec39614887a8acd42fbef0b8a6/users/0ee092fe66e04331a1438435dbf868e0/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.912502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 891/1824] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:15 2022] DELETE /identity/v3/users/0c9a8a1dffaf4c548bc8ad017b33959d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:15.916974 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d762cb-f299-4906-94dc-2f05d8028695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3dd6aec39614887a8acd42fbef0b8a6, user_id=0ee092fe66e04331a1438435dbf868e0, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:15.920185 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d762cb-f299-4906-94dc-2f05d8028695 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:15.937144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 934/1825] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:15 2022] PUT /identity/v3/projects/d3dd6aec39614887a8acd42fbef0b8a6/users/0ee092fe66e04331a1438435dbf868e0/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:15.948135 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f31b-fea7-46b7-adf1-148c1fd22c8d None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:15.948666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f31b-fea7-46b7-adf1-148c1fd22c8d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:15.949331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5f31b-fea7-46b7-adf1-148c1fd22c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:15.990430 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-7fd5f31b-fea7-46b7-adf1-148c1fd22c8d None None] MFA Rules not processed for user `0ee092fe66e04331a1438435dbf868e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:15.993072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7fd5f31b-fea7-46b7-adf1-148c1fd22c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:16.007592 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d762cb-f299-4906-94dc-2f05d8028695 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:16.009510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d3d762cb-f299-4906-94dc-2f05d8028695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:16.161341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d762cb-f299-4906-94dc-2f05d8028695 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:16.169177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:16.170070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:16.170353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:16.170629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] PATH_INFO: `/v3/projects/a3268fcde4e44c71885a782bce23e4cf` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:16.171886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3268fcde4e44c71885a782bce23e4cf)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:16.173862 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:16.230052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:16.242786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3268fcde4e44c71885a782bce23e4cf', 'request_id': 'req-0f5b4406-c853-4255-be99-492e92bcf584'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.251036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3268fcde4e44c71885a782bce23e4cf', 'request_id': 'req-0f5b4406-c853-4255-be99-492e92bcf584'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.267394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3268fcde4e44c71885a782bce23e4cf', 'request_id': 'req-0f5b4406-c853-4255-be99-492e92bcf584'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.290281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] The token cache is being invalidate because project a3268fcde4e44c71885a782bce23e4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:16.290702 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.291575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.296551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 935/1826] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:16 2022] DELETE /identity/v3/projects/a3268fcde4e44c71885a782bce23e4cf => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:16.297684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:16.299611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:16.403039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b4406-c853-4255-be99-492e92bcf584 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:16.408598 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404faa5e-dccf-4c94-bcc0-b982dfc5b411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:16.409586 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404faa5e-dccf-4c94-bcc0-b982dfc5b411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:16.410148 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404faa5e-dccf-4c94-bcc0-b982dfc5b411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:16.410596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404faa5e-dccf-4c94-bcc0-b982dfc5b411 admin admin] PATH_INFO: `/v3/users/b19f31a6af6245b69e4fb57c34544e16` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:16.411949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404faa5e-dccf-4c94-bcc0-b982dfc5b411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19f31a6af6245b69e4fb57c34544e16)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:16.414575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404faa5e-dccf-4c94-bcc0-b982dfc5b411 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:16.443014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 892/1827] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:16.444317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5f31b-fea7-46b7-adf1-148c1fd22c8d None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:16.448411 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7fd5f31b-fea7-46b7-adf1-148c1fd22c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:16.481848 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5f31b-fea7-46b7-adf1-148c1fd22c8d None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:16.487552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:16.489208 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:16.489499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:16.489774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff admin admin] PATH_INFO: `/v3/projects/1de584dd864f4d8ebc707f74f63a8b86` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:16.491371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de584dd864f4d8ebc707f74f63a8b86)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:16.494018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:16.513713 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-404faa5e-dccf-4c94-bcc0-b982dfc5b411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19f31a6af6245b69e4fb57c34544e16'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.550085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-404faa5e-dccf-4c94-bcc0-b982dfc5b411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19f31a6af6245b69e4fb57c34544e16'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.551315 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-404faa5e-dccf-4c94-bcc0-b982dfc5b411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19f31a6af6245b69e4fb57c34544e16'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.562918 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-404faa5e-dccf-4c94-bcc0-b982dfc5b411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19f31a6af6245b69e4fb57c34544e16'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.573163 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:16.576452 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-404faa5e-dccf-4c94-bcc0-b982dfc5b411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19f31a6af6245b69e4fb57c34544e16'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.587644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 936/1828] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:16 2022] DELETE /identity/v3/users/b19f31a6af6245b69e4fb57c34544e16 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:16.588520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404faa5e-dccf-4c94-bcc0-b982dfc5b411 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:16.603833 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de584dd864f4d8ebc707f74f63a8b86', 'request_id': 'req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.607853 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-404faa5e-dccf-4c94-bcc0-b982dfc5b411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:16.614852 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de584dd864f4d8ebc707f74f63a8b86', 'request_id': 'req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.631968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de584dd864f4d8ebc707f74f63a8b86', 'request_id': 'req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.651549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff admin admin] The token cache is being invalidate because project 1de584dd864f4d8ebc707f74f63a8b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:16.651762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.652601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1e4eaf0b-0ae2-4192-8bc5-63ff9f2b92ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:16.654386 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 893/1829] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:16 2022] DELETE /identity/v3/projects/1de584dd864f4d8ebc707f74f63a8b86 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:16.659705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb27c97-8d88-4751-9ab8-a6b702d00db2 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:16.660166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb27c97-8d88-4751-9ab8-a6b702d00db2 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:16.660447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb27c97-8d88-4751-9ab8-a6b702d00db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:16.691125 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-2bb27c97-8d88-4751-9ab8-a6b702d00db2 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:16.699913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-2bb27c97-8d88-4751-9ab8-a6b702d00db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:16.712623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:16.737446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404faa5e-dccf-4c94-bcc0-b982dfc5b411 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:16.769725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ec642-cb47-4eb3-ad84-3ed89fa22eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:16.770784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ec642-cb47-4eb3-ad84-3ed89fa22eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:16.772492 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ec642-cb47-4eb3-ad84-3ed89fa22eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:16.775789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ec642-cb47-4eb3-ad84-3ed89fa22eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:16.776814 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ec642-cb47-4eb3-ad84-3ed89fa22eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:16.780539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ec642-cb47-4eb3-ad84-3ed89fa22eb0 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:16.838576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 937/1830] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:16 2022] POST /identity/v3/projects => generated 375 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:16.840558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 894/1831] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:16.861689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ec642-cb47-4eb3-ad84-3ed89fa22eb0 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:16.869124 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b8a35-98ce-4a4b-8568-3b0e9b120c55 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:16.877991 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7d3ec642-cb47-4eb3-ad84-3ed89fa22eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:16.878102 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b8a35-98ce-4a4b-8568-3b0e9b120c55 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:16.878102 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b8a35-98ce-4a4b-8568-3b0e9b120c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:16.927128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-d74b8a35-98ce-4a4b-8568-3b0e9b120c55 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:16.928592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d74b8a35-98ce-4a4b-8568-3b0e9b120c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:17.139758 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 895/1832] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:17.147914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b8a35-98ce-4a4b-8568-3b0e9b120c55 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:17.155066 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ec642-cb47-4eb3-ad84-3ed89fa22eb0 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:17.170925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b8a35-98ce-4a4b-8568-3b0e9b120c55 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:17.171961 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55333509-3125-40d6-a59a-93b80c6c611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:17.173184 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333509-3125-40d6-a59a-93b80c6c611c admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:17.174749 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333509-3125-40d6-a59a-93b80c6c611c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:17.175235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333509-3125-40d6-a59a-93b80c6c611c admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:17.176174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b3f4-e9b6-4585-9a22-d50b939fcaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:17.176849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b3f4-e9b6-4585-9a22-d50b939fcaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:17.177369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b3f4-e9b6-4585-9a22-d50b939fcaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:17.177659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b3f4-e9b6-4585-9a22-d50b939fcaa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:17.178403 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116b3f4-e9b6-4585-9a22-d50b939fcaa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:17.178711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116b3f4-e9b6-4585-9a22-d50b939fcaa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:17.182048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55333509-3125-40d6-a59a-93b80c6c611c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:17.187091 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55333509-3125-40d6-a59a-93b80c6c611c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:17.187617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116b3f4-e9b6-4585-9a22-d50b939fcaa3 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:17.221950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 938/1833] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:16 2022] POST /identity/v3/users => generated 294 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:17.225739 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55333509-3125-40d6-a59a-93b80c6c611c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:17.237072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55333509-3125-40d6-a59a-93b80c6c611c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:17.246144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d7553-c8c5-4c02-ab81-b79e6dd1944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:17.246786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d7553-c8c5-4c02-ab81-b79e6dd1944b admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:17.247143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d7553-c8c5-4c02-ab81-b79e6dd1944b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:17.247972 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d7553-c8c5-4c02-ab81-b79e6dd1944b admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:17.248483 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d7553-c8c5-4c02-ab81-b79e6dd1944b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:17.251001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d7553-c8c5-4c02-ab81-b79e6dd1944b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:17.251277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 896/1834] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:17.252423 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b3f4-e9b6-4585-9a22-d50b939fcaa3 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:17.270828 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 939/1835] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:17.272056 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d7553-c8c5-4c02-ab81-b79e6dd1944b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:17.285308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d7553-c8c5-4c02-ab81-b79e6dd1944b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:17.286597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b3f4-e9b6-4585-9a22-d50b939fcaa3 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:17.291560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cc1d4-dc6a-4b8d-a3ea-9e75c5d418b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:17.292621 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc1d4-dc6a-4b8d-a3ea-9e75c5d418b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:17.292978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc1d4-dc6a-4b8d-a3ea-9e75c5d418b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:17.293602 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc1d4-dc6a-4b8d-a3ea-9e75c5d418b5 admin admin] PATH_INFO: `/v3/projects/0fa24144dd1342dbb1e567733084d6b5/users/e556da995d7c48308188f65a03a0ca89/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:17.306602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856137b-6ae0-4e7a-b9e8-f99ac136f0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:17.307289 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856137b-6ae0-4e7a-b9e8-f99ac136f0af admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:17.307621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856137b-6ae0-4e7a-b9e8-f99ac136f0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:17.307872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856137b-6ae0-4e7a-b9e8-f99ac136f0af admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:17.308661 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856137b-6ae0-4e7a-b9e8-f99ac136f0af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:17.316008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cc1d4-dc6a-4b8d-a3ea-9e75c5d418b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa24144dd1342dbb1e567733084d6b5, user_id=e556da995d7c48308188f65a03a0ca89, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:17.319457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cc1d4-dc6a-4b8d-a3ea-9e75c5d418b5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:17.322740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856137b-6ae0-4e7a-b9e8-f99ac136f0af admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:17.343783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 940/1836] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:17 2022] PUT /identity/v3/projects/0fa24144dd1342dbb1e567733084d6b5/users/e556da995d7c48308188f65a03a0ca89/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:17.345721 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cc1d4-dc6a-4b8d-a3ea-9e75c5d418b5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:17.348641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-421cc1d4-dc6a-4b8d-a3ea-9e75c5d418b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:17.399310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 897/1837] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:17 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:17.405414 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856137b-6ae0-4e7a-b9e8-f99ac136f0af admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:17.448825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cc1d4-dc6a-4b8d-a3ea-9e75c5d418b5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:17.508857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:17.546567 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:17.588258 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856137b-6ae0-4e7a-b9e8-f99ac136f0af admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:17.594464 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b8baa-3a97-462e-9167-201d8cf702b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:17.595656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b8baa-3a97-462e-9167-201d8cf702b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:17.596290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b8baa-3a97-462e-9167-201d8cf702b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:17.596647 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b8baa-3a97-462e-9167-201d8cf702b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:17.599058 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b8baa-3a97-462e-9167-201d8cf702b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:17.602510 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b8baa-3a97-462e-9167-201d8cf702b0 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:17.621964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:17.622324 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:17.622962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:17.623607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] PATH_INFO: `/v3/projects/a25d555d40bf4bc595901d466ec8aedb` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:17.626051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 898/1838] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:17.629229 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b8baa-3a97-462e-9167-201d8cf702b0 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:17.629928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25d555d40bf4bc595901d466ec8aedb)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:17.632963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:17.650968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b8baa-3a97-462e-9167-201d8cf702b0 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:17.668234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c671d5-ffd3-4150-87ee-ea18b7ea8e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:17.675313 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c671d5-ffd3-4150-87ee-ea18b7ea8e64 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:17.675721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c671d5-ffd3-4150-87ee-ea18b7ea8e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:17.676053 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c671d5-ffd3-4150-87ee-ea18b7ea8e64 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:17.677981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c671d5-ffd3-4150-87ee-ea18b7ea8e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:17.678935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c671d5-ffd3-4150-87ee-ea18b7ea8e64 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:17.703128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 899/1839] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:17 2022] POST /identity/v3/users => generated 284 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:17.704157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c671d5-ffd3-4150-87ee-ea18b7ea8e64 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:17.714165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c671d5-ffd3-4150-87ee-ea18b7ea8e64 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:17.721680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25d555d40bf4bc595901d466ec8aedb', 'request_id': 'req-0efec1ad-f2a5-433a-b28d-582616846d9d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:17.731790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25d555d40bf4bc595901d466ec8aedb', 'request_id': 'req-0efec1ad-f2a5-433a-b28d-582616846d9d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:17.746804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25d555d40bf4bc595901d466ec8aedb', 'request_id': 'req-0efec1ad-f2a5-433a-b28d-582616846d9d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:17.762601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] The token cache is being invalidate because project a25d555d40bf4bc595901d466ec8aedb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:17.763029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:17.763736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:17.765726 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 941/1840] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:17 2022] DELETE /identity/v3/projects/a25d555d40bf4bc595901d466ec8aedb => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:17.768955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:17.768955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:17.793121 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e3c5a-df4c-46d8-b2c2-cc60ea57dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:17.794770 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3c5a-df4c-46d8-b2c2-cc60ea57dd24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:17.795317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3c5a-df4c-46d8-b2c2-cc60ea57dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:17.795635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e3c5a-df4c-46d8-b2c2-cc60ea57dd24 admin admin] PATH_INFO: `/v3/projects/0fa24144dd1342dbb1e567733084d6b5/users/e556da995d7c48308188f65a03a0ca89/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:17.798130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e3c5a-df4c-46d8-b2c2-cc60ea57dd24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa24144dd1342dbb1e567733084d6b5, user_id=e556da995d7c48308188f65a03a0ca89, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:17.800839 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e3c5a-df4c-46d8-b2c2-cc60ea57dd24 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:17.819596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 900/1841] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:17 2022] PUT /identity/v3/projects/0fa24144dd1342dbb1e567733084d6b5/users/e556da995d7c48308188f65a03a0ca89/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:17.819596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00d30e-ab75-4217-b6e3-13b00b33042a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:17.819596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00d30e-ab75-4217-b6e3-13b00b33042a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:17.819596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00d30e-ab75-4217-b6e3-13b00b33042a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:17.838845 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-aa00d30e-ab75-4217-b6e3-13b00b33042a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:17.840400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-aa00d30e-ab75-4217-b6e3-13b00b33042a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:17.844735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efec1ad-f2a5-433a-b28d-582616846d9d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:17.910904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6307355-faa9-4266-a5c9-b500a8ada679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:17.911635 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6307355-faa9-4266-a5c9-b500a8ada679 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:17.911921 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6307355-faa9-4266-a5c9-b500a8ada679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:17.912194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6307355-faa9-4266-a5c9-b500a8ada679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:17.912945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6307355-faa9-4266-a5c9-b500a8ada679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:17.915111 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6307355-faa9-4266-a5c9-b500a8ada679 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:17.917606 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 901/1842] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:17.919738 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b6cf2-c13f-4a07-bd73-a1783d1bf197 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:17.920033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b6cf2-c13f-4a07-bd73-a1783d1bf197 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:17.920363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b6cf2-c13f-4a07-bd73-a1783d1bf197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:17.929273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 942/1843] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:17.930366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0e19b-dcd4-420e-8c11-7e18a4ea3dc7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:17.930654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0e19b-dcd4-420e-8c11-7e18a4ea3dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:17.930927 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0e19b-dcd4-420e-8c11-7e18a4ea3dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:17.938650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:17.946484 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-4d0b6cf2-c13f-4a07-bd73-a1783d1bf197 None None] MFA Rules not processed for user `e556da995d7c48308188f65a03a0ca89`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:17.947729 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4d0b6cf2-c13f-4a07-bd73-a1783d1bf197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:17.952939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-05c0e19b-dcd4-420e-8c11-7e18a4ea3dc7 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:17.954374 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-05c0e19b-dcd4-420e-8c11-7e18a4ea3dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:17.969005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 943/1844] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:17.969005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0e19b-dcd4-420e-8c11-7e18a4ea3dc7 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:17.978222 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0e19b-dcd4-420e-8c11-7e18a4ea3dc7 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:17.983741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:17.986348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04ff62-b3cf-42ff-b68c-968a87f4d698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:17.987126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ff62-b3cf-42ff-b68c-968a87f4d698 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:17.987494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ff62-b3cf-42ff-b68c-968a87f4d698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:17.987786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ff62-b3cf-42ff-b68c-968a87f4d698 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:17.988518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04ff62-b3cf-42ff-b68c-968a87f4d698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:17.990151 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04ff62-b3cf-42ff-b68c-968a87f4d698 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.001767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 944/1845] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:18.002591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04ff62-b3cf-42ff-b68c-968a87f4d698 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.012079 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04ff62-b3cf-42ff-b68c-968a87f4d698 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.017443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1def304-1046-42c8-a73d-7c3a7cb2c4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.018106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1def304-1046-42c8-a73d-7c3a7cb2c4dc admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.018385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1def304-1046-42c8-a73d-7c3a7cb2c4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.018656 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1def304-1046-42c8-a73d-7c3a7cb2c4dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.019382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1def304-1046-42c8-a73d-7c3a7cb2c4dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:18.019719 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1def304-1046-42c8-a73d-7c3a7cb2c4dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.021315 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1def304-1046-42c8-a73d-7c3a7cb2c4dc admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.032319 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 902/1846] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:18.033141 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b6cf2-c13f-4a07-bd73-a1783d1bf197 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.037425 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 945/1847] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:18.038535 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1def304-1046-42c8-a73d-7c3a7cb2c4dc admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.046347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b6cf2-c13f-4a07-bd73-a1783d1bf197 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.048935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1def304-1046-42c8-a73d-7c3a7cb2c4dc admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.050973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70fba2-e2be-468e-8d63-f894a0ec4af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.051892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70fba2-e2be-468e-8d63-f894a0ec4af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.052202 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70fba2-e2be-468e-8d63-f894a0ec4af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.052530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70fba2-e2be-468e-8d63-f894a0ec4af5 admin admin] PATH_INFO: `/v3/projects/07a612d3c1c942c2a06d35aa07c485a0/users/9e7521fbdd664f5eb9dead229e7a2190/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.053678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b466efd-058c-4d18-a7cd-f53f6c9ed9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.054394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b466efd-058c-4d18-a7cd-f53f6c9ed9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.054811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b466efd-058c-4d18-a7cd-f53f6c9ed9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.054952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b466efd-058c-4d18-a7cd-f53f6c9ed9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.055666 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b466efd-058c-4d18-a7cd-f53f6c9ed9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.057551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b466efd-058c-4d18-a7cd-f53f6c9ed9f1 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.068016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70fba2-e2be-468e-8d63-f894a0ec4af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a612d3c1c942c2a06d35aa07c485a0, user_id=9e7521fbdd664f5eb9dead229e7a2190, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.070356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70fba2-e2be-468e-8d63-f894a0ec4af5 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.083429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 903/1848] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:18 2022] PUT /identity/v3/projects/07a612d3c1c942c2a06d35aa07c485a0/users/9e7521fbdd664f5eb9dead229e7a2190/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:18.084266 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70fba2-e2be-468e-8d63-f894a0ec4af5 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.088511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 946/1849] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:18 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:18.089482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b466efd-058c-4d18-a7cd-f53f6c9ed9f1 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.090821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6f70fba2-e2be-468e-8d63-f894a0ec4af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:18.153013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70fba2-e2be-468e-8d63-f894a0ec4af5 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.156646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b466efd-058c-4d18-a7cd-f53f6c9ed9f1 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.169490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bf574-f143-495b-80fc-745e419f4006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.170308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bf574-f143-495b-80fc-745e419f4006 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.170615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bf574-f143-495b-80fc-745e419f4006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.171045 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bf574-f143-495b-80fc-745e419f4006 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.171803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bf574-f143-495b-80fc-745e419f4006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.173850 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bf574-f143-495b-80fc-745e419f4006 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.198003 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 947/1850] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:18 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:18.199703 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cdfaa-cea1-4f1b-93ed-5c42a1899262 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.199997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cdfaa-cea1-4f1b-93ed-5c42a1899262 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.200275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cdfaa-cea1-4f1b-93ed-5c42a1899262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.221033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f24ee4-332a-4753-ab9b-7d963357c86a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.221698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24ee4-332a-4753-ab9b-7d963357c86a service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.221980 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24ee4-332a-4753-ab9b-7d963357c86a service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.222435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f24ee4-332a-4753-ab9b-7d963357c86a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.224311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a0f24ee4-332a-4753-ab9b-7d963357c86a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:18.229510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a93cdfaa-cea1-4f1b-93ed-5c42a1899262 None None] MFA Rules not processed for user `9e7521fbdd664f5eb9dead229e7a2190`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:18.231004 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a93cdfaa-cea1-4f1b-93ed-5c42a1899262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:18.295282 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f24ee4-332a-4753-ab9b-7d963357c86a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.297406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f24ee4-332a-4753-ab9b-7d963357c86a service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.302822 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 948/1851] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:18.303668 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cdfaa-cea1-4f1b-93ed-5c42a1899262 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.313137 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 904/1852] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:18.313967 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f24ee4-332a-4753-ab9b-7d963357c86a service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.314390 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cdfaa-cea1-4f1b-93ed-5c42a1899262 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.319523 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886bf52-717f-47c1-a089-7ceb71ec104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.320758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886bf52-717f-47c1-a089-7ceb71ec104c admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.321113 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886bf52-717f-47c1-a089-7ceb71ec104c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.321832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886bf52-717f-47c1-a089-7ceb71ec104c admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.322115 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886bf52-717f-47c1-a089-7ceb71ec104c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.323910 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886bf52-717f-47c1-a089-7ceb71ec104c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.327076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f24ee4-332a-4753-ab9b-7d963357c86a service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.333222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd339885-c7b1-45a1-86db-d229664c17e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.333896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339885-c7b1-45a1-86db-d229664c17e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.334180 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339885-c7b1-45a1-86db-d229664c17e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.334592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd339885-c7b1-45a1-86db-d229664c17e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.335350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd339885-c7b1-45a1-86db-d229664c17e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.338222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd339885-c7b1-45a1-86db-d229664c17e9 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.339145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 949/1853] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:18.343356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886bf52-717f-47c1-a089-7ceb71ec104c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.344479 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:18.361986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886bf52-717f-47c1-a089-7ceb71ec104c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.370402 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c654ea-cd56-404a-b88f-6fb26b5bbcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.371236 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c654ea-cd56-404a-b88f-6fb26b5bbcea admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.371623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c654ea-cd56-404a-b88f-6fb26b5bbcea admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.371993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c654ea-cd56-404a-b88f-6fb26b5bbcea admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.372903 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c654ea-cd56-404a-b88f-6fb26b5bbcea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.374995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c654ea-cd56-404a-b88f-6fb26b5bbcea admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.375718 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 905/1854] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:18 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:18.379993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd339885-c7b1-45a1-86db-d229664c17e9 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.394225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 950/1855] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:18.398988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c654ea-cd56-404a-b88f-6fb26b5bbcea admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.414316 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c654ea-cd56-404a-b88f-6fb26b5bbcea admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.421290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:18.482057 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd339885-c7b1-45a1-86db-d229664c17e9 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.485925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e266801-cb97-4a87-b2d0-d6d48ee0d25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.486444 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e266801-cb97-4a87-b2d0-d6d48ee0d25f admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.486730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e266801-cb97-4a87-b2d0-d6d48ee0d25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.486855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46ac24-a486-483b-a85d-9ff7cb536f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.487005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e266801-cb97-4a87-b2d0-d6d48ee0d25f admin admin] PATH_INFO: `/v3/projects/06ca4db31826493f874fd8582ea8d2e3/users/18adbdfafa674a5ea750808af63d32c9/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.487493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46ac24-a486-483b-a85d-9ff7cb536f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.487836 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46ac24-a486-483b-a85d-9ff7cb536f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.488122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46ac24-a486-483b-a85d-9ff7cb536f67 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.488841 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46ac24-a486-483b-a85d-9ff7cb536f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.490792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46ac24-a486-483b-a85d-9ff7cb536f67 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.505983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e266801-cb97-4a87-b2d0-d6d48ee0d25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ca4db31826493f874fd8582ea8d2e3, user_id=18adbdfafa674a5ea750808af63d32c9, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.509480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e266801-cb97-4a87-b2d0-d6d48ee0d25f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.517932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 906/1856] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:18 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:18.522222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46ac24-a486-483b-a85d-9ff7cb536f67 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.529289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 951/1857] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:18 2022] PUT /identity/v3/projects/06ca4db31826493f874fd8582ea8d2e3/users/18adbdfafa674a5ea750808af63d32c9/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:18.542956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063abb-2b86-450e-b86d-c71cfd922868 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.543399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063abb-2b86-450e-b86d-c71cfd922868 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.544026 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063abb-2b86-450e-b86d-c71cfd922868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.544937 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46ac24-a486-483b-a85d-9ff7cb536f67 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.575299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ee063abb-2b86-450e-b86d-c71cfd922868 None None] MFA Rules not processed for user `18adbdfafa674a5ea750808af63d32c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:18.576802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ee063abb-2b86-450e-b86d-c71cfd922868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:18.639421 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa68b52-77ec-4048-a520-c87554894295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.640132 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa68b52-77ec-4048-a520-c87554894295 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.640446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa68b52-77ec-4048-a520-c87554894295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.640723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa68b52-77ec-4048-a520-c87554894295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.641672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa68b52-77ec-4048-a520-c87554894295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.643401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa68b52-77ec-4048-a520-c87554894295 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.662961 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 907/1858] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:18.664674 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa68b52-77ec-4048-a520-c87554894295 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.689361 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa68b52-77ec-4048-a520-c87554894295 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.691411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 952/1859] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:18.697262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee063abb-2b86-450e-b86d-c71cfd922868 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.706550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb5197-4ef8-4d5e-8f31-904e964cd7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.707805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb5197-4ef8-4d5e-8f31-904e964cd7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.708279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb5197-4ef8-4d5e-8f31-904e964cd7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.708635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb5197-4ef8-4d5e-8f31-904e964cd7ce admin admin] PATH_INFO: `/v3/projects/bfa620a8e14043e383d3f483c902b3fd/users/a285f38d953d4c3ca6546a12b69451ab/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.723809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee063abb-2b86-450e-b86d-c71cfd922868 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.733291 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb5197-4ef8-4d5e-8f31-904e964cd7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa620a8e14043e383d3f483c902b3fd, user_id=a285f38d953d4c3ca6546a12b69451ab, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.736925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718226d-9d62-408f-a2fd-1a52a80c3b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.737604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718226d-9d62-408f-a2fd-1a52a80c3b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.739032 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718226d-9d62-408f-a2fd-1a52a80c3b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.739689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718226d-9d62-408f-a2fd-1a52a80c3b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.740401 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718226d-9d62-408f-a2fd-1a52a80c3b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.744081 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718226d-9d62-408f-a2fd-1a52a80c3b35 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.746980 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb5197-4ef8-4d5e-8f31-904e964cd7ce admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.787754 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 908/1860] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:18 2022] PUT /identity/v3/projects/bfa620a8e14043e383d3f483c902b3fd/users/a285f38d953d4c3ca6546a12b69451ab/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:18.787754 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb5197-4ef8-4d5e-8f31-904e964cd7ce admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.788749 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 953/1861] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:18 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:18.788838 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718226d-9d62-408f-a2fd-1a52a80c3b35 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.873228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:18.897689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718226d-9d62-408f-a2fd-1a52a80c3b35 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.906387 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb5197-4ef8-4d5e-8f31-904e964cd7ce admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.912256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537234fb-f670-4053-a93f-40d417037db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.913242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537234fb-f670-4053-a93f-40d417037db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.913481 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf495f4-37db-4545-afa7-80d93c8f5ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.914668 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf495f4-37db-4545-afa7-80d93c8f5ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.914951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf495f4-37db-4545-afa7-80d93c8f5ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.915155 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537234fb-f670-4053-a93f-40d417037db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.915348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf495f4-37db-4545-afa7-80d93c8f5ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.916082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf495f4-37db-4545-afa7-80d93c8f5ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.916523 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537234fb-f670-4053-a93f-40d417037db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.917287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537234fb-f670-4053-a93f-40d417037db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.919006 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537234fb-f670-4053-a93f-40d417037db5 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.920367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf495f4-37db-4545-afa7-80d93c8f5ad3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.932276 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:18.933836 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 909/1862] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:18.939874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537234fb-f670-4053-a93f-40d417037db5 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.952149 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537234fb-f670-4053-a93f-40d417037db5 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.955510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 954/1863] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:18 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:18.959636 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf495f4-37db-4545-afa7-80d93c8f5ad3 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:18.966732 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f59139-bfcd-41a8-b5ac-858b511cc45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.967920 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59139-bfcd-41a8-b5ac-858b511cc45b admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.968081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59139-bfcd-41a8-b5ac-858b511cc45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.968458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59139-bfcd-41a8-b5ac-858b511cc45b admin admin] PATH_INFO: `/v3/projects/bfa620a8e14043e383d3f483c902b3fd/users/a285f38d953d4c3ca6546a12b69451ab/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.970706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f59139-bfcd-41a8-b5ac-858b511cc45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa620a8e14043e383d3f483c902b3fd, user_id=a285f38d953d4c3ca6546a12b69451ab, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.973701 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f59139-bfcd-41a8-b5ac-858b511cc45b admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.973819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf495f4-37db-4545-afa7-80d93c8f5ad3 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:18.983765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9444d-d406-49b7-8b01-3059ef2b736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:18.984473 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9444d-d406-49b7-8b01-3059ef2b736d admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:18.984951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9444d-d406-49b7-8b01-3059ef2b736d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:18.985236 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9444d-d406-49b7-8b01-3059ef2b736d admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:18.986581 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9444d-d406-49b7-8b01-3059ef2b736d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:18.989576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9444d-d406-49b7-8b01-3059ef2b736d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:18.991594 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 910/1864] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:18 2022] PUT /identity/v3/projects/bfa620a8e14043e383d3f483c902b3fd/users/a285f38d953d4c3ca6546a12b69451ab/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:19.016568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d8594-f50d-440b-98e8-657d950a15e2 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:19.016863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d8594-f50d-440b-98e8-657d950a15e2 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:19.017636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d8594-f50d-440b-98e8-657d950a15e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:19.020654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 955/1865] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:19.031792 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9444d-d406-49b7-8b01-3059ef2b736d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:19.046476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9444d-d406-49b7-8b01-3059ef2b736d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:19.086045 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-833d8594-f50d-440b-98e8-657d950a15e2 None None] MFA Rules not processed for user `a285f38d953d4c3ca6546a12b69451ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:19.087611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-833d8594-f50d-440b-98e8-657d950a15e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:19.154548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b06e9d-d181-44b2-953a-655c8fa31321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:19.155251 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b06e9d-d181-44b2-953a-655c8fa31321 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:19.155556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b06e9d-d181-44b2-953a-655c8fa31321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:19.155835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b06e9d-d181-44b2-953a-655c8fa31321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:19.158513 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b06e9d-d181-44b2-953a-655c8fa31321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:19.160204 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b06e9d-d181-44b2-953a-655c8fa31321 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:19.173219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 956/1866] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:19.177392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b06e9d-d181-44b2-953a-655c8fa31321 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:19.203363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b06e9d-d181-44b2-953a-655c8fa31321 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:19.214149 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0b2b6-d0b6-4dc1-8082-e2f148be3a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:19.218038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b2b6-d0b6-4dc1-8082-e2f148be3a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:19.219107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b2b6-d0b6-4dc1-8082-e2f148be3a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:19.219654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b2b6-d0b6-4dc1-8082-e2f148be3a0b admin admin] PATH_INFO: `/v3/projects/ae77e9afb3bb467db84630c79ff58881/users/48240f09f69642e893bec46247a38608/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:19.250358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0b2b6-d0b6-4dc1-8082-e2f148be3a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae77e9afb3bb467db84630c79ff58881, user_id=48240f09f69642e893bec46247a38608, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:19.250665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 911/1867] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:19 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:19.254285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0b2b6-d0b6-4dc1-8082-e2f148be3a0b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:19.263864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d8594-f50d-440b-98e8-657d950a15e2 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:19.265887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-833d8594-f50d-440b-98e8-657d950a15e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:19.284903 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 957/1868] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:19 2022] PUT /identity/v3/projects/ae77e9afb3bb467db84630c79ff58881/users/48240f09f69642e893bec46247a38608/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:19.297198 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0b50d-768f-4df0-8d07-bda4d136280d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:19.297718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0b50d-768f-4df0-8d07-bda4d136280d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:19.297809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0b50d-768f-4df0-8d07-bda4d136280d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:19.334293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f5e0b50d-768f-4df0-8d07-bda4d136280d None None] MFA Rules not processed for user `48240f09f69642e893bec46247a38608`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:19.341988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f5e0b50d-768f-4df0-8d07-bda4d136280d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:19.343351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d8594-f50d-440b-98e8-657d950a15e2 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:19.403147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb140f-fb43-413d-a833-5a6d57037fb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:19.403827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb140f-fb43-413d-a833-5a6d57037fb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:19.404107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb140f-fb43-413d-a833-5a6d57037fb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:19.404376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb140f-fb43-413d-a833-5a6d57037fb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:19.414761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 958/1869] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:19.419186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0b50d-768f-4df0-8d07-bda4d136280d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:19.437330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:19.470992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:19.481536 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb140f-fb43-413d-a833-5a6d57037fb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:19.483014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb140f-fb43-413d-a833-5a6d57037fb9 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:19.492825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 912/1870] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:19 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:19.495290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0b50d-768f-4df0-8d07-bda4d136280d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:19.501154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a74835-efe3-4f8c-9d02-b8afc2d740de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:19.501819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a74835-efe3-4f8c-9d02-b8afc2d740de admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:19.502219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a74835-efe3-4f8c-9d02-b8afc2d740de admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:19.502389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a74835-efe3-4f8c-9d02-b8afc2d740de admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:19.503089 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a74835-efe3-4f8c-9d02-b8afc2d740de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:19.505004 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a74835-efe3-4f8c-9d02-b8afc2d740de admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:19.532369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 959/1871] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:19 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:19.539015 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb140f-fb43-413d-a833-5a6d57037fb9 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:19.550339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb140f-fb43-413d-a833-5a6d57037fb9 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:19.615025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c789d-dce2-4d46-8366-355c184a7696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:19.615801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c789d-dce2-4d46-8366-355c184a7696 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:19.616152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c789d-dce2-4d46-8366-355c184a7696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:19.616521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c789d-dce2-4d46-8366-355c184a7696 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:19.617276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c789d-dce2-4d46-8366-355c184a7696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:19.619215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c789d-dce2-4d46-8366-355c184a7696 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:19.640997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 913/1872] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:19 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:19.645377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a74835-efe3-4f8c-9d02-b8afc2d740de admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:19.661427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a74835-efe3-4f8c-9d02-b8afc2d740de admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:19.667599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a6002-52ba-4b59-aa9b-61315a229a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:19.668278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a6002-52ba-4b59-aa9b-61315a229a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:19.668557 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a6002-52ba-4b59-aa9b-61315a229a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:19.668834 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a6002-52ba-4b59-aa9b-61315a229a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:19.669593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a6002-52ba-4b59-aa9b-61315a229a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:19.671293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a6002-52ba-4b59-aa9b-61315a229a89 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:19.684103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 960/1873] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:19.688807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c789d-dce2-4d46-8366-355c184a7696 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:19.702539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c789d-dce2-4d46-8366-355c184a7696 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:19.708950 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a09f8d-8781-4dc8-8ab5-9ae35456b7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:19.709845 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a09f8d-8781-4dc8-8ab5-9ae35456b7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:19.710125 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a09f8d-8781-4dc8-8ab5-9ae35456b7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:19.710444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a09f8d-8781-4dc8-8ab5-9ae35456b7d9 admin admin] PATH_INFO: `/v3/projects/c2670ea6159e468fba557a8510e4fc05/users/337e9e9a33e34c918913dbff2a3cf7b1/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:19.727728 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a09f8d-8781-4dc8-8ab5-9ae35456b7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2670ea6159e468fba557a8510e4fc05, user_id=337e9e9a33e34c918913dbff2a3cf7b1, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:19.732112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a09f8d-8781-4dc8-8ab5-9ae35456b7d9 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:19.745656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 914/1874] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:19 2022] PUT /identity/v3/projects/c2670ea6159e468fba557a8510e4fc05/users/337e9e9a33e34c918913dbff2a3cf7b1/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:19.753015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a6002-52ba-4b59-aa9b-61315a229a89 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:19.762035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a6002-52ba-4b59-aa9b-61315a229a89 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:19.826969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556676b-402b-4030-8330-3010e3ff0763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:19.827560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556676b-402b-4030-8330-3010e3ff0763 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:19.828134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556676b-402b-4030-8330-3010e3ff0763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:19.831683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556676b-402b-4030-8330-3010e3ff0763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:19.832549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556676b-402b-4030-8330-3010e3ff0763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:19.834208 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556676b-402b-4030-8330-3010e3ff0763 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:19.848496 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 961/1875] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:19.849367 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a09f8d-8781-4dc8-8ab5-9ae35456b7d9 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:19.860516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a09f8d-8781-4dc8-8ab5-9ae35456b7d9 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:19.867449 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93c952-b781-47d5-ae3c-970690be2040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:19.868374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93c952-b781-47d5-ae3c-970690be2040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:19.869196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93c952-b781-47d5-ae3c-970690be2040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:19.869196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93c952-b781-47d5-ae3c-970690be2040 admin admin] PATH_INFO: `/v3/projects/c2670ea6159e468fba557a8510e4fc05/users/337e9e9a33e34c918913dbff2a3cf7b1/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:19.874888 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93c952-b781-47d5-ae3c-970690be2040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2670ea6159e468fba557a8510e4fc05, user_id=337e9e9a33e34c918913dbff2a3cf7b1, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:19.877543 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93c952-b781-47d5-ae3c-970690be2040 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:19.892395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 915/1876] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:19 2022] PUT /identity/v3/projects/c2670ea6159e468fba557a8510e4fc05/users/337e9e9a33e34c918913dbff2a3cf7b1/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:19.902955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd084a-8375-489d-ae14-beed6b580d32 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:19.903437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd084a-8375-489d-ae14-beed6b580d32 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:19.903925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd084a-8375-489d-ae14-beed6b580d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:19.937809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4bdd084a-8375-489d-ae14-beed6b580d32 None None] MFA Rules not processed for user `337e9e9a33e34c918913dbff2a3cf7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:19.939447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4bdd084a-8375-489d-ae14-beed6b580d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:20.088121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 962/1877] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:20.099827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93c952-b781-47d5-ae3c-970690be2040 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:20.199826 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93c952-b781-47d5-ae3c-970690be2040 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:20.205688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f294304-90a8-4b13-a9bb-e490a22aa2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:20.206477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f294304-90a8-4b13-a9bb-e490a22aa2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:20.206860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f294304-90a8-4b13-a9bb-e490a22aa2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:20.207301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f294304-90a8-4b13-a9bb-e490a22aa2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:20.220608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f294304-90a8-4b13-a9bb-e490a22aa2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:20.223716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f294304-90a8-4b13-a9bb-e490a22aa2d9 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:20.252502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 916/1878] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:20.301978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd084a-8375-489d-ae14-beed6b580d32 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:20.317500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd084a-8375-489d-ae14-beed6b580d32 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:20.322017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36151a0f-7524-4e04-8ccd-5af7c11d2364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:20.322859 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36151a0f-7524-4e04-8ccd-5af7c11d2364 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:20.323288 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36151a0f-7524-4e04-8ccd-5af7c11d2364 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:20.323764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36151a0f-7524-4e04-8ccd-5af7c11d2364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:20.383175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:20.424709 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36151a0f-7524-4e04-8ccd-5af7c11d2364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:20.427179 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36151a0f-7524-4e04-8ccd-5af7c11d2364 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:20.444904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 963/1879] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:21.101123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f294304-90a8-4b13-a9bb-e490a22aa2d9 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:21.110918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f294304-90a8-4b13-a9bb-e490a22aa2d9 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:21.138074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3750b1-c230-4583-9167-b724363244f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:21.138750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3750b1-c230-4583-9167-b724363244f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:21.139029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3750b1-c230-4583-9167-b724363244f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:21.139514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3750b1-c230-4583-9167-b724363244f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:21.168205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:21.249260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3750b1-c230-4583-9167-b724363244f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:21.251577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3750b1-c230-4583-9167-b724363244f5 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:21.278306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 917/1880] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:21.915219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36151a0f-7524-4e04-8ccd-5af7c11d2364 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:22.013545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36151a0f-7524-4e04-8ccd-5af7c11d2364 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:22.013545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d98907-e686-4c55-aba5-4436df68d4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:22.014929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d98907-e686-4c55-aba5-4436df68d4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:22.015512 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d98907-e686-4c55-aba5-4436df68d4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:22.016140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d98907-e686-4c55-aba5-4436df68d4a7 admin admin] PATH_INFO: `/v3/users/9e7521fbdd664f5eb9dead229e7a2190` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:22.018006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d98907-e686-4c55-aba5-4436df68d4a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e7521fbdd664f5eb9dead229e7a2190)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:22.020279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d98907-e686-4c55-aba5-4436df68d4a7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:22.181188 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-63d98907-e686-4c55-aba5-4436df68d4a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e7521fbdd664f5eb9dead229e7a2190'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:22.243896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-63d98907-e686-4c55-aba5-4436df68d4a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e7521fbdd664f5eb9dead229e7a2190'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:22.246419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-63d98907-e686-4c55-aba5-4436df68d4a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e7521fbdd664f5eb9dead229e7a2190'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:22.278211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-63d98907-e686-4c55-aba5-4436df68d4a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e7521fbdd664f5eb9dead229e7a2190'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:22.294028 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-63d98907-e686-4c55-aba5-4436df68d4a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e7521fbdd664f5eb9dead229e7a2190'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:22.311099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 964/1881] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:21 2022] DELETE /identity/v3/users/9e7521fbdd664f5eb9dead229e7a2190 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:22.316429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4652b-44de-4316-9afd-8c3c53224a41 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:22.317271 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4652b-44de-4316-9afd-8c3c53224a41 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:22.318885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4652b-44de-4316-9afd-8c3c53224a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:22.355756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-17d4652b-44de-4316-9afd-8c3c53224a41 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:22.357454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-17d4652b-44de-4316-9afd-8c3c53224a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:22.463147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 918/1882] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:22.476685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d98907-e686-4c55-aba5-4436df68d4a7 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:22.479053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-63d98907-e686-4c55-aba5-4436df68d4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:22.569401 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d98907-e686-4c55-aba5-4436df68d4a7 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:22.574532 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3320f28-490b-49de-ad0e-b29034f1a618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:22.575282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320f28-490b-49de-ad0e-b29034f1a618 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:22.575820 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320f28-490b-49de-ad0e-b29034f1a618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:22.576178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320f28-490b-49de-ad0e-b29034f1a618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:22.585130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:22.588699 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320f28-490b-49de-ad0e-b29034f1a618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:22.590861 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320f28-490b-49de-ad0e-b29034f1a618 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:22.608683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 965/1883] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:23.001592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4652b-44de-4316-9afd-8c3c53224a41 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:23.003089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-17d4652b-44de-4316-9afd-8c3c53224a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:23.030217 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4652b-44de-4316-9afd-8c3c53224a41 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:23.049333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:23.052527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:23.053089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:23.053676 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] PATH_INFO: `/v3/projects/07a612d3c1c942c2a06d35aa07c485a0` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:23.058346 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a612d3c1c942c2a06d35aa07c485a0)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:23.064968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:23.183954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a612d3c1c942c2a06d35aa07c485a0', 'request_id': 'req-1ce4160c-3110-4a53-8675-3f72abcfaaca'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:23.193708 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a612d3c1c942c2a06d35aa07c485a0', 'request_id': 'req-1ce4160c-3110-4a53-8675-3f72abcfaaca'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:23.202008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a612d3c1c942c2a06d35aa07c485a0', 'request_id': 'req-1ce4160c-3110-4a53-8675-3f72abcfaaca'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:23.228302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] The token cache is being invalidate because project 07a612d3c1c942c2a06d35aa07c485a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:23.228800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:23.229549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:23.232500 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 919/1884] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:23 2022] DELETE /identity/v3/projects/07a612d3c1c942c2a06d35aa07c485a0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:23.236121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3320f28-490b-49de-ad0e-b29034f1a618 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:23.249282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3320f28-490b-49de-ad0e-b29034f1a618 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:23.348960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d34c1-e30c-4af6-bd72-eae9dd4dd1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:23.349914 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d34c1-e30c-4af6-bd72-eae9dd4dd1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:23.350196 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d34c1-e30c-4af6-bd72-eae9dd4dd1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:23.351324 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d34c1-e30c-4af6-bd72-eae9dd4dd1c3 admin admin] PATH_INFO: `/v3/users/a285f38d953d4c3ca6546a12b69451ab` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:23.353408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d34c1-e30c-4af6-bd72-eae9dd4dd1c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a285f38d953d4c3ca6546a12b69451ab)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:23.356890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d34c1-e30c-4af6-bd72-eae9dd4dd1c3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:23.452565 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-943d34c1-e30c-4af6-bd72-eae9dd4dd1c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a285f38d953d4c3ca6546a12b69451ab'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:23.469135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-943d34c1-e30c-4af6-bd72-eae9dd4dd1c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a285f38d953d4c3ca6546a12b69451ab'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:23.470429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-943d34c1-e30c-4af6-bd72-eae9dd4dd1c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a285f38d953d4c3ca6546a12b69451ab'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:23.482815 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-943d34c1-e30c-4af6-bd72-eae9dd4dd1c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a285f38d953d4c3ca6546a12b69451ab'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:23.508245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-943d34c1-e30c-4af6-bd72-eae9dd4dd1c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a285f38d953d4c3ca6546a12b69451ab'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:23.520804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 966/1885] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:23 2022] DELETE /identity/v3/users/a285f38d953d4c3ca6546a12b69451ab => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:23.832357 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:23.835151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:23.850570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4160c-3110-4a53-8675-3f72abcfaaca admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:23.889320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:23.928315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:23.929879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:23.930269 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:23.931192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] PATH_INFO: `/v3/projects/bfa620a8e14043e383d3f483c902b3fd` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:23.933129 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa620a8e14043e383d3f483c902b3fd)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:23.936245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:23.999665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa620a8e14043e383d3f483c902b3fd', 'request_id': 'req-2edbbe76-06fa-41d8-b505-729fc41d117f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:24.006383 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa620a8e14043e383d3f483c902b3fd', 'request_id': 'req-2edbbe76-06fa-41d8-b505-729fc41d117f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:24.015017 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa620a8e14043e383d3f483c902b3fd', 'request_id': 'req-2edbbe76-06fa-41d8-b505-729fc41d117f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:24.034277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] The token cache is being invalidate because project bfa620a8e14043e383d3f483c902b3fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:24.034587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:24.035240 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:24.037466 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 920/1886] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:23 2022] DELETE /identity/v3/projects/bfa620a8e14043e383d3f483c902b3fd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:24.043262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c8900-e646-4df2-9d9c-f17a497ad7ff None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:24.043920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c8900-e646-4df2-9d9c-f17a497ad7ff None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:24.044464 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c8900-e646-4df2-9d9c-f17a497ad7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:24.049656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:24.051188 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:24.096821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5d6c8900-e646-4df2-9d9c-f17a497ad7ff None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:24.096821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5d6c8900-e646-4df2-9d9c-f17a497ad7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:24.157205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbbe76-06fa-41d8-b505-729fc41d117f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:24.164277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3831f-1f1d-4cd7-993c-5b669f93c8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:24.165198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3831f-1f1d-4cd7-993c-5b669f93c8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:24.165482 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3831f-1f1d-4cd7-993c-5b669f93c8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:24.165928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3831f-1f1d-4cd7-993c-5b669f93c8d3 admin admin] PATH_INFO: `/v3/users/18adbdfafa674a5ea750808af63d32c9` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:24.167917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3831f-1f1d-4cd7-993c-5b669f93c8d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18adbdfafa674a5ea750808af63d32c9)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:24.169988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3831f-1f1d-4cd7-993c-5b669f93c8d3 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:24.176552 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 967/1887] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:24.184908 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5defbf-3b98-4bae-bab3-5dc6b15a4b40 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:24.185204 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5defbf-3b98-4bae-bab3-5dc6b15a4b40 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:24.185474 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5defbf-3b98-4bae-bab3-5dc6b15a4b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:24.206911 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5c5defbf-3b98-4bae-bab3-5dc6b15a4b40 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:24.208279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5c5defbf-3b98-4bae-bab3-5dc6b15a4b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:24.219160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 968/1888] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:24.223935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5defbf-3b98-4bae-bab3-5dc6b15a4b40 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:24.249006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5defbf-3b98-4bae-bab3-5dc6b15a4b40 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:24.249865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-28a3831f-1f1d-4cd7-993c-5b669f93c8d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18adbdfafa674a5ea750808af63d32c9'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:24.261085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfa351-26f9-4951-a1ae-531afcb15fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:24.261774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfa351-26f9-4951-a1ae-531afcb15fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:24.262062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfa351-26f9-4951-a1ae-531afcb15fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:24.262357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfa351-26f9-4951-a1ae-531afcb15fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:24.263077 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfa351-26f9-4951-a1ae-531afcb15fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:24.264337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfa351-26f9-4951-a1ae-531afcb15fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:24.266201 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfa351-26f9-4951-a1ae-531afcb15fa2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:24.274458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:24.276152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-28a3831f-1f1d-4cd7-993c-5b669f93c8d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18adbdfafa674a5ea750808af63d32c9'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:24.277772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-28a3831f-1f1d-4cd7-993c-5b669f93c8d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18adbdfafa674a5ea750808af63d32c9'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:24.285523 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 969/1889] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:35:24.287307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfa351-26f9-4951-a1ae-531afcb15fa2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:24.289563 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0fcfa351-26f9-4951-a1ae-531afcb15fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:24.292924 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:24.309709 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfa351-26f9-4951-a1ae-531afcb15fa2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:24.310252 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-28a3831f-1f1d-4cd7-993c-5b669f93c8d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18adbdfafa674a5ea750808af63d32c9'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:24.311553 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-28a3831f-1f1d-4cd7-993c-5b669f93c8d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18adbdfafa674a5ea750808af63d32c9'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:24.317785 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c088b5d-071a-448a-9d86-0a004c7e3722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:24.318649 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c088b5d-071a-448a-9d86-0a004c7e3722 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:24.318936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c088b5d-071a-448a-9d86-0a004c7e3722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:24.319237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c088b5d-071a-448a-9d86-0a004c7e3722 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:24.320501 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c088b5d-071a-448a-9d86-0a004c7e3722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:24.322788 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c088b5d-071a-448a-9d86-0a004c7e3722 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:24.360606 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 970/1890] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:24 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:24.362608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c088b5d-071a-448a-9d86-0a004c7e3722 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:24.367715 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 921/1891] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:24 2022] DELETE /identity/v3/users/18adbdfafa674a5ea750808af63d32c9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:24.373348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5178e-a27f-47c7-9d61-d3b2c0a1f110 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:24.373648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5178e-a27f-47c7-9d61-d3b2c0a1f110 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:24.373931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5178e-a27f-47c7-9d61-d3b2c0a1f110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:24.401885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-cdf5178e-a27f-47c7-9d61-d3b2c0a1f110 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:24.407192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-cdf5178e-a27f-47c7-9d61-d3b2c0a1f110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:24.484912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c088b5d-071a-448a-9d86-0a004c7e3722 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:24.493578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 922/1892] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:24.518013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5178e-a27f-47c7-9d61-d3b2c0a1f110 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:24.520227 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-cdf5178e-a27f-47c7-9d61-d3b2c0a1f110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:24.677433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a8678-17cb-4275-9566-34116a58a770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:24.678137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8678-17cb-4275-9566-34116a58a770 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:24.678418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8678-17cb-4275-9566-34116a58a770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:24.678696 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8678-17cb-4275-9566-34116a58a770 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:24.679968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a8678-17cb-4275-9566-34116a58a770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:24.685578 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a8678-17cb-4275-9566-34116a58a770 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:24.710172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5178e-a27f-47c7-9d61-d3b2c0a1f110 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:24.715659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5e121-ffb8-4ec1-b01f-ffac005e285a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:24.716537 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5e121-ffb8-4ec1-b01f-ffac005e285a service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:24.716848 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5e121-ffb8-4ec1-b01f-ffac005e285a service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:24.717127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5e121-ffb8-4ec1-b01f-ffac005e285a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:24.730423 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5e121-ffb8-4ec1-b01f-ffac005e285a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:24.732685 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5e121-ffb8-4ec1-b01f-ffac005e285a service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:24.742506 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 971/1893] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:24 2022] POST /identity/v3/users => generated 289 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:24.755691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a8678-17cb-4275-9566-34116a58a770 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:24.765357 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 923/1894] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:24.778215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a8678-17cb-4275-9566-34116a58a770 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:24.796577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3548bd-fe01-4abb-acc7-8eadd93b7f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:24.797278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3548bd-fe01-4abb-acc7-8eadd93b7f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:24.797568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3548bd-fe01-4abb-acc7-8eadd93b7f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:24.797852 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3548bd-fe01-4abb-acc7-8eadd93b7f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:24.798683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3548bd-fe01-4abb-acc7-8eadd93b7f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:24.800634 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3548bd-fe01-4abb-acc7-8eadd93b7f3a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:24.827352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 972/1895] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:24.830763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5e121-ffb8-4ec1-b01f-ffac005e285a service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:24.841981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5e121-ffb8-4ec1-b01f-ffac005e285a service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:24.856201 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2534f-c16b-47f2-bf82-ea237f70d55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:24.857036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2534f-c16b-47f2-bf82-ea237f70d55f admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:24.857402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2534f-c16b-47f2-bf82-ea237f70d55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:24.857689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2534f-c16b-47f2-bf82-ea237f70d55f admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:24.858515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2534f-c16b-47f2-bf82-ea237f70d55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:24.860270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2534f-c16b-47f2-bf82-ea237f70d55f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:24.897807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 924/1896] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:24.902011 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3548bd-fe01-4abb-acc7-8eadd93b7f3a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:24.915876 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3548bd-fe01-4abb-acc7-8eadd93b7f3a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:24.924837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448931f-f516-4184-9499-0ce9a4756e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:24.926006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448931f-f516-4184-9499-0ce9a4756e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:24.926129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448931f-f516-4184-9499-0ce9a4756e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:24.926628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448931f-f516-4184-9499-0ce9a4756e5c admin admin] PATH_INFO: `/v3/projects/c54330d52b9440b78b381ae707d33fb4/users/a4889c3e134a47dab2c5017e1907526e/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:24.961618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448931f-f516-4184-9499-0ce9a4756e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54330d52b9440b78b381ae707d33fb4, user_id=a4889c3e134a47dab2c5017e1907526e, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:24.981942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448931f-f516-4184-9499-0ce9a4756e5c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:25.024713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7cc37-f6c5-4f2f-b1f6-987f0bc1ea53 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:25.025279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7cc37-f6c5-4f2f-b1f6-987f0bc1ea53 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:25.025744 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7cc37-f6c5-4f2f-b1f6-987f0bc1ea53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:25.035122 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 973/1897] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:24 2022] PUT /identity/v3/projects/c54330d52b9440b78b381ae707d33fb4/users/a4889c3e134a47dab2c5017e1907526e/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:25.064595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-cfd7cc37-f6c5-4f2f-b1f6-987f0bc1ea53 None None] MFA Rules not processed for user `a4889c3e134a47dab2c5017e1907526e`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:25.066025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-cfd7cc37-f6c5-4f2f-b1f6-987f0bc1ea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:25.173038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448931f-f516-4184-9499-0ce9a4756e5c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:25.173685 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 925/1898] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:25.230020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:25.265416 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448931f-f516-4184-9499-0ce9a4756e5c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:25.276005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7a238-db57-489b-bde5-d7c6bb95d503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:25.276777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7cc37-f6c5-4f2f-b1f6-987f0bc1ea53 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:25.276884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7a238-db57-489b-bde5-d7c6bb95d503 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:25.277307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7a238-db57-489b-bde5-d7c6bb95d503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:25.277629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7a238-db57-489b-bde5-d7c6bb95d503 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:25.278466 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7a238-db57-489b-bde5-d7c6bb95d503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:25.278584 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-cfd7cc37-f6c5-4f2f-b1f6-987f0bc1ea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:25.281723 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7a238-db57-489b-bde5-d7c6bb95d503 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:25.292135 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:25.305075 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7cc37-f6c5-4f2f-b1f6-987f0bc1ea53 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:25.321774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:25.323108 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:25.323565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:25.324155 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] PATH_INFO: `/v3/projects/06ca4db31826493f874fd8582ea8d2e3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:25.337302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 974/1899] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:25 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:25.337523 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ca4db31826493f874fd8582ea8d2e3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:25.337607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:25.337889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7a238-db57-489b-bde5-d7c6bb95d503 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:25.400631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ca4db31826493f874fd8582ea8d2e3', 'request_id': 'req-65001040-1237-4994-a2f7-9b458b6902c9'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:25.407801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ca4db31826493f874fd8582ea8d2e3', 'request_id': 'req-65001040-1237-4994-a2f7-9b458b6902c9'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:25.414905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ca4db31826493f874fd8582ea8d2e3', 'request_id': 'req-65001040-1237-4994-a2f7-9b458b6902c9'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:25.417773 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7a238-db57-489b-bde5-d7c6bb95d503 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:25.429645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] The token cache is being invalidate because project 06ca4db31826493f874fd8582ea8d2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:25.429938 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:25.430642 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:25.432363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 926/1900] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:25 2022] DELETE /identity/v3/projects/06ca4db31826493f874fd8582ea8d2e3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:25.437239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:25.439236 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:25.488486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb7037-63eb-441e-91d8-ec635b0e75cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:25.489167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb7037-63eb-441e-91d8-ec635b0e75cb admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:25.489451 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb7037-63eb-441e-91d8-ec635b0e75cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:25.489724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb7037-63eb-441e-91d8-ec635b0e75cb admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:25.490420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb7037-63eb-441e-91d8-ec635b0e75cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:25.492433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb7037-63eb-441e-91d8-ec635b0e75cb admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:25.517104 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 975/1901] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:25 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:25.518461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65001040-1237-4994-a2f7-9b458b6902c9 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:25.518613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb7037-63eb-441e-91d8-ec635b0e75cb admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:25.520795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0ffb7037-63eb-441e-91d8-ec635b0e75cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:25.523992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefb715-14ff-4ba2-9291-ffe4220151d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:25.524881 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefb715-14ff-4ba2-9291-ffe4220151d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:25.525170 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefb715-14ff-4ba2-9291-ffe4220151d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:25.525442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefb715-14ff-4ba2-9291-ffe4220151d2 admin admin] PATH_INFO: `/v3/users/48240f09f69642e893bec46247a38608` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:25.526665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefb715-14ff-4ba2-9291-ffe4220151d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48240f09f69642e893bec46247a38608)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:25.528706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefb715-14ff-4ba2-9291-ffe4220151d2 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:25.536008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb7037-63eb-441e-91d8-ec635b0e75cb admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:25.542120 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f976d-f932-4f3e-add3-b4d95a898a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:25.542841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f976d-f932-4f3e-add3-b4d95a898a58 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:25.543086 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f976d-f932-4f3e-add3-b4d95a898a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:25.543359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f976d-f932-4f3e-add3-b4d95a898a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:25.544128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f976d-f932-4f3e-add3-b4d95a898a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:25.545728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f976d-f932-4f3e-add3-b4d95a898a58 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:25.561381 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 976/1902] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:25.563806 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f976d-f932-4f3e-add3-b4d95a898a58 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:25.574025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f976d-f932-4f3e-add3-b4d95a898a58 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:25.579190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517a41-9ac3-4c54-9bd5-6896b4e12288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:25.580114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517a41-9ac3-4c54-9bd5-6896b4e12288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:25.580395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517a41-9ac3-4c54-9bd5-6896b4e12288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:25.580670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517a41-9ac3-4c54-9bd5-6896b4e12288 admin admin] PATH_INFO: `/v3/projects/f1df4497f3834c688eb972daec7d72ad/users/113f2be4fa5547df8e41fe2d257169f1/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:25.581474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4aefb715-14ff-4ba2-9291-ffe4220151d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48240f09f69642e893bec46247a38608'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:25.596777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4aefb715-14ff-4ba2-9291-ffe4220151d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48240f09f69642e893bec46247a38608'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:25.597635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4aefb715-14ff-4ba2-9291-ffe4220151d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48240f09f69642e893bec46247a38608'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:25.597825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d517a41-9ac3-4c54-9bd5-6896b4e12288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1df4497f3834c688eb972daec7d72ad, user_id=113f2be4fa5547df8e41fe2d257169f1, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:25.601728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d517a41-9ac3-4c54-9bd5-6896b4e12288 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:25.606653 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4aefb715-14ff-4ba2-9291-ffe4220151d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48240f09f69642e893bec46247a38608'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:25.607397 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4aefb715-14ff-4ba2-9291-ffe4220151d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48240f09f69642e893bec46247a38608'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:25.616908 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 977/1903] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:25 2022] PUT /identity/v3/projects/f1df4497f3834c688eb972daec7d72ad/users/113f2be4fa5547df8e41fe2d257169f1/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:25.621126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517a41-9ac3-4c54-9bd5-6896b4e12288 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:25.623991 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1d517a41-9ac3-4c54-9bd5-6896b4e12288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:25.624617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 927/1904] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:25 2022] DELETE /identity/v3/users/48240f09f69642e893bec46247a38608 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:25.664426 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:25.712630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517a41-9ac3-4c54-9bd5-6896b4e12288 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:25.793769 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689faa3-c0aa-4e84-a43e-da9ba9061fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:25.795145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689faa3-c0aa-4e84-a43e-da9ba9061fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:25.795621 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689faa3-c0aa-4e84-a43e-da9ba9061fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:25.796624 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689faa3-c0aa-4e84-a43e-da9ba9061fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:25.798144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689faa3-c0aa-4e84-a43e-da9ba9061fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:25.798643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689faa3-c0aa-4e84-a43e-da9ba9061fb6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:25.812403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 978/1905] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:25.817024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefb715-14ff-4ba2-9291-ffe4220151d2 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:25.832106 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefb715-14ff-4ba2-9291-ffe4220151d2 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:25.842331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f722b-c384-448c-89b0-9f76375d5767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:25.844876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f722b-c384-448c-89b0-9f76375d5767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:25.845379 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f722b-c384-448c-89b0-9f76375d5767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:25.845924 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f722b-c384-448c-89b0-9f76375d5767 admin admin] PATH_INFO: `/v3/projects/f1df4497f3834c688eb972daec7d72ad/users/113f2be4fa5547df8e41fe2d257169f1/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:25.853735 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f722b-c384-448c-89b0-9f76375d5767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1df4497f3834c688eb972daec7d72ad, user_id=113f2be4fa5547df8e41fe2d257169f1, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:25.858321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f722b-c384-448c-89b0-9f76375d5767 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:25.861316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:25.878816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 928/1906] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:25 2022] PUT /identity/v3/projects/f1df4497f3834c688eb972daec7d72ad/users/113f2be4fa5547df8e41fe2d257169f1/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:25.893072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e11b7-30b8-4527-b874-a9d150c846e5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:25.893405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e11b7-30b8-4527-b874-a9d150c846e5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:25.893639 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e11b7-30b8-4527-b874-a9d150c846e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:25.950485 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-893e11b7-30b8-4527-b874-a9d150c846e5 None None] MFA Rules not processed for user `113f2be4fa5547df8e41fe2d257169f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:25.951752 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-893e11b7-30b8-4527-b874-a9d150c846e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:26.025105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f722b-c384-448c-89b0-9f76375d5767 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:26.027152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ba0f722b-c384-448c-89b0-9f76375d5767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:26.106457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 979/1907] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:26.117862 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e11b7-30b8-4527-b874-a9d150c846e5 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:26.121370 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-893e11b7-30b8-4527-b874-a9d150c846e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:26.144789 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f722b-c384-448c-89b0-9f76375d5767 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:26.154070 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:26.154974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:26.155254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:26.155592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] PATH_INFO: `/v3/projects/ae77e9afb3bb467db84630c79ff58881` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:26.156855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae77e9afb3bb467db84630c79ff58881)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:26.159052 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:26.204427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e11b7-30b8-4527-b874-a9d150c846e5 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:26.208579 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:26.219715 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae77e9afb3bb467db84630c79ff58881', 'request_id': 'req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:26.226923 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae77e9afb3bb467db84630c79ff58881', 'request_id': 'req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:26.235029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae77e9afb3bb467db84630c79ff58881', 'request_id': 'req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:26.250334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] The token cache is being invalidate because project ae77e9afb3bb467db84630c79ff58881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:26.250560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:26.251092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:26.255544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 929/1908] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:26 2022] DELETE /identity/v3/projects/ae77e9afb3bb467db84630c79ff58881 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:26.256931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:26.259063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:26.260757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd11b9-654f-45c5-83da-6ac828e1743a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:26.261441 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd11b9-654f-45c5-83da-6ac828e1743a service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:26.261684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd11b9-654f-45c5-83da-6ac828e1743a service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:26.261961 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd11b9-654f-45c5-83da-6ac828e1743a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:26.263817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-79fd11b9-654f-45c5-83da-6ac828e1743a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:26.332026 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd11b9-654f-45c5-83da-6ac828e1743a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:26.334240 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd11b9-654f-45c5-83da-6ac828e1743a service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:26.360021 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 980/1909] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:35:26.365101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03602ec4-ed62-491f-92eb-cbab1b5c9fdf admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:26.370573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a5232-3962-4231-bb76-d18c7b6f64d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:26.372223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a5232-3962-4231-bb76-d18c7b6f64d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:26.372511 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a5232-3962-4231-bb76-d18c7b6f64d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:26.372790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a5232-3962-4231-bb76-d18c7b6f64d0 admin admin] PATH_INFO: `/v3/users/337e9e9a33e34c918913dbff2a3cf7b1` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:26.375085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a5232-3962-4231-bb76-d18c7b6f64d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=337e9e9a33e34c918913dbff2a3cf7b1)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:26.377563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a5232-3962-4231-bb76-d18c7b6f64d0 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:26.488778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:26.550186 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ba5a5232-3962-4231-bb76-d18c7b6f64d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337e9e9a33e34c918913dbff2a3cf7b1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:26.584406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ba5a5232-3962-4231-bb76-d18c7b6f64d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337e9e9a33e34c918913dbff2a3cf7b1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:26.586271 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ba5a5232-3962-4231-bb76-d18c7b6f64d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337e9e9a33e34c918913dbff2a3cf7b1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:26.603893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ba5a5232-3962-4231-bb76-d18c7b6f64d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337e9e9a33e34c918913dbff2a3cf7b1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:26.604664 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ba5a5232-3962-4231-bb76-d18c7b6f64d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337e9e9a33e34c918913dbff2a3cf7b1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:26.629153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 930/1910] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:26 2022] DELETE /identity/v3/users/337e9e9a33e34c918913dbff2a3cf7b1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:27.159931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd11b9-654f-45c5-83da-6ac828e1743a service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:27.171913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd11b9-654f-45c5-83da-6ac828e1743a service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:27.244156 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:27.245057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:27.245341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:27.245614 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7 admin admin] PATH_INFO: `/v3/projects/c2670ea6159e468fba557a8510e4fc05` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:27.246852 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2670ea6159e468fba557a8510e4fc05)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:27.249091 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:27.302746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2670ea6159e468fba557a8510e4fc05', 'request_id': 'req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:27.311571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2670ea6159e468fba557a8510e4fc05', 'request_id': 'req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:27.316170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:27.323019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2670ea6159e468fba557a8510e4fc05', 'request_id': 'req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:27.338740 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7 admin admin] The token cache is being invalidate because project c2670ea6159e468fba557a8510e4fc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:27.339659 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:27.340761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9eaaf153-2894-4a31-b7ac-61f2faa8fcf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:27.343162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 981/1911] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:27 2022] DELETE /identity/v3/projects/c2670ea6159e468fba557a8510e4fc05 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:27.349315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80e51a-c26c-444a-98d7-0dc0dabd9499 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:27.349878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80e51a-c26c-444a-98d7-0dc0dabd9499 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:27.349878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80e51a-c26c-444a-98d7-0dc0dabd9499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:27.380746 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ce80e51a-c26c-444a-98d7-0dc0dabd9499 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:27.382270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ce80e51a-c26c-444a-98d7-0dc0dabd9499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:27.475287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 931/1912] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:27.486778 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ed982-29fe-4921-83fc-28e9e4f2bccb None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:27.487074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ed982-29fe-4921-83fc-28e9e4f2bccb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:27.487341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ed982-29fe-4921-83fc-28e9e4f2bccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:27.507711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f14ed982-29fe-4921-83fc-28e9e4f2bccb None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:27.508938 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f14ed982-29fe-4921-83fc-28e9e4f2bccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:27.517388 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 982/1913] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:27.521865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80e51a-c26c-444a-98d7-0dc0dabd9499 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:27.533224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80e51a-c26c-444a-98d7-0dc0dabd9499 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:27.540325 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec646e8a-0abd-4e50-b410-5a9f09dada81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:27.541021 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec646e8a-0abd-4e50-b410-5a9f09dada81 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:27.541305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec646e8a-0abd-4e50-b410-5a9f09dada81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:27.541594 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec646e8a-0abd-4e50-b410-5a9f09dada81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:27.542325 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec646e8a-0abd-4e50-b410-5a9f09dada81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:27.542622 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec646e8a-0abd-4e50-b410-5a9f09dada81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:27.544279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec646e8a-0abd-4e50-b410-5a9f09dada81 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:27.559340 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 932/1914] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:35:27.563692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ed982-29fe-4921-83fc-28e9e4f2bccb None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:27.577404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ed982-29fe-4921-83fc-28e9e4f2bccb None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:27.587105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37d8ce-66a3-4d84-a94e-a7b3da6c7633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:27.587105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37d8ce-66a3-4d84-a94e-a7b3da6c7633 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:27.587105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37d8ce-66a3-4d84-a94e-a7b3da6c7633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:27.587105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37d8ce-66a3-4d84-a94e-a7b3da6c7633 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:27.587457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37d8ce-66a3-4d84-a94e-a7b3da6c7633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:27.587457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37d8ce-66a3-4d84-a94e-a7b3da6c7633 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:27.614517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 983/1915] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:27 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:27.619035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec646e8a-0abd-4e50-b410-5a9f09dada81 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:27.629781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec646e8a-0abd-4e50-b410-5a9f09dada81 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:27.701004 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58a800-46f8-4112-b361-3341eaf08208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:27.702062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a800-46f8-4112-b361-3341eaf08208 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:27.702308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a800-46f8-4112-b361-3341eaf08208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:27.702632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a800-46f8-4112-b361-3341eaf08208 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:27.703291 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58a800-46f8-4112-b361-3341eaf08208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:27.705245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58a800-46f8-4112-b361-3341eaf08208 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:27.727088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 933/1916] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:27 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:27.731194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37d8ce-66a3-4d84-a94e-a7b3da6c7633 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:27.742245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37d8ce-66a3-4d84-a94e-a7b3da6c7633 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:27.747041 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8c787-21ee-4c97-85ea-7d0362f3c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:27.747738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8c787-21ee-4c97-85ea-7d0362f3c113 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:27.748023 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8c787-21ee-4c97-85ea-7d0362f3c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:27.748296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8c787-21ee-4c97-85ea-7d0362f3c113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:27.749016 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8c787-21ee-4c97-85ea-7d0362f3c113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:27.750880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8c787-21ee-4c97-85ea-7d0362f3c113 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:27.761700 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 984/1917] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:27.765349 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58a800-46f8-4112-b361-3341eaf08208 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:27.776038 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58a800-46f8-4112-b361-3341eaf08208 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:27.780808 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb889d-e5eb-4639-b0c5-5d6c6b2d1fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:27.781465 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb889d-e5eb-4639-b0c5-5d6c6b2d1fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:27.781746 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb889d-e5eb-4639-b0c5-5d6c6b2d1fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:27.782023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb889d-e5eb-4639-b0c5-5d6c6b2d1fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:27.782750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb889d-e5eb-4639-b0c5-5d6c6b2d1fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:27.784381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb889d-e5eb-4639-b0c5-5d6c6b2d1fa3 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:27.795296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 934/1918] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:27.799591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8c787-21ee-4c97-85ea-7d0362f3c113 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:27.809572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8c787-21ee-4c97-85ea-7d0362f3c113 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:27.814219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae698fae-d007-4a1f-82e7-7997cf43361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:27.815092 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae698fae-d007-4a1f-82e7-7997cf43361d admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:27.815377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae698fae-d007-4a1f-82e7-7997cf43361d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:27.815677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae698fae-d007-4a1f-82e7-7997cf43361d admin admin] PATH_INFO: `/v3/projects/66b6a73f87d14652b9c632588546d2c1/users/1e480e465c21438fb471bb43e0e3f39d/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:27.830922 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae698fae-d007-4a1f-82e7-7997cf43361d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b6a73f87d14652b9c632588546d2c1, user_id=1e480e465c21438fb471bb43e0e3f39d, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:27.833584 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae698fae-d007-4a1f-82e7-7997cf43361d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:27.848198 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 985/1919] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:27 2022] PUT /identity/v3/projects/66b6a73f87d14652b9c632588546d2c1/users/1e480e465c21438fb471bb43e0e3f39d/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:27.860156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5fca3-85b0-4bfc-98d0-9842b1c06b8a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:27.860448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5fca3-85b0-4bfc-98d0-9842b1c06b8a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:27.860725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5fca3-85b0-4bfc-98d0-9842b1c06b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:27.879922 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:27.890348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-f7f5fca3-85b0-4bfc-98d0-9842b1c06b8a None None] MFA Rules not processed for user `1e480e465c21438fb471bb43e0e3f39d`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:27.891636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f7f5fca3-85b0-4bfc-98d0-9842b1c06b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:27.957001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 935/1920] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:27.963089 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae698fae-d007-4a1f-82e7-7997cf43361d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:28.036073 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae698fae-d007-4a1f-82e7-7997cf43361d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:28.040898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0320e-fb39-4a71-a0c0-15320fed0912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:28.041688 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0320e-fb39-4a71-a0c0-15320fed0912 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:28.042088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0320e-fb39-4a71-a0c0-15320fed0912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:28.042348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0320e-fb39-4a71-a0c0-15320fed0912 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:28.043370 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0320e-fb39-4a71-a0c0-15320fed0912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:28.045018 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0320e-fb39-4a71-a0c0-15320fed0912 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:28.061087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5fca3-85b0-4bfc-98d0-9842b1c06b8a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:28.062612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f7f5fca3-85b0-4bfc-98d0-9842b1c06b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:28.078674 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 986/1921] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:27 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:28.080374 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0320e-fb39-4a71-a0c0-15320fed0912 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:28.144105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5fca3-85b0-4bfc-98d0-9842b1c06b8a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:28.156637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0320e-fb39-4a71-a0c0-15320fed0912 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:28.163001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eef078-7ce1-4b14-b966-e855569eb46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:28.164038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eef078-7ce1-4b14-b966-e855569eb46d admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:28.164518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eef078-7ce1-4b14-b966-e855569eb46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:28.164949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eef078-7ce1-4b14-b966-e855569eb46d admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:28.165651 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eef078-7ce1-4b14-b966-e855569eb46d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:28.167619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eef078-7ce1-4b14-b966-e855569eb46d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:28.191642 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 987/1922] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:28 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:28.196007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eef078-7ce1-4b14-b966-e855569eb46d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:28.211994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47366aec-0b1b-4144-8d03-003ff08443e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:28.212731 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47366aec-0b1b-4144-8d03-003ff08443e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:28.213174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47366aec-0b1b-4144-8d03-003ff08443e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:28.213413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47366aec-0b1b-4144-8d03-003ff08443e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:28.215450 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-47366aec-0b1b-4144-8d03-003ff08443e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:28.223925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:28.230450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eef078-7ce1-4b14-b966-e855569eb46d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:28.237486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dc266-4add-4c48-b9b0-092e551a3fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:28.238094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dc266-4add-4c48-b9b0-092e551a3fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:28.238527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dc266-4add-4c48-b9b0-092e551a3fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:28.238814 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dc266-4add-4c48-b9b0-092e551a3fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:28.240000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dc266-4add-4c48-b9b0-092e551a3fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:28.241968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dc266-4add-4c48-b9b0-092e551a3fa7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:28.257760 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 988/1923] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:28.262566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dc266-4add-4c48-b9b0-092e551a3fa7 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:28.278939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dc266-4add-4c48-b9b0-092e551a3fa7 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:28.287057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9999c7-e905-4239-af9e-ec3a819e1a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:28.288262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9999c7-e905-4239-af9e-ec3a819e1a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:28.288755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9999c7-e905-4239-af9e-ec3a819e1a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:28.288959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9999c7-e905-4239-af9e-ec3a819e1a86 admin admin] PATH_INFO: `/v3/projects/72da0b5c506141beaf344be8fecc82da/users/033b231424f04e268f6a27dfd6c2c6f4/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:28.301309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47366aec-0b1b-4144-8d03-003ff08443e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:28.302888 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47366aec-0b1b-4144-8d03-003ff08443e2 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:28.307404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9999c7-e905-4239-af9e-ec3a819e1a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72da0b5c506141beaf344be8fecc82da, user_id=033b231424f04e268f6a27dfd6c2c6f4, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:28.313867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9999c7-e905-4239-af9e-ec3a819e1a86 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:28.315657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 936/1924] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:35:28.331148 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 989/1925] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:28 2022] PUT /identity/v3/projects/72da0b5c506141beaf344be8fecc82da/users/033b231424f04e268f6a27dfd6c2c6f4/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:28.335169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47366aec-0b1b-4144-8d03-003ff08443e2 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:28.342703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:28.347366 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47366aec-0b1b-4144-8d03-003ff08443e2 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:28.443498 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508d48e-e4a7-4b5b-987b-c91d04e5009d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:28.444455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508d48e-e4a7-4b5b-987b-c91d04e5009d admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:28.445329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508d48e-e4a7-4b5b-987b-c91d04e5009d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:28.445671 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508d48e-e4a7-4b5b-987b-c91d04e5009d admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:28.446489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508d48e-e4a7-4b5b-987b-c91d04e5009d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:28.448810 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508d48e-e4a7-4b5b-987b-c91d04e5009d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:28.463524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 937/1926] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:28.469792 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9999c7-e905-4239-af9e-ec3a819e1a86 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:28.482126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9999c7-e905-4239-af9e-ec3a819e1a86 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:28.487082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135cabe-e716-432a-a918-6dfc02728a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:28.488156 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135cabe-e716-432a-a918-6dfc02728a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:28.488458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135cabe-e716-432a-a918-6dfc02728a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:28.488831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135cabe-e716-432a-a918-6dfc02728a9e admin admin] PATH_INFO: `/v3/projects/72da0b5c506141beaf344be8fecc82da/users/033b231424f04e268f6a27dfd6c2c6f4/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:28.491009 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135cabe-e716-432a-a918-6dfc02728a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=72da0b5c506141beaf344be8fecc82da, user_id=033b231424f04e268f6a27dfd6c2c6f4, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:28.495770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135cabe-e716-432a-a918-6dfc02728a9e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:28.512442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 990/1927] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:28 2022] PUT /identity/v3/projects/72da0b5c506141beaf344be8fecc82da/users/033b231424f04e268f6a27dfd6c2c6f4/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:28.523875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5915290-032d-49a9-b2e4-503de5774d53 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:28.524355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5915290-032d-49a9-b2e4-503de5774d53 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:28.524777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5915290-032d-49a9-b2e4-503de5774d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:28.560866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-e5915290-032d-49a9-b2e4-503de5774d53 None None] MFA Rules not processed for user `033b231424f04e268f6a27dfd6c2c6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:28.562432 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-e5915290-032d-49a9-b2e4-503de5774d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:28.713983 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 938/1928] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:28.727035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135cabe-e716-432a-a918-6dfc02728a9e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:28.812858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135cabe-e716-432a-a918-6dfc02728a9e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:28.825161 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b09281-f31f-4cb2-bafd-c3df061ac79b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:28.825925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b09281-f31f-4cb2-bafd-c3df061ac79b service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:28.826250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b09281-f31f-4cb2-bafd-c3df061ac79b service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:28.826633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b09281-f31f-4cb2-bafd-c3df061ac79b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:28.839713 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b09281-f31f-4cb2-bafd-c3df061ac79b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:28.841308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b09281-f31f-4cb2-bafd-c3df061ac79b service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:28.853591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 991/1929] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:29.329133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5915290-032d-49a9-b2e4-503de5774d53 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:29.473306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5915290-032d-49a9-b2e4-503de5774d53 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:29.479429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c3ab3-bf2d-444f-9060-d168b0f5adce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:29.480380 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3ab3-bf2d-444f-9060-d168b0f5adce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:29.480666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3ab3-bf2d-444f-9060-d168b0f5adce admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:29.480979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3ab3-bf2d-444f-9060-d168b0f5adce admin admin] PATH_INFO: `/v3/users/1e480e465c21438fb471bb43e0e3f39d` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:29.483652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c3ab3-bf2d-444f-9060-d168b0f5adce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e480e465c21438fb471bb43e0e3f39d)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:29.484537 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c3ab3-bf2d-444f-9060-d168b0f5adce admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:29.532748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:29.554584 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-631c3ab3-bf2d-444f-9060-d168b0f5adce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e480e465c21438fb471bb43e0e3f39d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:29.566752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-631c3ab3-bf2d-444f-9060-d168b0f5adce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e480e465c21438fb471bb43e0e3f39d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:29.567682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-631c3ab3-bf2d-444f-9060-d168b0f5adce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e480e465c21438fb471bb43e0e3f39d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:29.576506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-631c3ab3-bf2d-444f-9060-d168b0f5adce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e480e465c21438fb471bb43e0e3f39d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:29.577442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-631c3ab3-bf2d-444f-9060-d168b0f5adce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e480e465c21438fb471bb43e0e3f39d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:29.598015 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 939/1930] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:29 2022] DELETE /identity/v3/users/1e480e465c21438fb471bb43e0e3f39d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:29.602363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadd446-14aa-4f6f-8da8-74876b7fa2f6 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:29.602861 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadd446-14aa-4f6f-8da8-74876b7fa2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:29.602957 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadd446-14aa-4f6f-8da8-74876b7fa2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:29.621946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-fdadd446-14aa-4f6f-8da8-74876b7fa2f6 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:29.623278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fdadd446-14aa-4f6f-8da8-74876b7fa2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:29.699033 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 992/1931] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:29.709123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c3ab3-bf2d-444f-9060-d168b0f5adce admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:29.711137 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-631c3ab3-bf2d-444f-9060-d168b0f5adce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:29.779513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c3ab3-bf2d-444f-9060-d168b0f5adce admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:29.783623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c98db2-c480-4682-a7bc-1597060699fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:29.784677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c98db2-c480-4682-a7bc-1597060699fb service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:29.784677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c98db2-c480-4682-a7bc-1597060699fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:29.784957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c98db2-c480-4682-a7bc-1597060699fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:29.796759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c98db2-c480-4682-a7bc-1597060699fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:29.799186 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c98db2-c480-4682-a7bc-1597060699fb service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:29.813838 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 940/1932] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:30.499132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadd446-14aa-4f6f-8da8-74876b7fa2f6 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:30.501008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fdadd446-14aa-4f6f-8da8-74876b7fa2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:30.524653 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadd446-14aa-4f6f-8da8-74876b7fa2f6 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:30.546366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:30.547122 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:30.551970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:30.551970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] PATH_INFO: `/v3/projects/66b6a73f87d14652b9c632588546d2c1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:30.554794 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b6a73f87d14652b9c632588546d2c1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:30.556793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:30.638034 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b6a73f87d14652b9c632588546d2c1', 'request_id': 'req-21d05a87-aad7-4789-9e3a-477d6be0028c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:30.640633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:30.651774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b6a73f87d14652b9c632588546d2c1', 'request_id': 'req-21d05a87-aad7-4789-9e3a-477d6be0028c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:30.674142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b6a73f87d14652b9c632588546d2c1', 'request_id': 'req-21d05a87-aad7-4789-9e3a-477d6be0028c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:30.762752 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] The token cache is being invalidate because project 66b6a73f87d14652b9c632588546d2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:30.763091 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:30.765085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:30.769930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 993/1933] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:30 2022] DELETE /identity/v3/projects/66b6a73f87d14652b9c632588546d2c1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:30.776349 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c98db2-c480-4682-a7bc-1597060699fb service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:30.786525 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c98db2-c480-4682-a7bc-1597060699fb service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:30.947428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef38de-8062-4033-aa1c-c44cffef79b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:30.948623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef38de-8062-4033-aa1c-c44cffef79b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:30.949200 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef38de-8062-4033-aa1c-c44cffef79b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:30.949634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef38de-8062-4033-aa1c-c44cffef79b9 admin admin] PATH_INFO: `/v3/users/033b231424f04e268f6a27dfd6c2c6f4` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:30.951665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef38de-8062-4033-aa1c-c44cffef79b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=033b231424f04e268f6a27dfd6c2c6f4)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:30.955797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef38de-8062-4033-aa1c-c44cffef79b9 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:31.073172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-abef38de-8062-4033-aa1c-c44cffef79b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '033b231424f04e268f6a27dfd6c2c6f4'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:31.077349 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:31.104093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-abef38de-8062-4033-aa1c-c44cffef79b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '033b231424f04e268f6a27dfd6c2c6f4'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:31.107791 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-abef38de-8062-4033-aa1c-c44cffef79b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '033b231424f04e268f6a27dfd6c2c6f4'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:31.119392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-abef38de-8062-4033-aa1c-c44cffef79b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '033b231424f04e268f6a27dfd6c2c6f4'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:31.120694 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-abef38de-8062-4033-aa1c-c44cffef79b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '033b231424f04e268f6a27dfd6c2c6f4'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:31.152554 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 941/1934] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:30 2022] DELETE /identity/v3/users/033b231424f04e268f6a27dfd6c2c6f4 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:31.818647 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:31.820284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:31.854560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d05a87-aad7-4789-9e3a-477d6be0028c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:31.931325 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee8ee3-10af-4c65-8644-af0d3121b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:31.932284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8ee3-10af-4c65-8644-af0d3121b233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:31.932567 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8ee3-10af-4c65-8644-af0d3121b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:31.932847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8ee3-10af-4c65-8644-af0d3121b233 admin admin] PATH_INFO: `/v3/projects/72da0b5c506141beaf344be8fecc82da` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:31.934313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee8ee3-10af-4c65-8644-af0d3121b233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72da0b5c506141beaf344be8fecc82da)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:31.936458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee8ee3-10af-4c65-8644-af0d3121b233 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:31.986893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-caee8ee3-10af-4c65-8644-af0d3121b233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72da0b5c506141beaf344be8fecc82da', 'request_id': 'req-caee8ee3-10af-4c65-8644-af0d3121b233'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:31.992960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-caee8ee3-10af-4c65-8644-af0d3121b233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72da0b5c506141beaf344be8fecc82da', 'request_id': 'req-caee8ee3-10af-4c65-8644-af0d3121b233'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:32.001181 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-caee8ee3-10af-4c65-8644-af0d3121b233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72da0b5c506141beaf344be8fecc82da', 'request_id': 'req-caee8ee3-10af-4c65-8644-af0d3121b233'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:32.013733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-caee8ee3-10af-4c65-8644-af0d3121b233 admin admin] The token cache is being invalidate because project 72da0b5c506141beaf344be8fecc82da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:32.014098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-caee8ee3-10af-4c65-8644-af0d3121b233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:32.014786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-caee8ee3-10af-4c65-8644-af0d3121b233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:32.016400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 994/1935] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:31 2022] DELETE /identity/v3/projects/72da0b5c506141beaf344be8fecc82da => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:32.021772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dda5cf-203c-4e6f-b4a7-5adce1e693de None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.022254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dda5cf-203c-4e6f-b4a7-5adce1e693de None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.022370 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dda5cf-203c-4e6f-b4a7-5adce1e693de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:32.040542 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-d6dda5cf-203c-4e6f-b4a7-5adce1e693de None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:32.041977 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d6dda5cf-203c-4e6f-b4a7-5adce1e693de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:32.112763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 942/1936] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:32.120620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7423e-d052-468c-9410-0182845db186 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.120912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7423e-d052-468c-9410-0182845db186 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.121224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7423e-d052-468c-9410-0182845db186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:32.140202 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-02f7423e-d052-468c-9410-0182845db186 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:32.141439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-02f7423e-d052-468c-9410-0182845db186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:32.150470 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 995/1937] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:32.154897 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dda5cf-203c-4e6f-b4a7-5adce1e693de None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:32.165710 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dda5cf-203c-4e6f-b4a7-5adce1e693de None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:32.170370 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1366eff-d15e-4ca0-8964-57cb9bd1fc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:32.171030 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1366eff-d15e-4ca0-8964-57cb9bd1fc0e admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.171313 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1366eff-d15e-4ca0-8964-57cb9bd1fc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.171620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1366eff-d15e-4ca0-8964-57cb9bd1fc0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:32.172343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1366eff-d15e-4ca0-8964-57cb9bd1fc0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:32.172649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1366eff-d15e-4ca0-8964-57cb9bd1fc0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:32.174536 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1366eff-d15e-4ca0-8964-57cb9bd1fc0e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:32.186593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 943/1938] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:32.190929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7423e-d052-468c-9410-0182845db186 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:32.200214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7423e-d052-468c-9410-0182845db186 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:32.204942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cf395-88a6-421e-9840-c56da2a2624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:32.205599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cf395-88a6-421e-9840-c56da2a2624d admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.205886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cf395-88a6-421e-9840-c56da2a2624d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.206174 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cf395-88a6-421e-9840-c56da2a2624d admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:32.206854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cf395-88a6-421e-9840-c56da2a2624d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:32.208786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cf395-88a6-421e-9840-c56da2a2624d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:32.235748 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 996/1939] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:32 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:32.239810 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1366eff-d15e-4ca0-8964-57cb9bd1fc0e admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:32.250284 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1366eff-d15e-4ca0-8964-57cb9bd1fc0e admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:32.308823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007c4af-7e0e-42cf-89ce-bb7988b33285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:32.309498 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007c4af-7e0e-42cf-89ce-bb7988b33285 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.309869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007c4af-7e0e-42cf-89ce-bb7988b33285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.310148 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007c4af-7e0e-42cf-89ce-bb7988b33285 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:32.310899 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007c4af-7e0e-42cf-89ce-bb7988b33285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:32.312821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007c4af-7e0e-42cf-89ce-bb7988b33285 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:32.333811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 944/1940] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:32 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:32.338391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cf395-88a6-421e-9840-c56da2a2624d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:32.349525 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cf395-88a6-421e-9840-c56da2a2624d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:32.354798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe1ba3-d8dc-4b19-9bd2-8df1dd3f0435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:32.355490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe1ba3-d8dc-4b19-9bd2-8df1dd3f0435 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.355786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe1ba3-d8dc-4b19-9bd2-8df1dd3f0435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.356065 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe1ba3-d8dc-4b19-9bd2-8df1dd3f0435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:32.356796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe1ba3-d8dc-4b19-9bd2-8df1dd3f0435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:32.358402 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe1ba3-d8dc-4b19-9bd2-8df1dd3f0435 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:32.369151 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 997/1941] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:32.373321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007c4af-7e0e-42cf-89ce-bb7988b33285 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:32.384751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007c4af-7e0e-42cf-89ce-bb7988b33285 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:32.390077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2254bf-470b-4c2e-b275-26b6de4c723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:32.390754 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2254bf-470b-4c2e-b275-26b6de4c723c admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.391042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2254bf-470b-4c2e-b275-26b6de4c723c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.391321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2254bf-470b-4c2e-b275-26b6de4c723c admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:32.392089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2254bf-470b-4c2e-b275-26b6de4c723c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:32.393708 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2254bf-470b-4c2e-b275-26b6de4c723c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:32.404678 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 945/1942] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:32.408896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe1ba3-d8dc-4b19-9bd2-8df1dd3f0435 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:32.419664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe1ba3-d8dc-4b19-9bd2-8df1dd3f0435 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:32.424517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5b7c7-c5da-4ddc-ae6a-c58ec66dcead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:32.425400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5b7c7-c5da-4ddc-ae6a-c58ec66dcead admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.425674 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5b7c7-c5da-4ddc-ae6a-c58ec66dcead admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.425943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5b7c7-c5da-4ddc-ae6a-c58ec66dcead admin admin] PATH_INFO: `/v3/projects/78f3fa926d764ec08e7c2d2d05605f0b/users/7b8ea379d1314498b10b94e7f2f8d6b8/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:32.440585 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5b7c7-c5da-4ddc-ae6a-c58ec66dcead admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f3fa926d764ec08e7c2d2d05605f0b, user_id=7b8ea379d1314498b10b94e7f2f8d6b8, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:32.443261 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5b7c7-c5da-4ddc-ae6a-c58ec66dcead admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:32.462104 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 998/1943] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:32 2022] PUT /identity/v3/projects/78f3fa926d764ec08e7c2d2d05605f0b/users/7b8ea379d1314498b10b94e7f2f8d6b8/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:32.476890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3495-33be-42d2-b920-261b83f80e9d None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.477185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3495-33be-42d2-b920-261b83f80e9d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.477450 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3495-33be-42d2-b920-261b83f80e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:32.505920 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-351d3495-33be-42d2-b920-261b83f80e9d None None] MFA Rules not processed for user `7b8ea379d1314498b10b94e7f2f8d6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:32.507611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-351d3495-33be-42d2-b920-261b83f80e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:32.528560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:32.579860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 946/1944] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:32.584176 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5b7c7-c5da-4ddc-ae6a-c58ec66dcead admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:32.597156 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:32.674948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5b7c7-c5da-4ddc-ae6a-c58ec66dcead admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:32.680343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad231e1b-a124-462e-a673-dd30a18072b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:32.681281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad231e1b-a124-462e-a673-dd30a18072b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.681786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad231e1b-a124-462e-a673-dd30a18072b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.682233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad231e1b-a124-462e-a673-dd30a18072b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:32.683114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad231e1b-a124-462e-a673-dd30a18072b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:32.685495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad231e1b-a124-462e-a673-dd30a18072b3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:32.720389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d3495-33be-42d2-b920-261b83f80e9d None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:32.722002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-351d3495-33be-42d2-b920-261b83f80e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:32.726126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 999/1945] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:32 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:32.730297 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad231e1b-a124-462e-a673-dd30a18072b3 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:32.741339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d3495-33be-42d2-b920-261b83f80e9d None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:32.828791 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6b7e1-438c-4ff8-bcac-eb7672fc4d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:32.830066 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b7e1-438c-4ff8-bcac-eb7672fc4d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.830420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b7e1-438c-4ff8-bcac-eb7672fc4d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.830705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b7e1-438c-4ff8-bcac-eb7672fc4d3c admin admin] PATH_INFO: `/v3/users/a4889c3e134a47dab2c5017e1907526e` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:32.832283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6b7e1-438c-4ff8-bcac-eb7672fc4d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4889c3e134a47dab2c5017e1907526e)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:32.834396 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6b7e1-438c-4ff8-bcac-eb7672fc4d3c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:32.842432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad231e1b-a124-462e-a673-dd30a18072b3 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:32.848868 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93ec64-cf35-43b7-92ad-fa5b9f786000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:32.849979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93ec64-cf35-43b7-92ad-fa5b9f786000 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.850502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93ec64-cf35-43b7-92ad-fa5b9f786000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.851134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93ec64-cf35-43b7-92ad-fa5b9f786000 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:32.852099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93ec64-cf35-43b7-92ad-fa5b9f786000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:32.854412 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93ec64-cf35-43b7-92ad-fa5b9f786000 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:32.882891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1000/1946] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:32 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:32.887991 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93ec64-cf35-43b7-92ad-fa5b9f786000 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:32.906918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c4b6b7e1-438c-4ff8-bcac-eb7672fc4d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4889c3e134a47dab2c5017e1907526e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:32.907368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93ec64-cf35-43b7-92ad-fa5b9f786000 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:32.914490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb81d8e-57f5-4495-a39f-bc7d9b1857a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:32.915711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb81d8e-57f5-4495-a39f-bc7d9b1857a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.916334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb81d8e-57f5-4495-a39f-bc7d9b1857a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.917038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb81d8e-57f5-4495-a39f-bc7d9b1857a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:32.917932 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb81d8e-57f5-4495-a39f-bc7d9b1857a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:32.920275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb81d8e-57f5-4495-a39f-bc7d9b1857a5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:32.932126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c4b6b7e1-438c-4ff8-bcac-eb7672fc4d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4889c3e134a47dab2c5017e1907526e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:32.933957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c4b6b7e1-438c-4ff8-bcac-eb7672fc4d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4889c3e134a47dab2c5017e1907526e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:32.935365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1001/1947] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:32.940262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb81d8e-57f5-4495-a39f-bc7d9b1857a5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:32.943546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1cb81d8e-57f5-4495-a39f-bc7d9b1857a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:32.948389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c4b6b7e1-438c-4ff8-bcac-eb7672fc4d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4889c3e134a47dab2c5017e1907526e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:32.949390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c4b6b7e1-438c-4ff8-bcac-eb7672fc4d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4889c3e134a47dab2c5017e1907526e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:32.960215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb81d8e-57f5-4495-a39f-bc7d9b1857a5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:32.965452 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0b38e-6df4-4ed9-8208-d05c11991a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:32.966409 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0b38e-6df4-4ed9-8208-d05c11991a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.966692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0b38e-6df4-4ed9-8208-d05c11991a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.966967 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0b38e-6df4-4ed9-8208-d05c11991a39 admin admin] PATH_INFO: `/v3/projects/b8924794cde24906a8782d417eba9959/users/acd44916e4e240db9456d527f87d9aa0/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:32.973065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 947/1948] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:32 2022] DELETE /identity/v3/users/a4889c3e134a47dab2c5017e1907526e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:32.985352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddcee3-2fe5-4e42-aa79-0622ea4580ac None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:32.985750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddcee3-2fe5-4e42-aa79-0622ea4580ac None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:32.985917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddcee3-2fe5-4e42-aa79-0622ea4580ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:33.008264 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-52ddcee3-2fe5-4e42-aa79-0622ea4580ac None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:33.009741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-52ddcee3-2fe5-4e42-aa79-0622ea4580ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:33.010472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0b38e-6df4-4ed9-8208-d05c11991a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8924794cde24906a8782d417eba9959, user_id=acd44916e4e240db9456d527f87d9aa0, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:33.016759 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0b38e-6df4-4ed9-8208-d05c11991a39 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:33.047969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1002/1949] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:32 2022] PUT /identity/v3/projects/b8924794cde24906a8782d417eba9959/users/acd44916e4e240db9456d527f87d9aa0/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:33.049375 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0b38e-6df4-4ed9-8208-d05c11991a39 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:33.068280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:33.124368 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 948/1950] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:33.136200 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddcee3-2fe5-4e42-aa79-0622ea4580ac None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:33.143375 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-52ddcee3-2fe5-4e42-aa79-0622ea4580ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:33.154198 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:33.177144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0b38e-6df4-4ed9-8208-d05c11991a39 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:33.184796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df24c-a6b5-43f4-92d1-bfc7cc60fd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:33.185540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df24c-a6b5-43f4-92d1-bfc7cc60fd72 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:33.185889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df24c-a6b5-43f4-92d1-bfc7cc60fd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:33.186228 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76df24c-a6b5-43f4-92d1-bfc7cc60fd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:33.187040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76df24c-a6b5-43f4-92d1-bfc7cc60fd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:33.189099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76df24c-a6b5-43f4-92d1-bfc7cc60fd72 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:33.212351 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1003/1951] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:33.213499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df24c-a6b5-43f4-92d1-bfc7cc60fd72 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:33.232706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76df24c-a6b5-43f4-92d1-bfc7cc60fd72 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:33.237546 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddcee3-2fe5-4e42-aa79-0622ea4580ac None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:33.239811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3129d3-b0df-4ba3-8e4b-a393601e33e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:33.241293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3129d3-b0df-4ba3-8e4b-a393601e33e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:33.242399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3129d3-b0df-4ba3-8e4b-a393601e33e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:33.242832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3129d3-b0df-4ba3-8e4b-a393601e33e9 admin admin] PATH_INFO: `/v3/projects/b8924794cde24906a8782d417eba9959/users/acd44916e4e240db9456d527f87d9aa0/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:33.248099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3129d3-b0df-4ba3-8e4b-a393601e33e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8924794cde24906a8782d417eba9959, user_id=acd44916e4e240db9456d527f87d9aa0, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:33.253964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3129d3-b0df-4ba3-8e4b-a393601e33e9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:33.272556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1004/1952] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:33 2022] PUT /identity/v3/projects/b8924794cde24906a8782d417eba9959/users/acd44916e4e240db9456d527f87d9aa0/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:33.289836 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246ae42-6f40-46a9-8162-3b7ffaebceea None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:33.290118 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246ae42-6f40-46a9-8162-3b7ffaebceea None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:33.290392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246ae42-6f40-46a9-8162-3b7ffaebceea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:33.321954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59511643-6eb7-4c15-b946-429a14ba0a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:33.322756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511643-6eb7-4c15-b946-429a14ba0a86 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:33.323092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511643-6eb7-4c15-b946-429a14ba0a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:33.323456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59511643-6eb7-4c15-b946-429a14ba0a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:33.334744 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59511643-6eb7-4c15-b946-429a14ba0a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:33.336532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59511643-6eb7-4c15-b946-429a14ba0a86 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:33.338829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8246ae42-6f40-46a9-8162-3b7ffaebceea None None] MFA Rules not processed for user `acd44916e4e240db9456d527f87d9aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:33.340248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8246ae42-6f40-46a9-8162-3b7ffaebceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:33.353376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 949/1953] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:35:33.490705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1005/1954] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:33.504989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59511643-6eb7-4c15-b946-429a14ba0a86 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:33.506802 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-59511643-6eb7-4c15-b946-429a14ba0a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:33.573981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59511643-6eb7-4c15-b946-429a14ba0a86 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:33.624376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81338e64-00d5-4702-beae-47dae2939cce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:33.625764 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338e64-00d5-4702-beae-47dae2939cce service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:33.626049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338e64-00d5-4702-beae-47dae2939cce service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:33.626330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81338e64-00d5-4702-beae-47dae2939cce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:33.635696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81338e64-00d5-4702-beae-47dae2939cce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:33.637128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81338e64-00d5-4702-beae-47dae2939cce service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:33.642216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:33.649190 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 950/1955] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:33.675248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246ae42-6f40-46a9-8162-3b7ffaebceea None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:33.680263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8246ae42-6f40-46a9-8162-3b7ffaebceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:33.764526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81338e64-00d5-4702-beae-47dae2939cce service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:33.765955 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-81338e64-00d5-4702-beae-47dae2939cce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:33.770412 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246ae42-6f40-46a9-8162-3b7ffaebceea None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:33.777069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:33.778158 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:33.778518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:33.778871 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] PATH_INFO: `/v3/projects/c54330d52b9440b78b381ae707d33fb4` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:33.779238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81338e64-00d5-4702-beae-47dae2939cce service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:33.780300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54330d52b9440b78b381ae707d33fb4)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:33.782295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:33.784023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6523f08-6e72-4070-a3a7-6433a80fe41b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:33.784846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6523f08-6e72-4070-a3a7-6433a80fe41b service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:33.785130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6523f08-6e72-4070-a3a7-6433a80fe41b service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:33.785407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6523f08-6e72-4070-a3a7-6433a80fe41b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:33.796935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c6523f08-6e72-4070-a3a7-6433a80fe41b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:33.834445 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54330d52b9440b78b381ae707d33fb4', 'request_id': 'req-bce46f20-8a36-4995-af3b-3a028db1a519'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:33.841393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54330d52b9440b78b381ae707d33fb4', 'request_id': 'req-bce46f20-8a36-4995-af3b-3a028db1a519'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:33.843422 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:33.851254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54330d52b9440b78b381ae707d33fb4', 'request_id': 'req-bce46f20-8a36-4995-af3b-3a028db1a519'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:33.865074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] The token cache is being invalidate because project c54330d52b9440b78b381ae707d33fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:33.865608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:33.866366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:33.868307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1006/1956] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:33 2022] DELETE /identity/v3/projects/c54330d52b9440b78b381ae707d33fb4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:33.869977 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6523f08-6e72-4070-a3a7-6433a80fe41b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:33.871551 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6523f08-6e72-4070-a3a7-6433a80fe41b service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:33.872937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:33.874366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:33.881714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 951/1957] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:33.958941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce46f20-8a36-4995-af3b-3a028db1a519 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:33.966641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b9c27-4157-4033-b60a-e55fd3674d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:33.967691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b9c27-4157-4033-b60a-e55fd3674d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:33.967936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b9c27-4157-4033-b60a-e55fd3674d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:33.968201 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b9c27-4157-4033-b60a-e55fd3674d9a admin admin] PATH_INFO: `/v3/users/113f2be4fa5547df8e41fe2d257169f1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:33.969823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b9c27-4157-4033-b60a-e55fd3674d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=113f2be4fa5547df8e41fe2d257169f1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:33.971955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b9c27-4157-4033-b60a-e55fd3674d9a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:34.071560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1f6b9c27-4157-4033-b60a-e55fd3674d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113f2be4fa5547df8e41fe2d257169f1'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.104390 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1f6b9c27-4157-4033-b60a-e55fd3674d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113f2be4fa5547df8e41fe2d257169f1'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.105259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1f6b9c27-4157-4033-b60a-e55fd3674d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113f2be4fa5547df8e41fe2d257169f1'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.122218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1f6b9c27-4157-4033-b60a-e55fd3674d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113f2be4fa5547df8e41fe2d257169f1'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.140127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1f6b9c27-4157-4033-b60a-e55fd3674d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113f2be4fa5547df8e41fe2d257169f1'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.163531 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1007/1958] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:33 2022] DELETE /identity/v3/users/113f2be4fa5547df8e41fe2d257169f1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:34.244330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6523f08-6e72-4070-a3a7-6433a80fe41b service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:34.262044 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6523f08-6e72-4070-a3a7-6433a80fe41b service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:34.327840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b501001-9521-4720-868a-f590477ef867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:34.328878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b501001-9521-4720-868a-f590477ef867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:34.329264 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b501001-9521-4720-868a-f590477ef867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:34.329739 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b501001-9521-4720-868a-f590477ef867 admin admin] PATH_INFO: `/v3/users/7b8ea379d1314498b10b94e7f2f8d6b8` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:34.332050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b501001-9521-4720-868a-f590477ef867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b8ea379d1314498b10b94e7f2f8d6b8)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:34.333970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b501001-9521-4720-868a-f590477ef867 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:34.386223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6b501001-9521-4720-868a-f590477ef867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b8ea379d1314498b10b94e7f2f8d6b8'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.399421 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6b501001-9521-4720-868a-f590477ef867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b8ea379d1314498b10b94e7f2f8d6b8'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.400537 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6b501001-9521-4720-868a-f590477ef867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b8ea379d1314498b10b94e7f2f8d6b8'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.408119 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6b501001-9521-4720-868a-f590477ef867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b8ea379d1314498b10b94e7f2f8d6b8'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.408761 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6b501001-9521-4720-868a-f590477ef867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b8ea379d1314498b10b94e7f2f8d6b8'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.423518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 952/1959] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:34 2022] DELETE /identity/v3/users/7b8ea379d1314498b10b94e7f2f8d6b8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:34.427809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca25588-4fd4-4730-ade2-dc817907af3e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:34.428281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca25588-4fd4-4730-ade2-dc817907af3e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:34.428636 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca25588-4fd4-4730-ade2-dc817907af3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:34.470782 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9ca25588-4fd4-4730-ade2-dc817907af3e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:34.472186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9ca25588-4fd4-4730-ade2-dc817907af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:34.561180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1008/1960] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:34.571527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b501001-9521-4720-868a-f590477ef867 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:34.573817 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6b501001-9521-4720-868a-f590477ef867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:34.618211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca25588-4fd4-4730-ade2-dc817907af3e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:34.619926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9ca25588-4fd4-4730-ade2-dc817907af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:34.621952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:34.630904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:34.636647 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca25588-4fd4-4730-ade2-dc817907af3e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:34.643282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74113e38-9901-4a97-a4c5-ddca85a89529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:34.645109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74113e38-9901-4a97-a4c5-ddca85a89529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:34.645776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74113e38-9901-4a97-a4c5-ddca85a89529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:34.646138 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74113e38-9901-4a97-a4c5-ddca85a89529 admin admin] PATH_INFO: `/v3/projects/f1df4497f3834c688eb972daec7d72ad` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:34.648505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74113e38-9901-4a97-a4c5-ddca85a89529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1df4497f3834c688eb972daec7d72ad)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:34.650848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74113e38-9901-4a97-a4c5-ddca85a89529 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:34.723008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b501001-9521-4720-868a-f590477ef867 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:34.738088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-74113e38-9901-4a97-a4c5-ddca85a89529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1df4497f3834c688eb972daec7d72ad', 'request_id': 'req-74113e38-9901-4a97-a4c5-ddca85a89529'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.746151 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-74113e38-9901-4a97-a4c5-ddca85a89529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1df4497f3834c688eb972daec7d72ad', 'request_id': 'req-74113e38-9901-4a97-a4c5-ddca85a89529'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.759087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-74113e38-9901-4a97-a4c5-ddca85a89529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1df4497f3834c688eb972daec7d72ad', 'request_id': 'req-74113e38-9901-4a97-a4c5-ddca85a89529'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.775027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-74113e38-9901-4a97-a4c5-ddca85a89529 admin admin] The token cache is being invalidate because project f1df4497f3834c688eb972daec7d72ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:34.775027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-74113e38-9901-4a97-a4c5-ddca85a89529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.776017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-74113e38-9901-4a97-a4c5-ddca85a89529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:34.778043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1009/1961] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:34 2022] DELETE /identity/v3/projects/f1df4497f3834c688eb972daec7d72ad => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:34.783528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb0a80-010e-49a7-8172-a3f94b153a13 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:34.783937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb0a80-010e-49a7-8172-a3f94b153a13 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:34.784335 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb0a80-010e-49a7-8172-a3f94b153a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:34.814084 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9ccb0a80-010e-49a7-8172-a3f94b153a13 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:34.815318 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9ccb0a80-010e-49a7-8172-a3f94b153a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:34.825686 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cb964-5ef1-411c-911c-04a600a621f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:34.826433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cb964-5ef1-411c-911c-04a600a621f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:34.826780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cb964-5ef1-411c-911c-04a600a621f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:34.827061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cb964-5ef1-411c-911c-04a600a621f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:34.829137 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c06cb964-5ef1-411c-911c-04a600a621f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:34.891031 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1010/1962] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:34.901274 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4b21-30d0-41bf-a374-ed8138f8a633 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:34.902110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4b21-30d0-41bf-a374-ed8138f8a633 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:34.902602 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4b21-30d0-41bf-a374-ed8138f8a633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:34.902841 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cb964-5ef1-411c-911c-04a600a621f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:34.904343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cb964-5ef1-411c-911c-04a600a621f3 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:34.917816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 953/1963] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:34.924601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b10c4b21-30d0-41bf-a374-ed8138f8a633 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:34.925963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b10c4b21-30d0-41bf-a374-ed8138f8a633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:34.936380 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1011/1964] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:34.941089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cb964-5ef1-411c-911c-04a600a621f3 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:34.951085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cb964-5ef1-411c-911c-04a600a621f3 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:34.957646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85a52a-a344-4ce1-a6e9-3bdfd482134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:34.958049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85a52a-a344-4ce1-a6e9-3bdfd482134f admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:34.958339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85a52a-a344-4ce1-a6e9-3bdfd482134f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:34.958740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85a52a-a344-4ce1-a6e9-3bdfd482134f admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:34.959352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85a52a-a344-4ce1-a6e9-3bdfd482134f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:34.960093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85a52a-a344-4ce1-a6e9-3bdfd482134f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:34.961709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85a52a-a344-4ce1-a6e9-3bdfd482134f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:34.981706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 954/1965] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:34.983155 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c4b21-30d0-41bf-a374-ed8138f8a633 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:34.996556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c4b21-30d0-41bf-a374-ed8138f8a633 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:35.002085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3d77f-2645-4fca-a626-1ce9efd58a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:35.002757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3d77f-2645-4fca-a626-1ce9efd58a38 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:35.003044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3d77f-2645-4fca-a626-1ce9efd58a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:35.003325 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3d77f-2645-4fca-a626-1ce9efd58a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:35.004061 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3d77f-2645-4fca-a626-1ce9efd58a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:35.006247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3d77f-2645-4fca-a626-1ce9efd58a38 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:35.055581 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1012/1966] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:34 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:35.058486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85a52a-a344-4ce1-a6e9-3bdfd482134f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:35.069455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85a52a-a344-4ce1-a6e9-3bdfd482134f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:35.147305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44f374-8cbc-4c56-b2f2-0e067662bad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:35.148721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f374-8cbc-4c56-b2f2-0e067662bad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:35.149276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f374-8cbc-4c56-b2f2-0e067662bad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:35.149568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f374-8cbc-4c56-b2f2-0e067662bad1 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:35.150526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44f374-8cbc-4c56-b2f2-0e067662bad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:35.152864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44f374-8cbc-4c56-b2f2-0e067662bad1 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:35.173590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:35.180226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 955/1967] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:35 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:35.184150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3d77f-2645-4fca-a626-1ce9efd58a38 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:35.197038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3d77f-2645-4fca-a626-1ce9efd58a38 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:35.201898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e895484-fefb-48c1-8d03-94ccff67c204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:35.202638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e895484-fefb-48c1-8d03-94ccff67c204 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:35.202846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e895484-fefb-48c1-8d03-94ccff67c204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:35.203124 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e895484-fefb-48c1-8d03-94ccff67c204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:35.203893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e895484-fefb-48c1-8d03-94ccff67c204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:35.205527 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e895484-fefb-48c1-8d03-94ccff67c204 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:35.217284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1013/1968] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:35.221308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44f374-8cbc-4c56-b2f2-0e067662bad1 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:35.232283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44f374-8cbc-4c56-b2f2-0e067662bad1 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:35.237376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba97cbd-9ef2-453f-8bc1-91e87028eee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:35.238295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba97cbd-9ef2-453f-8bc1-91e87028eee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:35.238545 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba97cbd-9ef2-453f-8bc1-91e87028eee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:35.238868 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba97cbd-9ef2-453f-8bc1-91e87028eee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:35.239587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba97cbd-9ef2-453f-8bc1-91e87028eee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:35.241263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba97cbd-9ef2-453f-8bc1-91e87028eee4 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:35.257605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 956/1969] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:35.259329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e895484-fefb-48c1-8d03-94ccff67c204 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:35.261495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba97cbd-9ef2-453f-8bc1-91e87028eee4 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:35.262017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0e895484-fefb-48c1-8d03-94ccff67c204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:35.274289 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba97cbd-9ef2-453f-8bc1-91e87028eee4 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:35.276975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e895484-fefb-48c1-8d03-94ccff67c204 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:35.280591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa16ef6-e0fa-4a52-83e4-66c444079882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:35.281740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa16ef6-e0fa-4a52-83e4-66c444079882 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:35.282146 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa16ef6-e0fa-4a52-83e4-66c444079882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:35.282488 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa16ef6-e0fa-4a52-83e4-66c444079882 admin admin] PATH_INFO: `/v3/projects/a34c21e469b5424b9bd7e7aeabe31308/users/ed011be1cf274d478c8c3078a695ed1f/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:35.283590 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:35.285032 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:35.285528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:35.285987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] PATH_INFO: `/v3/projects/78f3fa926d764ec08e7c2d2d05605f0b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:35.294522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f3fa926d764ec08e7c2d2d05605f0b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:35.297937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:35.299906 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa16ef6-e0fa-4a52-83e4-66c444079882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34c21e469b5424b9bd7e7aeabe31308, user_id=ed011be1cf274d478c8c3078a695ed1f, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:35.302753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa16ef6-e0fa-4a52-83e4-66c444079882 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:35.320679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 957/1970] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:35 2022] PUT /identity/v3/projects/a34c21e469b5424b9bd7e7aeabe31308/users/ed011be1cf274d478c8c3078a695ed1f/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:35.330625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11327e-2554-4fc4-85db-96a8ffacc8a7 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:35.331171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11327e-2554-4fc4-85db-96a8ffacc8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:35.331656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11327e-2554-4fc4-85db-96a8ffacc8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:35.363864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-af11327e-2554-4fc4-85db-96a8ffacc8a7 None None] MFA Rules not processed for user `ed011be1cf274d478c8c3078a695ed1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:35.365441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-af11327e-2554-4fc4-85db-96a8ffacc8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:35.411501 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:35.422708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f3fa926d764ec08e7c2d2d05605f0b', 'request_id': 'req-de33441d-3fd0-48c6-8361-42a6c5a485e5'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:35.433511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f3fa926d764ec08e7c2d2d05605f0b', 'request_id': 'req-de33441d-3fd0-48c6-8361-42a6c5a485e5'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:35.448748 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f3fa926d764ec08e7c2d2d05605f0b', 'request_id': 'req-de33441d-3fd0-48c6-8361-42a6c5a485e5'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:35.470745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] The token cache is being invalidate because project 78f3fa926d764ec08e7c2d2d05605f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:35.471248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:35.472157 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:35.474436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1014/1971] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:35 2022] DELETE /identity/v3/projects/78f3fa926d764ec08e7c2d2d05605f0b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:35.480467 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:35.481878 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:35.499860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 958/1972] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:35.501344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11327e-2554-4fc4-85db-96a8ffacc8a7 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:35.563848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33441d-3fd0-48c6-8361-42a6c5a485e5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:35.571676 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dadf8d-c8c4-4ef4-ad37-6d43358933a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:35.572708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dadf8d-c8c4-4ef4-ad37-6d43358933a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:35.572989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dadf8d-c8c4-4ef4-ad37-6d43358933a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:35.573266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dadf8d-c8c4-4ef4-ad37-6d43358933a8 admin admin] PATH_INFO: `/v3/users/acd44916e4e240db9456d527f87d9aa0` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:35.573534 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11327e-2554-4fc4-85db-96a8ffacc8a7 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:35.574597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dadf8d-c8c4-4ef4-ad37-6d43358933a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acd44916e4e240db9456d527f87d9aa0)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:35.577074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dadf8d-c8c4-4ef4-ad37-6d43358933a8 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:35.578652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ef39a-1efb-4670-b079-3a6d7d4a1c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:35.579448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ef39a-1efb-4670-b079-3a6d7d4a1c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:35.579762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ef39a-1efb-4670-b079-3a6d7d4a1c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:35.580045 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ef39a-1efb-4670-b079-3a6d7d4a1c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:35.580729 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ef39a-1efb-4670-b079-3a6d7d4a1c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:35.582777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ef39a-1efb-4670-b079-3a6d7d4a1c4f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:35.620210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 959/1973] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:35 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:35.623160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ef39a-1efb-4670-b079-3a6d7d4a1c4f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:35.625773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-e07ef39a-1efb-4670-b079-3a6d7d4a1c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:35.688846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-61dadf8d-c8c4-4ef4-ad37-6d43358933a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acd44916e4e240db9456d527f87d9aa0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:35.697599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:35.703260 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-61dadf8d-c8c4-4ef4-ad37-6d43358933a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acd44916e4e240db9456d527f87d9aa0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:35.704054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-61dadf8d-c8c4-4ef4-ad37-6d43358933a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acd44916e4e240db9456d527f87d9aa0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:35.712854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-61dadf8d-c8c4-4ef4-ad37-6d43358933a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acd44916e4e240db9456d527f87d9aa0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:35.723407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-61dadf8d-c8c4-4ef4-ad37-6d43358933a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acd44916e4e240db9456d527f87d9aa0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:35.736852 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1015/1974] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:35 2022] DELETE /identity/v3/users/acd44916e4e240db9456d527f87d9aa0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:35.737591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ef39a-1efb-4670-b079-3a6d7d4a1c4f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:35.742334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dadf8d-c8c4-4ef4-ad37-6d43358933a8 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:35.743846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-61dadf8d-c8c4-4ef4-ad37-6d43358933a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:35.824247 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b13040-89ed-41f8-92f0-e705f9801c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:35.825012 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b13040-89ed-41f8-92f0-e705f9801c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:35.825681 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b13040-89ed-41f8-92f0-e705f9801c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:35.825969 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b13040-89ed-41f8-92f0-e705f9801c40 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:35.826744 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b13040-89ed-41f8-92f0-e705f9801c40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:35.827551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:35.829679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b13040-89ed-41f8-92f0-e705f9801c40 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:35.850835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dadf8d-c8c4-4ef4-ad37-6d43358933a8 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:35.863987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325ec5e-b4c9-4aa9-a3f0-929d05fae451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:35.864900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325ec5e-b4c9-4aa9-a3f0-929d05fae451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:35.865779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325ec5e-b4c9-4aa9-a3f0-929d05fae451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:35.866796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325ec5e-b4c9-4aa9-a3f0-929d05fae451 admin admin] PATH_INFO: `/v3/users/0ee092fe66e04331a1438435dbf868e0` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:35.867997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325ec5e-b4c9-4aa9-a3f0-929d05fae451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee092fe66e04331a1438435dbf868e0)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:35.870446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325ec5e-b4c9-4aa9-a3f0-929d05fae451 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:35.880937 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 960/1975] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:35 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:35.885828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b13040-89ed-41f8-92f0-e705f9801c40 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:35.897889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d9b13040-89ed-41f8-92f0-e705f9801c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:35.906837 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b13040-89ed-41f8-92f0-e705f9801c40 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:35.913298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32de66-d96e-4aeb-9348-bbdf6ecd2950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:35.914293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32de66-d96e-4aeb-9348-bbdf6ecd2950 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:35.914590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32de66-d96e-4aeb-9348-bbdf6ecd2950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:35.915082 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32de66-d96e-4aeb-9348-bbdf6ecd2950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:35.915932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32de66-d96e-4aeb-9348-bbdf6ecd2950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:35.918386 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32de66-d96e-4aeb-9348-bbdf6ecd2950 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:35.931284 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 961/1976] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:35.936697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32de66-d96e-4aeb-9348-bbdf6ecd2950 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:35.958753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32de66-d96e-4aeb-9348-bbdf6ecd2950 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:35.972031 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c325ec5e-b4c9-4aa9-a3f0-929d05fae451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee092fe66e04331a1438435dbf868e0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:35.973429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6eb27-a570-4a3b-983a-bb3c51fd0802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:35.974278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6eb27-a570-4a3b-983a-bb3c51fd0802 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:35.974505 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6eb27-a570-4a3b-983a-bb3c51fd0802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:35.974751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6eb27-a570-4a3b-983a-bb3c51fd0802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:35.975692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6eb27-a570-4a3b-983a-bb3c51fd0802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:35.978402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6eb27-a570-4a3b-983a-bb3c51fd0802 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:35.994751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 962/1977] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:35.999100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6eb27-a570-4a3b-983a-bb3c51fd0802 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:36.004957 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c325ec5e-b4c9-4aa9-a3f0-929d05fae451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee092fe66e04331a1438435dbf868e0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:36.005839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c325ec5e-b4c9-4aa9-a3f0-929d05fae451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee092fe66e04331a1438435dbf868e0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:36.014617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6eb27-a570-4a3b-983a-bb3c51fd0802 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:36.020612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d61ee3-9d4a-4c3e-aab3-3b59ace185a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:36.021608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d61ee3-9d4a-4c3e-aab3-3b59ace185a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.021977 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d61ee3-9d4a-4c3e-aab3-3b59ace185a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.022349 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d61ee3-9d4a-4c3e-aab3-3b59ace185a1 admin admin] PATH_INFO: `/v3/projects/cbc03bba77de47758c2ca6415297dced/users/0790d1f69825429fb8bbc63092fab797/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.025464 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c325ec5e-b4c9-4aa9-a3f0-929d05fae451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee092fe66e04331a1438435dbf868e0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:36.040835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c325ec5e-b4c9-4aa9-a3f0-929d05fae451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee092fe66e04331a1438435dbf868e0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:36.041585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d61ee3-9d4a-4c3e-aab3-3b59ace185a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc03bba77de47758c2ca6415297dced, user_id=0790d1f69825429fb8bbc63092fab797, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:36.045076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d61ee3-9d4a-4c3e-aab3-3b59ace185a1 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:36.055513 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1016/1978] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:35 2022] DELETE /identity/v3/users/0ee092fe66e04331a1438435dbf868e0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:36.058678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825a38d-c344-4ba0-85cf-4cf3282b8e49 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.058971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825a38d-c344-4ba0-85cf-4cf3282b8e49 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.059254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825a38d-c344-4ba0-85cf-4cf3282b8e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.070297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 963/1979] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:35 2022] PUT /identity/v3/projects/cbc03bba77de47758c2ca6415297dced/users/0790d1f69825429fb8bbc63092fab797/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:36.081072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed094e0a-6d9e-4024-9191-9388654ffad2 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.081355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed094e0a-6d9e-4024-9191-9388654ffad2 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.081627 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed094e0a-6d9e-4024-9191-9388654ffad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.085447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6825a38d-c344-4ba0-85cf-4cf3282b8e49 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:36.087156 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6825a38d-c344-4ba0-85cf-4cf3282b8e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:36.112574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ed094e0a-6d9e-4024-9191-9388654ffad2 None None] MFA Rules not processed for user `0790d1f69825429fb8bbc63092fab797`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:36.114577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ed094e0a-6d9e-4024-9191-9388654ffad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:36.169611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1017/1980] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:36.170658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825a38d-c344-4ba0-85cf-4cf3282b8e49 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:36.171949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6825a38d-c344-4ba0-85cf-4cf3282b8e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:36.184696 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825a38d-c344-4ba0-85cf-4cf3282b8e49 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:36.189610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:36.190484 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.190759 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.191026 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] PATH_INFO: `/v3/projects/b8924794cde24906a8782d417eba9959` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.192269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8924794cde24906a8782d417eba9959)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:36.194175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:36.196591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 964/1981] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:36.201206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed094e0a-6d9e-4024-9191-9388654ffad2 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:36.202667 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ed094e0a-6d9e-4024-9191-9388654ffad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:36.228428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:36.252291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8924794cde24906a8782d417eba9959', 'request_id': 'req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:36.258370 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8924794cde24906a8782d417eba9959', 'request_id': 'req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:36.266677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8924794cde24906a8782d417eba9959', 'request_id': 'req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:36.268317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:36.273107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed094e0a-6d9e-4024-9191-9388654ffad2 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:36.281403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] The token cache is being invalidate because project b8924794cde24906a8782d417eba9959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:36.281690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:36.282338 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:36.284028 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1018/1982] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:36 2022] DELETE /identity/v3/projects/b8924794cde24906a8782d417eba9959 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:36.284843 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:36.286093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:36.326102 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfb8cb-49c0-4e3f-87a3-b7b4d8b564d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:36.326753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfb8cb-49c0-4e3f-87a3-b7b4d8b564d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.327033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfb8cb-49c0-4e3f-87a3-b7b4d8b564d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.327308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfb8cb-49c0-4e3f-87a3-b7b4d8b564d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.329158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-42cfb8cb-49c0-4e3f-87a3-b7b4d8b564d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:36.351455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f2aa2-41c8-4a85-8c43-d94a2845bc7c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:36.356370 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62e563-b136-4e32-9d88-9a2800059d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:36.357027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62e563-b136-4e32-9d88-9a2800059d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.357312 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62e563-b136-4e32-9d88-9a2800059d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.357586 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62e563-b136-4e32-9d88-9a2800059d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.358274 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62e563-b136-4e32-9d88-9a2800059d0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:36.360300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62e563-b136-4e32-9d88-9a2800059d0a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:36.396139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1019/1983] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:36 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:36.396139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd51fc5-df73-479a-80df-1d57c91e2a54 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.396139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd51fc5-df73-479a-80df-1d57c91e2a54 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.396139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd51fc5-df73-479a-80df-1d57c91e2a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.403457 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfb8cb-49c0-4e3f-87a3-b7b4d8b564d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:36.405211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfb8cb-49c0-4e3f-87a3-b7b4d8b564d5 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:36.417403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-0cd51fc5-df73-479a-80df-1d57c91e2a54 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:36.418930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0cd51fc5-df73-479a-80df-1d57c91e2a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:36.419388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 965/1984] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:36.432746 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfb8cb-49c0-4e3f-87a3-b7b4d8b564d5 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:36.448540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfb8cb-49c0-4e3f-87a3-b7b4d8b564d5 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:36.501153 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1020/1985] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:36.511436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634c868-7c9a-466f-bf01-7ea28adebc98 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.511785 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634c868-7c9a-466f-bf01-7ea28adebc98 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.512000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634c868-7c9a-466f-bf01-7ea28adebc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.541323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5634c868-7c9a-466f-bf01-7ea28adebc98 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:36.543017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5634c868-7c9a-466f-bf01-7ea28adebc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:36.559297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501309b6-7961-4535-8392-71abf2343876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:36.559987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1021/1986] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:36.560093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501309b6-7961-4535-8392-71abf2343876 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.560093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501309b6-7961-4535-8392-71abf2343876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.560093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501309b6-7961-4535-8392-71abf2343876 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.560093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501309b6-7961-4535-8392-71abf2343876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:36.560093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501309b6-7961-4535-8392-71abf2343876 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:36.562727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634c868-7c9a-466f-bf01-7ea28adebc98 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:36.577906 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634c868-7c9a-466f-bf01-7ea28adebc98 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:36.600655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 966/1987] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:36 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:36.604515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501309b6-7961-4535-8392-71abf2343876 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:36.605920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973cb00-b520-4b1c-a4a5-444b15d0faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:36.606611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973cb00-b520-4b1c-a4a5-444b15d0faaf admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.606898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973cb00-b520-4b1c-a4a5-444b15d0faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.608177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973cb00-b520-4b1c-a4a5-444b15d0faaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.608177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973cb00-b520-4b1c-a4a5-444b15d0faaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:36.608399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973cb00-b520-4b1c-a4a5-444b15d0faaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:36.609978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973cb00-b520-4b1c-a4a5-444b15d0faaf admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:36.618894 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501309b6-7961-4535-8392-71abf2343876 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:36.625073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaa561-fa4d-4cb0-a0cc-fc88e6a48664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:36.626227 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaa561-fa4d-4cb0-a0cc-fc88e6a48664 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.626227 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaa561-fa4d-4cb0-a0cc-fc88e6a48664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.626652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eaa561-fa4d-4cb0-a0cc-fc88e6a48664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.627999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaa561-fa4d-4cb0-a0cc-fc88e6a48664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:36.629638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eaa561-fa4d-4cb0-a0cc-fc88e6a48664 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:36.643165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1022/1988] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:35:36.649321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 967/1989] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:36.649488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973cb00-b520-4b1c-a4a5-444b15d0faaf admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:36.650452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaa561-fa4d-4cb0-a0cc-fc88e6a48664 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:36.665437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973cb00-b520-4b1c-a4a5-444b15d0faaf admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:36.666995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:36.676612 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78f1c5-2214-4af9-aff7-c8e8b3176713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:36.677462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f1c5-2214-4af9-aff7-c8e8b3176713 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.677751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f1c5-2214-4af9-aff7-c8e8b3176713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.678165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78f1c5-2214-4af9-aff7-c8e8b3176713 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.678867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78f1c5-2214-4af9-aff7-c8e8b3176713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:36.679997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eaa561-fa4d-4cb0-a0cc-fc88e6a48664 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:36.681035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78f1c5-2214-4af9-aff7-c8e8b3176713 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:36.704462 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7e5bc-488c-4617-9aaa-71b28c97e876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:36.705417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7e5bc-488c-4617-9aaa-71b28c97e876 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.705745 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7e5bc-488c-4617-9aaa-71b28c97e876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.705948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7e5bc-488c-4617-9aaa-71b28c97e876 admin admin] PATH_INFO: `/v3/projects/724e4cd846e44389972848f2249d6bd3/users/411cb8fbf27f43a7b742d3796d7efa2b/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.735526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1023/1990] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:36 2022] POST /identity/v3/projects => generated 359 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:36.736295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7e5bc-488c-4617-9aaa-71b28c97e876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724e4cd846e44389972848f2249d6bd3, user_id=411cb8fbf27f43a7b742d3796d7efa2b, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:36.739131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7e5bc-488c-4617-9aaa-71b28c97e876 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:36.740177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78f1c5-2214-4af9-aff7-c8e8b3176713 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:36.772241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 968/1991] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:36 2022] PUT /identity/v3/projects/724e4cd846e44389972848f2249d6bd3/users/411cb8fbf27f43a7b742d3796d7efa2b/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:36.776797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7e5bc-488c-4617-9aaa-71b28c97e876 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:36.809281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:36.838900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78f1c5-2214-4af9-aff7-c8e8b3176713 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:36.868324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7e5bc-488c-4617-9aaa-71b28c97e876 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:36.874379 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec0259-752a-4345-8338-ebbeb6042b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:36.875878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0259-752a-4345-8338-ebbeb6042b3a admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.876313 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0259-752a-4345-8338-ebbeb6042b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.878274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0259-752a-4345-8338-ebbeb6042b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.879296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec0259-752a-4345-8338-ebbeb6042b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:36.882225 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec0259-752a-4345-8338-ebbeb6042b3a admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:36.895509 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 969/1992] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:36.898940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec0259-752a-4345-8338-ebbeb6042b3a admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:36.928768 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec0259-752a-4345-8338-ebbeb6042b3a admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:36.946388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80afb5-d800-4dd0-8474-0d409a2ad98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:36.947839 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80afb5-d800-4dd0-8474-0d409a2ad98c admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:36.948306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80afb5-d800-4dd0-8474-0d409a2ad98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:36.948810 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80afb5-d800-4dd0-8474-0d409a2ad98c admin admin] PATH_INFO: `/v3/projects/724e4cd846e44389972848f2249d6bd3/users/411cb8fbf27f43a7b742d3796d7efa2b/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:36.952349 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80afb5-d800-4dd0-8474-0d409a2ad98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=724e4cd846e44389972848f2249d6bd3, user_id=411cb8fbf27f43a7b742d3796d7efa2b, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:36.966023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80afb5-d800-4dd0-8474-0d409a2ad98c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:36.980806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 970/1993] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:36 2022] PUT /identity/v3/projects/724e4cd846e44389972848f2249d6bd3/users/411cb8fbf27f43a7b742d3796d7efa2b/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:36.981946 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80afb5-d800-4dd0-8474-0d409a2ad98c admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:36.984169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-3b80afb5-d800-4dd0-8474-0d409a2ad98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:37.031705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c67dd-2603-420b-a029-ed1a5803fde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:37.032131 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c67dd-2603-420b-a029-ed1a5803fde4 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:37.032316 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c67dd-2603-420b-a029-ed1a5803fde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:37.032610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c67dd-2603-420b-a029-ed1a5803fde4 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:37.033277 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c67dd-2603-420b-a029-ed1a5803fde4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:37.035426 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c67dd-2603-420b-a029-ed1a5803fde4 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:37.089074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80afb5-d800-4dd0-8474-0d409a2ad98c admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:37.094167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1024/1994] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:36 2022] POST /identity/v3/users => generated 280 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:37.094167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf1522-4723-449b-bfb8-3a15af29f894 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:37.094608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf1522-4723-449b-bfb8-3a15af29f894 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:37.094966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf1522-4723-449b-bfb8-3a15af29f894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:37.095147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:37.096653 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:37.097086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:37.097375 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] PATH_INFO: `/v3/projects/d3dd6aec39614887a8acd42fbef0b8a6` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:37.098594 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3dd6aec39614887a8acd42fbef0b8a6)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:37.100872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:37.140079 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7acf1522-4723-449b-bfb8-3a15af29f894 None None] MFA Rules not processed for user `411cb8fbf27f43a7b742d3796d7efa2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:37.142075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7acf1522-4723-449b-bfb8-3a15af29f894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:37.195826 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3dd6aec39614887a8acd42fbef0b8a6', 'request_id': 'req-1d4adf38-4eb6-4879-8477-c5cefff7c18e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:37.206021 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3dd6aec39614887a8acd42fbef0b8a6', 'request_id': 'req-1d4adf38-4eb6-4879-8477-c5cefff7c18e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:37.214874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3dd6aec39614887a8acd42fbef0b8a6', 'request_id': 'req-1d4adf38-4eb6-4879-8477-c5cefff7c18e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:37.219703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:37.241963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] The token cache is being invalidate because project d3dd6aec39614887a8acd42fbef0b8a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:37.244604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:37.246068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:37.250035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 971/1995] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:36 2022] DELETE /identity/v3/projects/d3dd6aec39614887a8acd42fbef0b8a6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:37.253362 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:37.254814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:37.318557 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1025/1996] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:37.325169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf1522-4723-449b-bfb8-3a15af29f894 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:37.325977 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4adf38-4eb6-4879-8477-c5cefff7c18e admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:37.328926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7acf1522-4723-449b-bfb8-3a15af29f894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:37.331054 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c30f4f-e199-4422-aa56-ff6753637f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:37.331753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c30f4f-e199-4422-aa56-ff6753637f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:37.332042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c30f4f-e199-4422-aa56-ff6753637f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:37.332322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c30f4f-e199-4422-aa56-ff6753637f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:37.333061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c30f4f-e199-4422-aa56-ff6753637f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:37.334672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c30f4f-e199-4422-aa56-ff6753637f56 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:37.347575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 972/1997] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:37.347575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c30f4f-e199-4422-aa56-ff6753637f56 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:37.350005 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-76c30f4f-e199-4422-aa56-ff6753637f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:37.355737 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf1522-4723-449b-bfb8-3a15af29f894 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:37.362520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61973f-d86a-4604-b37d-d701415df56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:37.363584 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61973f-d86a-4604-b37d-d701415df56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:37.363872 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61973f-d86a-4604-b37d-d701415df56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:37.364149 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61973f-d86a-4604-b37d-d701415df56e admin admin] PATH_INFO: `/v3/users/e556da995d7c48308188f65a03a0ca89` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:37.365376 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61973f-d86a-4604-b37d-d701415df56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e556da995d7c48308188f65a03a0ca89)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:37.367327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61973f-d86a-4604-b37d-d701415df56e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:37.420976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c30f4f-e199-4422-aa56-ff6753637f56 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:37.424828 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fc61973f-d86a-4604-b37d-d701415df56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e556da995d7c48308188f65a03a0ca89'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:37.426711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9ff47-b834-49a0-9d59-39381d143420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:37.427373 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9ff47-b834-49a0-9d59-39381d143420 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:37.427690 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9ff47-b834-49a0-9d59-39381d143420 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:37.427993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9ff47-b834-49a0-9d59-39381d143420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:37.432298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:37.449563 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fc61973f-d86a-4604-b37d-d701415df56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e556da995d7c48308188f65a03a0ca89'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:37.450308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fc61973f-d86a-4604-b37d-d701415df56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e556da995d7c48308188f65a03a0ca89'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:37.460384 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fc61973f-d86a-4604-b37d-d701415df56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e556da995d7c48308188f65a03a0ca89'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:37.469927 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fc61973f-d86a-4604-b37d-d701415df56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e556da995d7c48308188f65a03a0ca89'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:37.478707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1026/1998] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:37 2022] DELETE /identity/v3/users/e556da995d7c48308188f65a03a0ca89 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:37.479600 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61973f-d86a-4604-b37d-d701415df56e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:37.481924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fc61973f-d86a-4604-b37d-d701415df56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:37.521257 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9ff47-b834-49a0-9d59-39381d143420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:37.523498 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9ff47-b834-49a0-9d59-39381d143420 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:37.535759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 973/1999] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:37.568512 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61973f-d86a-4604-b37d-d701415df56e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:37.574367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488df28-393f-4917-bb79-43c42e4a09a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:37.575531 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488df28-393f-4917-bb79-43c42e4a09a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:37.575823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488df28-393f-4917-bb79-43c42e4a09a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:37.576156 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488df28-393f-4917-bb79-43c42e4a09a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:37.577348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488df28-393f-4917-bb79-43c42e4a09a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:37.579623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488df28-393f-4917-bb79-43c42e4a09a8 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:37.596182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1027/2000] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:37.598992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9ff47-b834-49a0-9d59-39381d143420 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:37.616491 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9ff47-b834-49a0-9d59-39381d143420 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:37.624926 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4c20a-e7a9-431b-8cf1-c766031ca827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:37.625942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4c20a-e7a9-431b-8cf1-c766031ca827 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:37.626300 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4c20a-e7a9-431b-8cf1-c766031ca827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:37.626669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4c20a-e7a9-431b-8cf1-c766031ca827 admin admin] PATH_INFO: `/v3/projects/b8602bfde13c40aca705e4ba40a643ae/users/3bf2296fdc43439c9f4002666a4abd48/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:37.644740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4c20a-e7a9-431b-8cf1-c766031ca827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8602bfde13c40aca705e4ba40a643ae, user_id=3bf2296fdc43439c9f4002666a4abd48, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:37.647930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4c20a-e7a9-431b-8cf1-c766031ca827 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:37.664622 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 974/2001] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:37 2022] PUT /identity/v3/projects/b8602bfde13c40aca705e4ba40a643ae/users/3bf2296fdc43439c9f4002666a4abd48/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:37.674887 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156784f-5f05-4c14-af3a-150e2249fec3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:37.675201 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156784f-5f05-4c14-af3a-150e2249fec3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:37.675451 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156784f-5f05-4c14-af3a-150e2249fec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:37.709660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8156784f-5f05-4c14-af3a-150e2249fec3 None None] MFA Rules not processed for user `3bf2296fdc43439c9f4002666a4abd48`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:37.711568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8156784f-5f05-4c14-af3a-150e2249fec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:37.815955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1028/2002] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:37 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:37.865755 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4c20a-e7a9-431b-8cf1-c766031ca827 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:37.867807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c3d4c20a-e7a9-431b-8cf1-c766031ca827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:37.902310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:38.007765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4c20a-e7a9-431b-8cf1-c766031ca827 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:38.014068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfdbd5-7a97-4350-a8ae-617f6ae39732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:38.014743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfdbd5-7a97-4350-a8ae-617f6ae39732 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:38.015983 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfdbd5-7a97-4350-a8ae-617f6ae39732 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:38.016552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfdbd5-7a97-4350-a8ae-617f6ae39732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:38.046723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfdbd5-7a97-4350-a8ae-617f6ae39732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:38.048315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfdbd5-7a97-4350-a8ae-617f6ae39732 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:38.059963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 975/2003] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:37 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:38.064260 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156784f-5f05-4c14-af3a-150e2249fec3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:38.070396 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8156784f-5f05-4c14-af3a-150e2249fec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:38.081356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfdbd5-7a97-4350-a8ae-617f6ae39732 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:38.259852 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:38.266673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156784f-5f05-4c14-af3a-150e2249fec3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:38.281495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:38.282646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:38.283141 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:38.284918 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f admin admin] PATH_INFO: `/v3/projects/0fa24144dd1342dbb1e567733084d6b5` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:38.289852 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa24144dd1342dbb1e567733084d6b5)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:38.297203 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:38.307089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfdbd5-7a97-4350-a8ae-617f6ae39732 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:38.332130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a035a-0881-4d0e-a5ce-4e3f11ff5924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:38.333060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a035a-0881-4d0e-a5ce-4e3f11ff5924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:38.333353 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a035a-0881-4d0e-a5ce-4e3f11ff5924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:38.333629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a035a-0881-4d0e-a5ce-4e3f11ff5924 admin admin] PATH_INFO: `/v3/users/3bf2296fdc43439c9f4002666a4abd48` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:38.338755 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a035a-0881-4d0e-a5ce-4e3f11ff5924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf2296fdc43439c9f4002666a4abd48)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:38.340918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a035a-0881-4d0e-a5ce-4e3f11ff5924 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:38.423160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa24144dd1342dbb1e567733084d6b5', 'request_id': 'req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:38.440752 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa24144dd1342dbb1e567733084d6b5', 'request_id': 'req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:38.472743 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa24144dd1342dbb1e567733084d6b5', 'request_id': 'req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:38.512169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-863a035a-0881-4d0e-a5ce-4e3f11ff5924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf2296fdc43439c9f4002666a4abd48'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:38.528333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f admin admin] The token cache is being invalidate because project 0fa24144dd1342dbb1e567733084d6b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:38.528333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:38.529038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-efcc46cd-b4af-4bc9-a3e6-d6d50102296f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:38.529146 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-863a035a-0881-4d0e-a5ce-4e3f11ff5924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf2296fdc43439c9f4002666a4abd48'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:38.529818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-863a035a-0881-4d0e-a5ce-4e3f11ff5924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf2296fdc43439c9f4002666a4abd48'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:38.533640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1029/2004] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:38 2022] DELETE /identity/v3/projects/0fa24144dd1342dbb1e567733084d6b5 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:38.542807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-863a035a-0881-4d0e-a5ce-4e3f11ff5924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf2296fdc43439c9f4002666a4abd48'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:38.543396 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6c5d2-48a0-426b-8a20-8b3c5fa520b4 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:38.543532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-863a035a-0881-4d0e-a5ce-4e3f11ff5924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf2296fdc43439c9f4002666a4abd48'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:38.543721 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6c5d2-48a0-426b-8a20-8b3c5fa520b4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:38.544007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6c5d2-48a0-426b-8a20-8b3c5fa520b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:38.562159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 976/2005] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:38 2022] DELETE /identity/v3/users/3bf2296fdc43439c9f4002666a4abd48 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:38.563292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a035a-0881-4d0e-a5ce-4e3f11ff5924 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:38.565151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-863a035a-0881-4d0e-a5ce-4e3f11ff5924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:38.609719 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-73b6c5d2-48a0-426b-8a20-8b3c5fa520b4 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:38.611000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-73b6c5d2-48a0-426b-8a20-8b3c5fa520b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:38.623549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:38.654677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a035a-0881-4d0e-a5ce-4e3f11ff5924 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:38.659673 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58575c7-6608-4243-b0f9-9f2864331838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:38.661016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58575c7-6608-4243-b0f9-9f2864331838 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:38.661686 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58575c7-6608-4243-b0f9-9f2864331838 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:38.662120 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58575c7-6608-4243-b0f9-9f2864331838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:38.664724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f58575c7-6608-4243-b0f9-9f2864331838 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:38.739407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1030/2006] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:38.742888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130d44-ef1d-4bd7-bf50-3848743b9716 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:38.743752 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130d44-ef1d-4bd7-bf50-3848743b9716 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:38.744192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de130d44-ef1d-4bd7-bf50-3848743b9716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:38.771899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-de130d44-ef1d-4bd7-bf50-3848743b9716 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:38.773692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58575c7-6608-4243-b0f9-9f2864331838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:38.774264 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-de130d44-ef1d-4bd7-bf50-3848743b9716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:38.776471 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58575c7-6608-4243-b0f9-9f2864331838 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:38.786967 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1031/2007] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:38.789394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3c2f7-84de-4f27-931e-e67400d23410 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:38.789747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3c2f7-84de-4f27-931e-e67400d23410 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:38.790090 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3c2f7-84de-4f27-931e-e67400d23410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:38.794176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 977/2008] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:38.806859 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58575c7-6608-4243-b0f9-9f2864331838 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:38.811689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f58575c7-6608-4243-b0f9-9f2864331838 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:38.851740 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-90b3c2f7-84de-4f27-931e-e67400d23410 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:38.853797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-90b3c2f7-84de-4f27-931e-e67400d23410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:38.885442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1032/2009] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:38.891043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3c2f7-84de-4f27-931e-e67400d23410 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:38.924895 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3c2f7-84de-4f27-931e-e67400d23410 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:38.939265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb828285-5c38-4f72-9bb1-599216d04656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:38.940008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb828285-5c38-4f72-9bb1-599216d04656 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:38.940287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb828285-5c38-4f72-9bb1-599216d04656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:38.940556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb828285-5c38-4f72-9bb1-599216d04656 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:38.941305 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb828285-5c38-4f72-9bb1-599216d04656 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:38.941600 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb828285-5c38-4f72-9bb1-599216d04656 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:38.949795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb828285-5c38-4f72-9bb1-599216d04656 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:38.958438 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58575c7-6608-4243-b0f9-9f2864331838 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:38.966502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad558df-6a0e-48d2-a342-cba4568189fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:38.967743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad558df-6a0e-48d2-a342-cba4568189fe service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:38.968229 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad558df-6a0e-48d2-a342-cba4568189fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:38.971394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad558df-6a0e-48d2-a342-cba4568189fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:38.979944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1033/2010] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:38.980869 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb828285-5c38-4f72-9bb1-599216d04656 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:38.984590 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fb828285-5c38-4f72-9bb1-599216d04656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:38.991334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad558df-6a0e-48d2-a342-cba4568189fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:38.993309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad558df-6a0e-48d2-a342-cba4568189fe service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:39.005426 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb828285-5c38-4f72-9bb1-599216d04656 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:39.009225 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 978/2011] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:39.010573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad558df-6a0e-48d2-a342-cba4568189fe service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:39.029686 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d7ccc-e971-4053-91d8-63343f52ce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:39.030638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d7ccc-e971-4053-91d8-63343f52ce30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:39.030926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d7ccc-e971-4053-91d8-63343f52ce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:39.031208 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d7ccc-e971-4053-91d8-63343f52ce30 admin admin] PATH_INFO: `/v3/users/971c81de6c3c45749c38f4e59e51e9c6` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:39.034593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad558df-6a0e-48d2-a342-cba4568189fe service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:39.046974 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d7ccc-e971-4053-91d8-63343f52ce30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=971c81de6c3c45749c38f4e59e51e9c6)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:39.048979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d7ccc-e971-4053-91d8-63343f52ce30 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:39.049818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fcc1a-8ca9-411d-bf2b-545983607509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:39.050499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fcc1a-8ca9-411d-bf2b-545983607509 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:39.050942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fcc1a-8ca9-411d-bf2b-545983607509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:39.051060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fcc1a-8ca9-411d-bf2b-545983607509 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:39.051876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fcc1a-8ca9-411d-bf2b-545983607509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:39.053940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fcc1a-8ca9-411d-bf2b-545983607509 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:39.118133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 979/2012] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:39 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:39.124137 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fcc1a-8ca9-411d-bf2b-545983607509 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:39.158106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-526d7ccc-e971-4053-91d8-63343f52ce30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971c81de6c3c45749c38f4e59e51e9c6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:39.173910 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:39.181893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-526d7ccc-e971-4053-91d8-63343f52ce30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971c81de6c3c45749c38f4e59e51e9c6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:39.184761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-526d7ccc-e971-4053-91d8-63343f52ce30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971c81de6c3c45749c38f4e59e51e9c6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:39.204907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-526d7ccc-e971-4053-91d8-63343f52ce30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971c81de6c3c45749c38f4e59e51e9c6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:39.217434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-526d7ccc-e971-4053-91d8-63343f52ce30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971c81de6c3c45749c38f4e59e51e9c6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:39.228540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1034/2013] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:38 2022] DELETE /identity/v3/users/971c81de6c3c45749c38f4e59e51e9c6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:39.233210 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ace0f-8c41-4f51-9575-7f47109610a3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:39.233664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ace0f-8c41-4f51-9575-7f47109610a3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:39.234095 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ace0f-8c41-4f51-9575-7f47109610a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:39.275642 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-0e7ace0f-8c41-4f51-9575-7f47109610a3 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:39.276885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0e7ace0f-8c41-4f51-9575-7f47109610a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:39.293693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fcc1a-8ca9-411d-bf2b-545983607509 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:39.330547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:39.407317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2afd12-fd34-4243-9963-2a8ba8401af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:39.408127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2afd12-fd34-4243-9963-2a8ba8401af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:39.408328 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2afd12-fd34-4243-9963-2a8ba8401af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:39.408601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2afd12-fd34-4243-9963-2a8ba8401af4 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:39.409465 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2afd12-fd34-4243-9963-2a8ba8401af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:39.411973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2afd12-fd34-4243-9963-2a8ba8401af4 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:39.416404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1035/2014] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:39.428750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ace0f-8c41-4f51-9575-7f47109610a3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:39.431550 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0e7ace0f-8c41-4f51-9575-7f47109610a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:39.447776 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 980/2015] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:39 2022] POST /identity/v3/users => generated 290 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:39.451723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2afd12-fd34-4243-9963-2a8ba8401af4 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:39.453979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-da2afd12-fd34-4243-9963-2a8ba8401af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:39.468356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2afd12-fd34-4243-9963-2a8ba8401af4 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:39.473566 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad829a-4d14-45f9-a86b-43282f9fa53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:39.474246 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad829a-4d14-45f9-a86b-43282f9fa53d admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:39.474535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad829a-4d14-45f9-a86b-43282f9fa53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:39.474817 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad829a-4d14-45f9-a86b-43282f9fa53d admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:39.475632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad829a-4d14-45f9-a86b-43282f9fa53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:39.477252 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad829a-4d14-45f9-a86b-43282f9fa53d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:39.489570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 981/2016] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:39.502177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad829a-4d14-45f9-a86b-43282f9fa53d admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:39.516198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad829a-4d14-45f9-a86b-43282f9fa53d admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:39.518000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ace0f-8c41-4f51-9575-7f47109610a3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:39.527253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbd01a-1017-4398-a871-63ce3c7f7043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:39.527947 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbd01a-1017-4398-a871-63ce3c7f7043 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:39.528228 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbd01a-1017-4398-a871-63ce3c7f7043 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:39.528806 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbd01a-1017-4398-a871-63ce3c7f7043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:39.532013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119ba60-b62f-450b-9a10-371216106d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:39.532689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119ba60-b62f-450b-9a10-371216106d9b admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:39.532969 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119ba60-b62f-450b-9a10-371216106d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:39.533244 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119ba60-b62f-450b-9a10-371216106d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:39.534120 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119ba60-b62f-450b-9a10-371216106d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:39.536383 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119ba60-b62f-450b-9a10-371216106d9b admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:39.546616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbd01a-1017-4398-a871-63ce3c7f7043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:39.549142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbd01a-1017-4398-a871-63ce3c7f7043 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:39.551668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 982/2017] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:39.553403 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119ba60-b62f-450b-9a10-371216106d9b admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:39.566772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119ba60-b62f-450b-9a10-371216106d9b admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:39.567821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1036/2018] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:39.572420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c7981-48fb-4d92-b0cd-3017dad64ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:39.573481 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c7981-48fb-4d92-b0cd-3017dad64ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:39.573765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c7981-48fb-4d92-b0cd-3017dad64ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:39.574036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c7981-48fb-4d92-b0cd-3017dad64ac1 admin admin] PATH_INFO: `/v3/projects/7ffe20a81c0d46678742324b6a0530b7/users/c44f1ff65e9e4aa59db4e989795beaf8/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:39.596242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c7981-48fb-4d92-b0cd-3017dad64ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ffe20a81c0d46678742324b6a0530b7, user_id=c44f1ff65e9e4aa59db4e989795beaf8, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:39.599011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c7981-48fb-4d92-b0cd-3017dad64ac1 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:39.614436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 983/2019] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:39 2022] PUT /identity/v3/projects/7ffe20a81c0d46678742324b6a0530b7/users/c44f1ff65e9e4aa59db4e989795beaf8/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:39.624878 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbd01a-1017-4398-a871-63ce3c7f7043 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:39.626726 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e1bbd01a-1017-4398-a871-63ce3c7f7043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:39.642256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbd01a-1017-4398-a871-63ce3c7f7043 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:39.649170 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140528f-da2b-47b0-9e91-d9029919b5a6 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:39.651548 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140528f-da2b-47b0-9e91-d9029919b5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:39.657457 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140528f-da2b-47b0-9e91-d9029919b5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:39.700240 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-6140528f-da2b-47b0-9e91-d9029919b5a6 None None] MFA Rules not processed for user `c44f1ff65e9e4aa59db4e989795beaf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:39.701662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6140528f-da2b-47b0-9e91-d9029919b5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:39.771665 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:39.778102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:39.778652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:39.781684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f admin admin] PATH_INFO: `/v3/projects/b8602bfde13c40aca705e4ba40a643ae` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:39.786846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8602bfde13c40aca705e4ba40a643ae)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:39.791960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:39.797275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 984/2020] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:39.801937 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140528f-da2b-47b0-9e91-d9029919b5a6 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:39.817967 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140528f-da2b-47b0-9e91-d9029919b5a6 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:39.825230 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afd1ec-2815-472e-bad8-091064028b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:39.826350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afd1ec-2815-472e-bad8-091064028b34 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:39.826890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afd1ec-2815-472e-bad8-091064028b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:39.827392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afd1ec-2815-472e-bad8-091064028b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:39.828313 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afd1ec-2815-472e-bad8-091064028b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:39.830590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afd1ec-2815-472e-bad8-091064028b34 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:39.844702 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:39.875191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 985/2021] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:39 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:39.879274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afd1ec-2815-472e-bad8-091064028b34 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:39.899035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8602bfde13c40aca705e4ba40a643ae', 'request_id': 'req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:39.915089 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8602bfde13c40aca705e4ba40a643ae', 'request_id': 'req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:39.928524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:39.942681 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8602bfde13c40aca705e4ba40a643ae', 'request_id': 'req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:39.965977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f admin admin] The token cache is being invalidate because project b8602bfde13c40aca705e4ba40a643ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:39.966469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:39.967319 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-27b9aa4d-f66d-4ca1-b91d-53e21b3c4a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:39.970228 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1037/2022] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:39 2022] DELETE /identity/v3/projects/b8602bfde13c40aca705e4ba40a643ae => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:39.975190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311324ac-9429-40e6-95f6-8060e5862beb None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:39.976263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311324ac-9429-40e6-95f6-8060e5862beb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:39.976630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311324ac-9429-40e6-95f6-8060e5862beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:39.998158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afd1ec-2815-472e-bad8-091064028b34 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:40.028627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-311324ac-9429-40e6-95f6-8060e5862beb None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:40.032249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-311324ac-9429-40e6-95f6-8060e5862beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:40.096164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2e239-88c6-4e2f-a39b-6df7fbffe5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:40.097284 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2e239-88c6-4e2f-a39b-6df7fbffe5cf admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.097589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2e239-88c6-4e2f-a39b-6df7fbffe5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.097905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2e239-88c6-4e2f-a39b-6df7fbffe5cf admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.098654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2e239-88c6-4e2f-a39b-6df7fbffe5cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:40.101220 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2e239-88c6-4e2f-a39b-6df7fbffe5cf admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:40.138975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 986/2023] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:39 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:40.138975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2e239-88c6-4e2f-a39b-6df7fbffe5cf admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:40.139321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-47b2e239-88c6-4e2f-a39b-6df7fbffe5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:40.147891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1038/2024] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:40.149170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311324ac-9429-40e6-95f6-8060e5862beb None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:40.150705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-311324ac-9429-40e6-95f6-8060e5862beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:40.158829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2e239-88c6-4e2f-a39b-6df7fbffe5cf admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:40.164077 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311324ac-9429-40e6-95f6-8060e5862beb None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:40.165000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:40.165869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.166159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.166555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] PATH_INFO: `/v3/projects/1a22891e645f4dbd899392f751b299ca` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.167806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a22891e645f4dbd899392f751b299ca)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:40.169722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:40.170273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134022fb-5d6c-43f1-9aba-505cf8118f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:40.171570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134022fb-5d6c-43f1-9aba-505cf8118f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.171857 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134022fb-5d6c-43f1-9aba-505cf8118f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.172136 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134022fb-5d6c-43f1-9aba-505cf8118f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.172897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134022fb-5d6c-43f1-9aba-505cf8118f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:40.174655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134022fb-5d6c-43f1-9aba-505cf8118f69 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:40.186091 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1039/2025] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:40.187899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bfeca-ba56-4558-8345-ac442d980024 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.187899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bfeca-ba56-4558-8345-ac442d980024 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.188150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bfeca-ba56-4558-8345-ac442d980024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.207141 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-dd3bfeca-ba56-4558-8345-ac442d980024 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:40.208467 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dd3bfeca-ba56-4558-8345-ac442d980024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:40.223651 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1040/2026] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:40.223651 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bfeca-ba56-4558-8345-ac442d980024 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:40.231823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bfeca-ba56-4558-8345-ac442d980024 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:40.235402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a22891e645f4dbd899392f751b299ca', 'request_id': 'req-d5607a5f-3889-448a-b6aa-63f6a5e150bf'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:40.252512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a22891e645f4dbd899392f751b299ca', 'request_id': 'req-d5607a5f-3889-448a-b6aa-63f6a5e150bf'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:40.277310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a22891e645f4dbd899392f751b299ca', 'request_id': 'req-d5607a5f-3889-448a-b6aa-63f6a5e150bf'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:40.294873 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] The token cache is being invalidate because project 1a22891e645f4dbd899392f751b299ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:40.295220 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:40.295896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:40.300903 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 987/2027] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:40 2022] DELETE /identity/v3/projects/1a22891e645f4dbd899392f751b299ca => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:40.300903 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:40.300903 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:40.309717 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c4324-9dc4-4ec0-93e3-ff597613187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:40.310961 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4324-9dc4-4ec0-93e3-ff597613187c admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.311490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4324-9dc4-4ec0-93e3-ff597613187c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.311912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c4324-9dc4-4ec0-93e3-ff597613187c admin admin] PATH_INFO: `/v3/projects/6788f80971704622bdb76e3de6dca51a/users/1af21daf33bd4c61a1174d5bff68d18e/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.313949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5607a5f-3889-448a-b6aa-63f6a5e150bf admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:40.319627 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689662f6-4b66-4723-be78-40310c4a04c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:40.320289 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689662f6-4b66-4723-be78-40310c4a04c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.321002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689662f6-4b66-4723-be78-40310c4a04c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.321283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689662f6-4b66-4723-be78-40310c4a04c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.322026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689662f6-4b66-4723-be78-40310c4a04c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:40.322324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689662f6-4b66-4723-be78-40310c4a04c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:40.323981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689662f6-4b66-4723-be78-40310c4a04c1 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:40.328750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c4324-9dc4-4ec0-93e3-ff597613187c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6788f80971704622bdb76e3de6dca51a, user_id=1af21daf33bd4c61a1174d5bff68d18e, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:40.331965 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c4324-9dc4-4ec0-93e3-ff597613187c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:40.336970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 988/2028] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:40.337893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689662f6-4b66-4723-be78-40310c4a04c1 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:40.340057 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-689662f6-4b66-4723-be78-40310c4a04c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:40.353013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689662f6-4b66-4723-be78-40310c4a04c1 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:40.357515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1041/2029] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:40 2022] PUT /identity/v3/projects/6788f80971704622bdb76e3de6dca51a/users/1af21daf33bd4c61a1174d5bff68d18e/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:40.357515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c4324-9dc4-4ec0-93e3-ff597613187c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:40.382814 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:40.400640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:40.438609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583c4ce-7f1a-4696-a575-e9438edb57ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:40.439606 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c4ce-7f1a-4696-a575-e9438edb57ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.439956 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c4ce-7f1a-4696-a575-e9438edb57ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.440301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583c4ce-7f1a-4696-a575-e9438edb57ed admin admin] PATH_INFO: `/v3/users/f64f68974e8f47adbb4a715dd2642725` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.441600 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583c4ce-7f1a-4696-a575-e9438edb57ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64f68974e8f47adbb4a715dd2642725)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:40.443816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583c4ce-7f1a-4696-a575-e9438edb57ed admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:40.472764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c4324-9dc4-4ec0-93e3-ff597613187c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:40.480333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e88dd-2b34-4eb2-a531-4d67c421fcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:40.481152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e88dd-2b34-4eb2-a531-4d67c421fcb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.481444 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e88dd-2b34-4eb2-a531-4d67c421fcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.481764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e88dd-2b34-4eb2-a531-4d67c421fcb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.482654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e88dd-2b34-4eb2-a531-4d67c421fcb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:40.484823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e88dd-2b34-4eb2-a531-4d67c421fcb6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:40.519619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-7583c4ce-7f1a-4696-a575-e9438edb57ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64f68974e8f47adbb4a715dd2642725'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:40.533189 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1042/2030] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:40 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:40.534233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e88dd-2b34-4eb2-a531-4d67c421fcb6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:40.535957 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-676e88dd-2b34-4eb2-a531-4d67c421fcb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:40.539002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-7583c4ce-7f1a-4696-a575-e9438edb57ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64f68974e8f47adbb4a715dd2642725'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:40.539761 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-7583c4ce-7f1a-4696-a575-e9438edb57ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64f68974e8f47adbb4a715dd2642725'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:40.548577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-7583c4ce-7f1a-4696-a575-e9438edb57ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64f68974e8f47adbb4a715dd2642725'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:40.549579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-7583c4ce-7f1a-4696-a575-e9438edb57ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64f68974e8f47adbb4a715dd2642725'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:40.568214 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 989/2031] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:40 2022] DELETE /identity/v3/users/f64f68974e8f47adbb4a715dd2642725 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:40.569405 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583c4ce-7f1a-4696-a575-e9438edb57ed admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:40.571050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7583c4ce-7f1a-4696-a575-e9438edb57ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:40.661817 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583c4ce-7f1a-4696-a575-e9438edb57ed admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:40.662917 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e88dd-2b34-4eb2-a531-4d67c421fcb6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:40.673873 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c9c56-2ba2-4627-9790-37bb5ea3a817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:40.680928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9c56-2ba2-4627-9790-37bb5ea3a817 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.682002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9c85d-066d-4e3f-9f97-c85a2cca150c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:40.682351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9c56-2ba2-4627-9790-37bb5ea3a817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.682645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9c56-2ba2-4627-9790-37bb5ea3a817 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.683409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c9c56-2ba2-4627-9790-37bb5ea3a817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:40.685614 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9c85d-066d-4e3f-9f97-c85a2cca150c admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.685917 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9c85d-066d-4e3f-9f97-c85a2cca150c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.686288 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9c85d-066d-4e3f-9f97-c85a2cca150c admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.686679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c9c56-2ba2-4627-9790-37bb5ea3a817 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:40.687051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9c85d-066d-4e3f-9f97-c85a2cca150c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:40.696012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9c85d-066d-4e3f-9f97-c85a2cca150c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:40.716571 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 990/2032] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:40 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:40.722949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c9c56-2ba2-4627-9790-37bb5ea3a817 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:40.728369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1043/2033] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:40.729492 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9c85d-066d-4e3f-9f97-c85a2cca150c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:40.735725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dfa9c85d-066d-4e3f-9f97-c85a2cca150c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:40.736750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c9c56-2ba2-4627-9790-37bb5ea3a817 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:40.742718 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47912761-1f99-4c90-8734-d5a10aeef954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:40.743443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47912761-1f99-4c90-8734-d5a10aeef954 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.744205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47912761-1f99-4c90-8734-d5a10aeef954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.744205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47912761-1f99-4c90-8734-d5a10aeef954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.744802 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47912761-1f99-4c90-8734-d5a10aeef954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:40.746442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47912761-1f99-4c90-8734-d5a10aeef954 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:40.751045 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9c85d-066d-4e3f-9f97-c85a2cca150c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:40.755746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fd5d9-a8e7-46c8-9fe7-7aeebd234857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:40.757654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fd5d9-a8e7-46c8-9fe7-7aeebd234857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.757806 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fd5d9-a8e7-46c8-9fe7-7aeebd234857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.758013 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fd5d9-a8e7-46c8-9fe7-7aeebd234857 admin admin] PATH_INFO: `/v3/projects/6788f80971704622bdb76e3de6dca51a/users/1af21daf33bd4c61a1174d5bff68d18e/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.758774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 991/2034] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:40.760414 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fd5d9-a8e7-46c8-9fe7-7aeebd234857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6788f80971704622bdb76e3de6dca51a, user_id=1af21daf33bd4c61a1174d5bff68d18e, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:40.762798 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47912761-1f99-4c90-8734-d5a10aeef954 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:40.763695 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fd5d9-a8e7-46c8-9fe7-7aeebd234857 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:40.785284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1044/2035] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:40 2022] PUT /identity/v3/projects/6788f80971704622bdb76e3de6dca51a/users/1af21daf33bd4c61a1174d5bff68d18e/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:40.785581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47912761-1f99-4c90-8734-d5a10aeef954 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:40.787336 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878bba7-5eac-4941-94cc-a770e09bb968 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.787649 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878bba7-5eac-4941-94cc-a770e09bb968 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.787995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878bba7-5eac-4941-94cc-a770e09bb968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.830589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:40.831847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d878bba7-5eac-4941-94cc-a770e09bb968 None None] MFA Rules not processed for user `1af21daf33bd4c61a1174d5bff68d18e`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:40.836665 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d878bba7-5eac-4941-94cc-a770e09bb968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:40.878138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23fac0-2efa-4625-bfc5-ce994470b37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:40.879140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23fac0-2efa-4625-bfc5-ce994470b37a admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.879656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23fac0-2efa-4625-bfc5-ce994470b37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.880105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23fac0-2efa-4625-bfc5-ce994470b37a admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.880950 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23fac0-2efa-4625-bfc5-ce994470b37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:40.884897 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23fac0-2efa-4625-bfc5-ce994470b37a admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:40.909027 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 992/2036] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:40.914174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23fac0-2efa-4625-bfc5-ce994470b37a admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:40.938522 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23fac0-2efa-4625-bfc5-ce994470b37a admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:40.948052 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b0da2-f31e-4321-9c04-2dae23d19074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:40.949193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b0da2-f31e-4321-9c04-2dae23d19074 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:40.949620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b0da2-f31e-4321-9c04-2dae23d19074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:40.949954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b0da2-f31e-4321-9c04-2dae23d19074 admin admin] PATH_INFO: `/v3/projects/9e1b5147f25842278e5f8af982b5c15a/users/048f39b24d3e4172964c5a5d4a144384/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:40.973026 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1045/2037] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:40.973506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b0da2-f31e-4321-9c04-2dae23d19074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e1b5147f25842278e5f8af982b5c15a, user_id=048f39b24d3e4172964c5a5d4a144384, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:40.977408 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b0da2-f31e-4321-9c04-2dae23d19074 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:41.012200 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 993/2038] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:40 2022] PUT /identity/v3/projects/9e1b5147f25842278e5f8af982b5c15a/users/048f39b24d3e4172964c5a5d4a144384/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:41.023292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d9f41-ae72-4ea0-b19b-a785477e6911 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:41.023935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d9f41-ae72-4ea0-b19b-a785477e6911 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:41.024249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d9f41-ae72-4ea0-b19b-a785477e6911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:41.044545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:41.047783 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b0da2-f31e-4321-9c04-2dae23d19074 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:41.049965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-040b0da2-f31e-4321-9c04-2dae23d19074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:41.079680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-286d9f41-ae72-4ea0-b19b-a785477e6911 None None] MFA Rules not processed for user `048f39b24d3e4172964c5a5d4a144384`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:41.081349 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-286d9f41-ae72-4ea0-b19b-a785477e6911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:41.166541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1046/2039] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:41.171028 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d9f41-ae72-4ea0-b19b-a785477e6911 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:41.183823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d9f41-ae72-4ea0-b19b-a785477e6911 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:41.189278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a423c8-2711-4244-b4cf-cfe0a0d4e50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:41.189945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a423c8-2711-4244-b4cf-cfe0a0d4e50d admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:41.190229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a423c8-2711-4244-b4cf-cfe0a0d4e50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:41.190503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a423c8-2711-4244-b4cf-cfe0a0d4e50d admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:41.191198 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a423c8-2711-4244-b4cf-cfe0a0d4e50d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:41.193146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a423c8-2711-4244-b4cf-cfe0a0d4e50d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:41.198818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b0da2-f31e-4321-9c04-2dae23d19074 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:41.215025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:41.216068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:41.216362 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:41.216641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8 admin admin] PATH_INFO: `/v3/projects/3442fc53847a4a1d84db06d626843424` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:41.221495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3442fc53847a4a1d84db06d626843424)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:41.223613 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:41.252421 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1047/2040] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:41 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:41.253257 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a423c8-2711-4244-b4cf-cfe0a0d4e50d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:41.301952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3442fc53847a4a1d84db06d626843424', 'request_id': 'req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:41.310078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3442fc53847a4a1d84db06d626843424', 'request_id': 'req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:41.323672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3442fc53847a4a1d84db06d626843424', 'request_id': 'req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:41.350718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a423c8-2711-4244-b4cf-cfe0a0d4e50d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:41.355886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8 admin admin] The token cache is being invalidate because project 3442fc53847a4a1d84db06d626843424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:41.356018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:41.357691 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-617b2edf-e04c-4ce4-b1cf-f1b7723b96a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:41.363598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 994/2041] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:41 2022] DELETE /identity/v3/projects/3442fc53847a4a1d84db06d626843424 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:41.368395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d808-9e06-445c-b3f5-2faad99602f5 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:41.368774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d808-9e06-445c-b3f5-2faad99602f5 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:41.369061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d808-9e06-445c-b3f5-2faad99602f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:41.400102 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-4640d808-9e06-445c-b3f5-2faad99602f5 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:41.401967 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4640d808-9e06-445c-b3f5-2faad99602f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:41.456374 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe7389-fb45-4715-8b37-8716f98aacf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:41.457065 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe7389-fb45-4715-8b37-8716f98aacf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:41.457356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe7389-fb45-4715-8b37-8716f98aacf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:41.457638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe7389-fb45-4715-8b37-8716f98aacf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:41.458851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe7389-fb45-4715-8b37-8716f98aacf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:41.461543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe7389-fb45-4715-8b37-8716f98aacf1 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:41.464369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:41.491836 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1048/2042] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:41 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:41.493710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe7389-fb45-4715-8b37-8716f98aacf1 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:41.495501 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0dfe7389-fb45-4715-8b37-8716f98aacf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:41.497761 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 995/2043] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:41.505413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660182c5-c8d7-4210-b817-7f335ca765f5 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:41.505699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660182c5-c8d7-4210-b817-7f335ca765f5 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:41.505975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660182c5-c8d7-4210-b817-7f335ca765f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:41.510189 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe7389-fb45-4715-8b37-8716f98aacf1 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:41.516968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d5167-9898-4016-ad7d-b3f6440bd6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:41.517652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d5167-9898-4016-ad7d-b3f6440bd6fe admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:41.517937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d5167-9898-4016-ad7d-b3f6440bd6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:41.518217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d5167-9898-4016-ad7d-b3f6440bd6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:41.519810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d5167-9898-4016-ad7d-b3f6440bd6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:41.521056 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d5167-9898-4016-ad7d-b3f6440bd6fe admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:41.524717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-660182c5-c8d7-4210-b817-7f335ca765f5 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:41.525932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-660182c5-c8d7-4210-b817-7f335ca765f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:41.527179 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:41.536894 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 996/2044] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:41.538427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1049/2045] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:41.539824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660182c5-c8d7-4210-b817-7f335ca765f5 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:41.545540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d5167-9898-4016-ad7d-b3f6440bd6fe admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:41.550863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660182c5-c8d7-4210-b817-7f335ca765f5 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:41.557165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b60f4-a9e8-439c-b9a3-34e6679a0e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:41.558068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b60f4-a9e8-439c-b9a3-34e6679a0e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:41.558352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b60f4-a9e8-439c-b9a3-34e6679a0e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:41.558785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b60f4-a9e8-439c-b9a3-34e6679a0e86 admin admin] PATH_INFO: `/v3/projects/28dd0644c4d24373b417cebf7695cf06/users/68d39ed77c5745cdaa072586d412b93d/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:41.560783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d5167-9898-4016-ad7d-b3f6440bd6fe admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:41.567392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80202b7-2a51-4ce1-b90e-f6dd853c717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:41.568317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80202b7-2a51-4ce1-b90e-f6dd853c717d admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:41.568669 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80202b7-2a51-4ce1-b90e-f6dd853c717d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:41.569057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80202b7-2a51-4ce1-b90e-f6dd853c717d admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:41.570650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80202b7-2a51-4ce1-b90e-f6dd853c717d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:41.571175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80202b7-2a51-4ce1-b90e-f6dd853c717d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:41.573941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80202b7-2a51-4ce1-b90e-f6dd853c717d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:41.577485 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b60f4-a9e8-439c-b9a3-34e6679a0e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28dd0644c4d24373b417cebf7695cf06, user_id=68d39ed77c5745cdaa072586d412b93d, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:41.580498 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b60f4-a9e8-439c-b9a3-34e6679a0e86 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:41.594074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1050/2046] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:41.596805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 997/2047] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:41 2022] PUT /identity/v3/projects/28dd0644c4d24373b417cebf7695cf06/users/68d39ed77c5745cdaa072586d412b93d/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:41.601222 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80202b7-2a51-4ce1-b90e-f6dd853c717d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:41.602519 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b60f4-a9e8-439c-b9a3-34e6679a0e86 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:41.619548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80202b7-2a51-4ce1-b90e-f6dd853c717d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:41.706912 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b60f4-a9e8-439c-b9a3-34e6679a0e86 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:41.712004 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b109a-0a1d-4a0b-8600-92e19fcb433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:41.712679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b109a-0a1d-4a0b-8600-92e19fcb433d admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:41.712962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b109a-0a1d-4a0b-8600-92e19fcb433d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:41.713237 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b109a-0a1d-4a0b-8600-92e19fcb433d admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:41.713965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b109a-0a1d-4a0b-8600-92e19fcb433d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:41.715741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b109a-0a1d-4a0b-8600-92e19fcb433d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:41.732681 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f033e-08c5-4f07-9478-7c2c0ab3b6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:41.734558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 998/2048] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:41.735899 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b109a-0a1d-4a0b-8600-92e19fcb433d admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:41.746280 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f033e-08c5-4f07-9478-7c2c0ab3b6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:41.746658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f033e-08c5-4f07-9478-7c2c0ab3b6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:41.746950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f033e-08c5-4f07-9478-7c2c0ab3b6a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:41.747768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f033e-08c5-4f07-9478-7c2c0ab3b6a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:41.752512 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f033e-08c5-4f07-9478-7c2c0ab3b6a3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:41.768614 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b109a-0a1d-4a0b-8600-92e19fcb433d admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:41.789813 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44d86a-42a5-4b38-9397-15ca5261ca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:41.790842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44d86a-42a5-4b38-9397-15ca5261ca40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:41.791224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44d86a-42a5-4b38-9397-15ca5261ca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:41.791616 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44d86a-42a5-4b38-9397-15ca5261ca40 admin admin] PATH_INFO: `/v3/projects/28dd0644c4d24373b417cebf7695cf06/users/68d39ed77c5745cdaa072586d412b93d/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:41.795518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1051/2049] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:41 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:41.795679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44d86a-42a5-4b38-9397-15ca5261ca40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28dd0644c4d24373b417cebf7695cf06, user_id=68d39ed77c5745cdaa072586d412b93d, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:41.797261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44d86a-42a5-4b38-9397-15ca5261ca40 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:41.798149 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f033e-08c5-4f07-9478-7c2c0ab3b6a3 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:41.824643 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 999/2050] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:41 2022] PUT /identity/v3/projects/28dd0644c4d24373b417cebf7695cf06/users/68d39ed77c5745cdaa072586d412b93d/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:41.841172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89868b-f7ec-4fac-a62f-10827cecd84a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:41.841559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89868b-f7ec-4fac-a62f-10827cecd84a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:41.841905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89868b-f7ec-4fac-a62f-10827cecd84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:41.878078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-7f89868b-f7ec-4fac-a62f-10827cecd84a None None] MFA Rules not processed for user `68d39ed77c5745cdaa072586d412b93d`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:41.880021 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7f89868b-f7ec-4fac-a62f-10827cecd84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:41.981084 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f033e-08c5-4f07-9478-7c2c0ab3b6a3 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:42.134285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1000/2051] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:42.146759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89868b-f7ec-4fac-a62f-10827cecd84a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:42.150820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7f89868b-f7ec-4fac-a62f-10827cecd84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:42.170083 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaba38-eee1-4b69-97df-220970aff4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:42.170798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaba38-eee1-4b69-97df-220970aff4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:42.173715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaba38-eee1-4b69-97df-220970aff4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:42.174042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaba38-eee1-4b69-97df-220970aff4f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:42.174760 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddaba38-eee1-4b69-97df-220970aff4f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:42.176749 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddaba38-eee1-4b69-97df-220970aff4f1 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:42.183320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:42.222620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1052/2052] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:41 2022] POST /identity/v3/users => generated 283 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:42.223617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaba38-eee1-4b69-97df-220970aff4f1 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:42.235773 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaba38-eee1-4b69-97df-220970aff4f1 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:42.242248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84da259-ffca-4017-9e95-54dc546fd4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:42.243575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84da259-ffca-4017-9e95-54dc546fd4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:42.252612 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84da259-ffca-4017-9e95-54dc546fd4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:42.252930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84da259-ffca-4017-9e95-54dc546fd4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:42.253718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84da259-ffca-4017-9e95-54dc546fd4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:42.255516 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84da259-ffca-4017-9e95-54dc546fd4f2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:42.259293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:42.287275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1053/2053] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:42.288448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84da259-ffca-4017-9e95-54dc546fd4f2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:42.298470 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89868b-f7ec-4fac-a62f-10827cecd84a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:42.303644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84da259-ffca-4017-9e95-54dc546fd4f2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:42.318905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc51bb-dda2-48ed-a0af-06bc2692d4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:42.321346 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc51bb-dda2-48ed-a0af-06bc2692d4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:42.322189 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc51bb-dda2-48ed-a0af-06bc2692d4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:42.322691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc51bb-dda2-48ed-a0af-06bc2692d4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:42.324583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc51bb-dda2-48ed-a0af-06bc2692d4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:42.326796 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bee405-1394-4461-b47a-496f34607d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:42.327555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bee405-1394-4461-b47a-496f34607d10 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:42.327850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bee405-1394-4461-b47a-496f34607d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:42.328245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bee405-1394-4461-b47a-496f34607d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:42.329766 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc51bb-dda2-48ed-a0af-06bc2692d4e5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:42.336750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c2bee405-1394-4461-b47a-496f34607d10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:42.353550 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1054/2054] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:42.358157 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc51bb-dda2-48ed-a0af-06bc2692d4e5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:42.371053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc51bb-dda2-48ed-a0af-06bc2692d4e5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:42.377574 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2be68f-aaf6-42cc-bb5e-ab8f72f6d5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:42.379966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2be68f-aaf6-42cc-bb5e-ab8f72f6d5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:42.381456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2be68f-aaf6-42cc-bb5e-ab8f72f6d5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:42.381456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2be68f-aaf6-42cc-bb5e-ab8f72f6d5bb admin admin] PATH_INFO: `/v3/projects/21444bcdad0e49599e794c0dd87ebd41/users/b42d6868013f4c91b30900ebe3922716/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:42.410995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2be68f-aaf6-42cc-bb5e-ab8f72f6d5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=21444bcdad0e49599e794c0dd87ebd41, user_id=b42d6868013f4c91b30900ebe3922716, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:42.413971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2be68f-aaf6-42cc-bb5e-ab8f72f6d5bb admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:42.434658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1055/2055] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:42 2022] PUT /identity/v3/projects/21444bcdad0e49599e794c0dd87ebd41/users/b42d6868013f4c91b30900ebe3922716/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:42.454166 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf8c25-2379-4b2b-97d1-7dc1f461640e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:42.454357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf8c25-2379-4b2b-97d1-7dc1f461640e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:42.455586 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf8c25-2379-4b2b-97d1-7dc1f461640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:42.489849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bee405-1394-4461-b47a-496f34607d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:42.493318 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bee405-1394-4461-b47a-496f34607d10 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:42.515990 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1001/2056] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:42.546019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a1cf8c25-2379-4b2b-97d1-7dc1f461640e None None] MFA Rules not processed for user `b42d6868013f4c91b30900ebe3922716`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:42.547460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a1cf8c25-2379-4b2b-97d1-7dc1f461640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:42.670311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1056/2057] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:42.677560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bee405-1394-4461-b47a-496f34607d10 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:42.693272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bee405-1394-4461-b47a-496f34607d10 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:42.815970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522cb21-d120-41b0-837f-40c148ce0e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:42.816654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522cb21-d120-41b0-837f-40c148ce0e39 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:42.816948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522cb21-d120-41b0-837f-40c148ce0e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:42.817283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522cb21-d120-41b0-837f-40c148ce0e39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:42.817988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522cb21-d120-41b0-837f-40c148ce0e39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:42.820535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522cb21-d120-41b0-837f-40c148ce0e39 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:42.859546 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1002/2058] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:42 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:42.863029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf8c25-2379-4b2b-97d1-7dc1f461640e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:42.876814 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf8c25-2379-4b2b-97d1-7dc1f461640e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:42.987553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d3b01-f591-4dc6-9444-a9f4c31abe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:42.988800 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d3b01-f591-4dc6-9444-a9f4c31abe0b admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:42.989500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d3b01-f591-4dc6-9444-a9f4c31abe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:42.989946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d3b01-f591-4dc6-9444-a9f4c31abe0b admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:42.992270 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d3b01-f591-4dc6-9444-a9f4c31abe0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:42.995116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d3b01-f591-4dc6-9444-a9f4c31abe0b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:43.066667 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1057/2059] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:42 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:43.070499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522cb21-d120-41b0-837f-40c148ce0e39 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:43.087448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522cb21-d120-41b0-837f-40c148ce0e39 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:43.102008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1604ae5-d274-439c-af5a-894ceddefd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:43.102703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1604ae5-d274-439c-af5a-894ceddefd94 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:43.102992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1604ae5-d274-439c-af5a-894ceddefd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:43.103273 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1604ae5-d274-439c-af5a-894ceddefd94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:43.104094 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1604ae5-d274-439c-af5a-894ceddefd94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:43.109360 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1604ae5-d274-439c-af5a-894ceddefd94 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:43.141147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1003/2060] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:43.142793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d3b01-f591-4dc6-9444-a9f4c31abe0b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:43.154784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d3b01-f591-4dc6-9444-a9f4c31abe0b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:43.164497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c439e3-f57d-4d60-ad98-11bdcd060cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:43.164497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c439e3-f57d-4d60-ad98-11bdcd060cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:43.164497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c439e3-f57d-4d60-ad98-11bdcd060cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:43.164497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c439e3-f57d-4d60-ad98-11bdcd060cdc admin admin] PATH_INFO: `/v3/projects/d1d936e20e5a4b66bf174a4bdf22a24e/users/13f25aba078348fd98f79d36f6d8f0a7/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:43.181911 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c439e3-f57d-4d60-ad98-11bdcd060cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d936e20e5a4b66bf174a4bdf22a24e, user_id=13f25aba078348fd98f79d36f6d8f0a7, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:43.185327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c439e3-f57d-4d60-ad98-11bdcd060cdc admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:43.205959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1058/2061] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:43 2022] PUT /identity/v3/projects/d1d936e20e5a4b66bf174a4bdf22a24e/users/13f25aba078348fd98f79d36f6d8f0a7/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:43.210056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1604ae5-d274-439c-af5a-894ceddefd94 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:43.228209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1604ae5-d274-439c-af5a-894ceddefd94 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:43.292432 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:43.320786 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdbefb-506c-4dfd-b7b4-b17fd1ecc84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:43.322049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdbefb-506c-4dfd-b7b4-b17fd1ecc84b admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:43.323726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdbefb-506c-4dfd-b7b4-b17fd1ecc84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:43.324039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdbefb-506c-4dfd-b7b4-b17fd1ecc84b admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:43.324816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdbefb-506c-4dfd-b7b4-b17fd1ecc84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:43.339800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdbefb-506c-4dfd-b7b4-b17fd1ecc84b admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:43.347644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1004/2062] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:43.349724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c439e3-f57d-4d60-ad98-11bdcd060cdc admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:43.364287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c439e3-f57d-4d60-ad98-11bdcd060cdc admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:43.372658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e137-c86b-49a5-85ec-ea697526883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:43.374338 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e137-c86b-49a5-85ec-ea697526883f admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:43.375103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e137-c86b-49a5-85ec-ea697526883f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:43.376309 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e137-c86b-49a5-85ec-ea697526883f admin admin] PATH_INFO: `/v3/projects/d1d936e20e5a4b66bf174a4bdf22a24e/users/13f25aba078348fd98f79d36f6d8f0a7/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:43.379517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792e137-c86b-49a5-85ec-ea697526883f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d936e20e5a4b66bf174a4bdf22a24e, user_id=13f25aba078348fd98f79d36f6d8f0a7, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:43.383085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792e137-c86b-49a5-85ec-ea697526883f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:43.399113 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1059/2063] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:43 2022] PUT /identity/v3/projects/d1d936e20e5a4b66bf174a4bdf22a24e/users/13f25aba078348fd98f79d36f6d8f0a7/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:43.415648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71878536-5400-4b2f-a143-54e22764bf9f None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:43.415648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71878536-5400-4b2f-a143-54e22764bf9f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:43.415648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71878536-5400-4b2f-a143-54e22764bf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:43.453618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-71878536-5400-4b2f-a143-54e22764bf9f None None] MFA Rules not processed for user `13f25aba078348fd98f79d36f6d8f0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:43.455268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-71878536-5400-4b2f-a143-54e22764bf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:43.551671 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1005/2064] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:43.565838 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e137-c86b-49a5-85ec-ea697526883f admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:43.568264 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71878536-5400-4b2f-a143-54e22764bf9f None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:43.569941 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-71878536-5400-4b2f-a143-54e22764bf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:43.575506 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:43.640319 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e137-c86b-49a5-85ec-ea697526883f admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:43.644754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6a364-9cdc-4d3d-962c-873fc168d37a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:43.645463 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a364-9cdc-4d3d-962c-873fc168d37a service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:43.645749 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a364-9cdc-4d3d-962c-873fc168d37a service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:43.646028 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a364-9cdc-4d3d-962c-873fc168d37a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:43.648891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71878536-5400-4b2f-a143-54e22764bf9f None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:43.653508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefcdeb-f0f5-49bb-a01d-5ab17b692116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:43.654626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefcdeb-f0f5-49bb-a01d-5ab17b692116 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:43.654840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefcdeb-f0f5-49bb-a01d-5ab17b692116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:43.655111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefcdeb-f0f5-49bb-a01d-5ab17b692116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:43.657021 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6eefcdeb-f0f5-49bb-a01d-5ab17b692116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:43.665202 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6a364-9cdc-4d3d-962c-873fc168d37a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:43.666804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6a364-9cdc-4d3d-962c-873fc168d37a service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:43.687836 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1060/2065] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:43.739090 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefcdeb-f0f5-49bb-a01d-5ab17b692116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:43.740615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefcdeb-f0f5-49bb-a01d-5ab17b692116 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:43.751966 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1006/2066] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:44.576106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6a364-9cdc-4d3d-962c-873fc168d37a service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:44.700708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6a364-9cdc-4d3d-962c-873fc168d37a service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:44.710351 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cbf0d-79ee-4490-a0c0-a143caf47011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:44.711263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cbf0d-79ee-4490-a0c0-a143caf47011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:44.711577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cbf0d-79ee-4490-a0c0-a143caf47011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:44.713419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cbf0d-79ee-4490-a0c0-a143caf47011 admin admin] PATH_INFO: `/v3/users/b42d6868013f4c91b30900ebe3922716` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:44.715008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cbf0d-79ee-4490-a0c0-a143caf47011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42d6868013f4c91b30900ebe3922716)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:44.719257 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cbf0d-79ee-4490-a0c0-a143caf47011 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:44.843859 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-651cbf0d-79ee-4490-a0c0-a143caf47011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42d6868013f4c91b30900ebe3922716'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:44.855885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefcdeb-f0f5-49bb-a01d-5ab17b692116 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:44.857469 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6eefcdeb-f0f5-49bb-a01d-5ab17b692116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:44.883339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-651cbf0d-79ee-4490-a0c0-a143caf47011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42d6868013f4c91b30900ebe3922716'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:44.884007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefcdeb-f0f5-49bb-a01d-5ab17b692116 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:44.885099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-651cbf0d-79ee-4490-a0c0-a143caf47011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42d6868013f4c91b30900ebe3922716'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:44.898517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309c8ec-57ec-45db-b7bf-e3018e234feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:44.899495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309c8ec-57ec-45db-b7bf-e3018e234feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:44.899940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309c8ec-57ec-45db-b7bf-e3018e234feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:44.900224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309c8ec-57ec-45db-b7bf-e3018e234feb admin admin] PATH_INFO: `/v3/users/e1a8bd6de53c4c308de21fbb21e38062` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:44.901524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309c8ec-57ec-45db-b7bf-e3018e234feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a8bd6de53c4c308de21fbb21e38062)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:44.903892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309c8ec-57ec-45db-b7bf-e3018e234feb admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:44.909897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-651cbf0d-79ee-4490-a0c0-a143caf47011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42d6868013f4c91b30900ebe3922716'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:44.922879 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-651cbf0d-79ee-4490-a0c0-a143caf47011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42d6868013f4c91b30900ebe3922716'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:44.929325 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:44.934212 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1061/2067] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:44 2022] DELETE /identity/v3/users/b42d6868013f4c91b30900ebe3922716 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:44.939841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c962a3b-062a-4b5b-a588-9fcf8df5d195 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:44.941168 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c962a3b-062a-4b5b-a588-9fcf8df5d195 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:44.941168 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c962a3b-062a-4b5b-a588-9fcf8df5d195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:44.966278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7c962a3b-062a-4b5b-a588-9fcf8df5d195 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:44.967751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7c962a3b-062a-4b5b-a588-9fcf8df5d195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:44.991829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f309c8ec-57ec-45db-b7bf-e3018e234feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a8bd6de53c4c308de21fbb21e38062'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:44.993714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:45.010787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f309c8ec-57ec-45db-b7bf-e3018e234feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a8bd6de53c4c308de21fbb21e38062'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:45.012216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f309c8ec-57ec-45db-b7bf-e3018e234feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a8bd6de53c4c308de21fbb21e38062'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:45.025471 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f309c8ec-57ec-45db-b7bf-e3018e234feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a8bd6de53c4c308de21fbb21e38062'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:45.026594 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f309c8ec-57ec-45db-b7bf-e3018e234feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a8bd6de53c4c308de21fbb21e38062'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:45.046962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1007/2068] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:44 2022] DELETE /identity/v3/users/e1a8bd6de53c4c308de21fbb21e38062 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:45.080732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1062/2069] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:45.092717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309c8ec-57ec-45db-b7bf-e3018e234feb admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:45.094031 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f309c8ec-57ec-45db-b7bf-e3018e234feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:45.173674 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309c8ec-57ec-45db-b7bf-e3018e234feb admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:45.178664 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de137d4-089d-48a2-b578-d5e4876b9a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:45.179538 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de137d4-089d-48a2-b578-d5e4876b9a3d service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:45.180752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de137d4-089d-48a2-b578-d5e4876b9a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:45.180752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de137d4-089d-48a2-b578-d5e4876b9a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:45.257390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de137d4-089d-48a2-b578-d5e4876b9a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:45.258847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de137d4-089d-48a2-b578-d5e4876b9a3d service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:45.270184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1008/2070] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:45.371419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c962a3b-062a-4b5b-a588-9fcf8df5d195 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:45.372867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7c962a3b-062a-4b5b-a588-9fcf8df5d195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:45.384934 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c962a3b-062a-4b5b-a588-9fcf8df5d195 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:45.390518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788056e-ae3f-4d2c-bf84-576949a42b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:45.391398 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788056e-ae3f-4d2c-bf84-576949a42b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:45.391721 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788056e-ae3f-4d2c-bf84-576949a42b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:45.392074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788056e-ae3f-4d2c-bf84-576949a42b05 admin admin] PATH_INFO: `/v3/projects/b41db46ea7f5484c84b35a033bc0406e` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:45.393316 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788056e-ae3f-4d2c-bf84-576949a42b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41db46ea7f5484c84b35a033bc0406e)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:45.395151 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788056e-ae3f-4d2c-bf84-576949a42b05 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:45.456849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de137d4-089d-48a2-b578-d5e4876b9a3d service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:45.458558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-9de137d4-089d-48a2-b578-d5e4876b9a3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:45.460628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8788056e-ae3f-4d2c-bf84-576949a42b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41db46ea7f5484c84b35a033bc0406e', 'request_id': 'req-8788056e-ae3f-4d2c-bf84-576949a42b05'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:45.469253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8788056e-ae3f-4d2c-bf84-576949a42b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41db46ea7f5484c84b35a033bc0406e', 'request_id': 'req-8788056e-ae3f-4d2c-bf84-576949a42b05'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:45.474177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de137d4-089d-48a2-b578-d5e4876b9a3d service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:45.481186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8788056e-ae3f-4d2c-bf84-576949a42b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41db46ea7f5484c84b35a033bc0406e', 'request_id': 'req-8788056e-ae3f-4d2c-bf84-576949a42b05'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:45.496680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8788056e-ae3f-4d2c-bf84-576949a42b05 admin admin] The token cache is being invalidate because project b41db46ea7f5484c84b35a033bc0406e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:45.497194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8788056e-ae3f-4d2c-bf84-576949a42b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:45.498070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-8788056e-ae3f-4d2c-bf84-576949a42b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:45.501593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1063/2071] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:45 2022] DELETE /identity/v3/projects/b41db46ea7f5484c84b35a033bc0406e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:45.507685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccec9b-53ff-460a-a6c7-365c2af4099c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:45.508110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccec9b-53ff-460a-a6c7-365c2af4099c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:45.508522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccec9b-53ff-460a-a6c7-365c2af4099c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:45.529303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:45.530449 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-06ccec9b-53ff-460a-a6c7-365c2af4099c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:45.532810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-06ccec9b-53ff-460a-a6c7-365c2af4099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:45.566451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9a963-1028-4870-a216-8d52854cc21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:45.567451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9a963-1028-4870-a216-8d52854cc21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:45.567809 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9a963-1028-4870-a216-8d52854cc21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:45.568369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9a963-1028-4870-a216-8d52854cc21d admin admin] PATH_INFO: `/v3/users/048f39b24d3e4172964c5a5d4a144384` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:45.570726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9a963-1028-4870-a216-8d52854cc21d admin admin] RBAC: Authorizing `identity:delete_user(user_id=048f39b24d3e4172964c5a5d4a144384)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:45.572851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9a963-1028-4870-a216-8d52854cc21d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:45.669617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d3c9a963-1028-4870-a216-8d52854cc21d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048f39b24d3e4172964c5a5d4a144384'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:45.684889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1064/2072] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:45.687839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27cc2a-d10a-4f67-804e-874c1a5e580b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:45.688307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27cc2a-d10a-4f67-804e-874c1a5e580b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:45.688737 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27cc2a-d10a-4f67-804e-874c1a5e580b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:45.697766 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d3c9a963-1028-4870-a216-8d52854cc21d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048f39b24d3e4172964c5a5d4a144384'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:45.698941 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d3c9a963-1028-4870-a216-8d52854cc21d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048f39b24d3e4172964c5a5d4a144384'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:45.708690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-cd27cc2a-d10a-4f67-804e-874c1a5e580b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:45.710919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cd27cc2a-d10a-4f67-804e-874c1a5e580b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:45.712367 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d3c9a963-1028-4870-a216-8d52854cc21d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048f39b24d3e4172964c5a5d4a144384'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:45.713058 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d3c9a963-1028-4870-a216-8d52854cc21d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048f39b24d3e4172964c5a5d4a144384'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:45.720977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1065/2073] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:45.726323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27cc2a-d10a-4f67-804e-874c1a5e580b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:45.737347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27cc2a-d10a-4f67-804e-874c1a5e580b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:45.743449 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f08cf9-3f6c-4fe9-92ba-ac058e73cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:45.744525 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f08cf9-3f6c-4fe9-92ba-ac058e73cd00 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:45.744638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1009/2074] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:45 2022] DELETE /identity/v3/users/048f39b24d3e4172964c5a5d4a144384 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:45.745261 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f08cf9-3f6c-4fe9-92ba-ac058e73cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:45.745840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f08cf9-3f6c-4fe9-92ba-ac058e73cd00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:45.746718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f08cf9-3f6c-4fe9-92ba-ac058e73cd00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:45.747545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f08cf9-3f6c-4fe9-92ba-ac058e73cd00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:45.749320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f08cf9-3f6c-4fe9-92ba-ac058e73cd00 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:45.749439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd0446-7104-4c44-b410-6705237ff1ff None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:45.750116 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd0446-7104-4c44-b410-6705237ff1ff None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:45.751847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd0446-7104-4c44-b410-6705237ff1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:45.764904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1066/2075] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:45.769625 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f08cf9-3f6c-4fe9-92ba-ac058e73cd00 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:45.785054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f08cf9-3f6c-4fe9-92ba-ac058e73cd00 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:45.788579 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-b4fd0446-7104-4c44-b410-6705237ff1ff None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:45.789810 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b4fd0446-7104-4c44-b410-6705237ff1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:45.847199 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:45.926631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c32cdb-a596-4b76-b6a1-e74185f0496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:45.926631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c32cdb-a596-4b76-b6a1-e74185f0496b admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:45.926631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c32cdb-a596-4b76-b6a1-e74185f0496b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:45.926982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c32cdb-a596-4b76-b6a1-e74185f0496b admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:45.927603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c32cdb-a596-4b76-b6a1-e74185f0496b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:45.927938 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1010/2076] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:45.929444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd0446-7104-4c44-b410-6705237ff1ff None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:45.929678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c32cdb-a596-4b76-b6a1-e74185f0496b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:45.932350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b4fd0446-7104-4c44-b410-6705237ff1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:45.955107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd0446-7104-4c44-b410-6705237ff1ff None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:45.961843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:45.962965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:45.963487 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:45.963957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] PATH_INFO: `/v3/projects/21444bcdad0e49599e794c0dd87ebd41` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:45.964089 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1067/2077] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:45 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:45.965156 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c32cdb-a596-4b76-b6a1-e74185f0496b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:45.965828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] RBAC: Authorizing `identity:delete_project(project_id=21444bcdad0e49599e794c0dd87ebd41)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:45.967998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-13c32cdb-a596-4b76-b6a1-e74185f0496b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:45.968348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:46.064839 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21444bcdad0e49599e794c0dd87ebd41', 'request_id': 'req-07543dc3-e0f5-463d-81ee-11dc4e33017d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.074909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21444bcdad0e49599e794c0dd87ebd41', 'request_id': 'req-07543dc3-e0f5-463d-81ee-11dc4e33017d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.077805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:46.086852 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21444bcdad0e49599e794c0dd87ebd41', 'request_id': 'req-07543dc3-e0f5-463d-81ee-11dc4e33017d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.090175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c32cdb-a596-4b76-b6a1-e74185f0496b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:46.111210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] The token cache is being invalidate because project 21444bcdad0e49599e794c0dd87ebd41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:46.112237 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.114394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.121593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1011/2078] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:45 2022] DELETE /identity/v3/projects/21444bcdad0e49599e794c0dd87ebd41 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:46.121593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:46.124828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:46.180533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f220f5-ffba-4d27-9a02-6ea1f6ddf9bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:46.181303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f220f5-ffba-4d27-9a02-6ea1f6ddf9bf service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:46.181715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f220f5-ffba-4d27-9a02-6ea1f6ddf9bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:46.182079 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f220f5-ffba-4d27-9a02-6ea1f6ddf9bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:46.185997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-01f220f5-ffba-4d27-9a02-6ea1f6ddf9bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:46.231076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07543dc3-e0f5-463d-81ee-11dc4e33017d admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:46.239059 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb35c69-7a87-43f9-9445-f9f32f96f8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:46.239790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb35c69-7a87-43f9-9445-f9f32f96f8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:46.240248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb35c69-7a87-43f9-9445-f9f32f96f8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:46.240755 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb35c69-7a87-43f9-9445-f9f32f96f8a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:46.241636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb35c69-7a87-43f9-9445-f9f32f96f8a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:46.244329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb35c69-7a87-43f9-9445-f9f32f96f8a7 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:46.275996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1012/2079] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:46 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:46.277856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb35c69-7a87-43f9-9445-f9f32f96f8a7 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:46.281333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8bb35c69-7a87-43f9-9445-f9f32f96f8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:46.303306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb35c69-7a87-43f9-9445-f9f32f96f8a7 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:46.309621 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f220f5-ffba-4d27-9a02-6ea1f6ddf9bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:46.311367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f220f5-ffba-4d27-9a02-6ea1f6ddf9bf service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:46.312333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc4d34-3f61-4020-bc55-8bce2814f0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:46.313632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc4d34-3f61-4020-bc55-8bce2814f0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:46.313632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc4d34-3f61-4020-bc55-8bce2814f0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:46.313935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc4d34-3f61-4020-bc55-8bce2814f0a4 admin admin] PATH_INFO: `/v3/users/13f25aba078348fd98f79d36f6d8f0a7` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:46.315315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc4d34-3f61-4020-bc55-8bce2814f0a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f25aba078348fd98f79d36f6d8f0a7)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:46.317965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc4d34-3f61-4020-bc55-8bce2814f0a4 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:46.323412 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1068/2080] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:46.324438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f220f5-ffba-4d27-9a02-6ea1f6ddf9bf service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:46.336702 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f220f5-ffba-4d27-9a02-6ea1f6ddf9bf service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:46.343250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d48dd-0de3-42ae-8cae-6a9d10d44d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:46.343970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d48dd-0de3-42ae-8cae-6a9d10d44d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:46.344253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d48dd-0de3-42ae-8cae-6a9d10d44d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:46.344528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d48dd-0de3-42ae-8cae-6a9d10d44d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:46.346333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d48dd-0de3-42ae-8cae-6a9d10d44d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:46.349180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d48dd-0de3-42ae-8cae-6a9d10d44d13 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:46.362475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1069/2081] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:46.367096 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d48dd-0de3-42ae-8cae-6a9d10d44d13 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:46.384113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-bbdc4d34-3f61-4020-bc55-8bce2814f0a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f25aba078348fd98f79d36f6d8f0a7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.384652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d48dd-0de3-42ae-8cae-6a9d10d44d13 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:46.396107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b8a15-3434-4fe8-9a08-e82421caa078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:46.396949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b8a15-3434-4fe8-9a08-e82421caa078 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:46.397436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b8a15-3434-4fe8-9a08-e82421caa078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:46.397820 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b8a15-3434-4fe8-9a08-e82421caa078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:46.400019 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-bbdc4d34-3f61-4020-bc55-8bce2814f0a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f25aba078348fd98f79d36f6d8f0a7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.402099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-bbdc4d34-3f61-4020-bc55-8bce2814f0a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f25aba078348fd98f79d36f6d8f0a7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.406476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b8a15-3434-4fe8-9a08-e82421caa078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:46.408753 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b8a15-3434-4fe8-9a08-e82421caa078 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:46.415209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-bbdc4d34-3f61-4020-bc55-8bce2814f0a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f25aba078348fd98f79d36f6d8f0a7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.416155 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-bbdc4d34-3f61-4020-bc55-8bce2814f0a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f25aba078348fd98f79d36f6d8f0a7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.431982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:46.436802 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1013/2082] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:46 2022] DELETE /identity/v3/users/13f25aba078348fd98f79d36f6d8f0a7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:46.446146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1070/2083] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:46.449541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc4d34-3f61-4020-bc55-8bce2814f0a4 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:46.452040 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-bbdc4d34-3f61-4020-bc55-8bce2814f0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:46.528232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:46.565152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc4d34-3f61-4020-bc55-8bce2814f0a4 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:46.573260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c57a1-0954-4076-9f60-c23b0ad1e568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:46.574602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c57a1-0954-4076-9f60-c23b0ad1e568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:46.575371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c57a1-0954-4076-9f60-c23b0ad1e568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:46.575847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c57a1-0954-4076-9f60-c23b0ad1e568 admin admin] PATH_INFO: `/v3/projects/8ad63b720a0044a7bcb0cb1d8628ad09/users/0d6ad1725257401888617fdcf7e57386/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:46.597392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c57a1-0954-4076-9f60-c23b0ad1e568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad63b720a0044a7bcb0cb1d8628ad09, user_id=0d6ad1725257401888617fdcf7e57386, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:46.600649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c57a1-0954-4076-9f60-c23b0ad1e568 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:46.627618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1014/2084] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:46 2022] PUT /identity/v3/projects/8ad63b720a0044a7bcb0cb1d8628ad09/users/0d6ad1725257401888617fdcf7e57386/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:46.632800 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d897e-60ba-4b37-9110-4a44ae4854f8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:46.634103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d897e-60ba-4b37-9110-4a44ae4854f8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:46.634533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d897e-60ba-4b37-9110-4a44ae4854f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:46.664649 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c68d897e-60ba-4b37-9110-4a44ae4854f8 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:46.666016 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c68d897e-60ba-4b37-9110-4a44ae4854f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:46.720005 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c57a1-0954-4076-9f60-c23b0ad1e568 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:46.722331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-477c57a1-0954-4076-9f60-c23b0ad1e568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:46.770587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1071/2085] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:46.771724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d897e-60ba-4b37-9110-4a44ae4854f8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:46.773326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c68d897e-60ba-4b37-9110-4a44ae4854f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:46.860580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d897e-60ba-4b37-9110-4a44ae4854f8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:46.865279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e5466-1888-4d14-9c1d-4c730924e86f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:46.866105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e5466-1888-4d14-9c1d-4c730924e86f service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:46.866959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e5466-1888-4d14-9c1d-4c730924e86f service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:46.867825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e5466-1888-4d14-9c1d-4c730924e86f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:46.867971 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c57a1-0954-4076-9f60-c23b0ad1e568 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:46.869553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e47e5466-1888-4d14-9c1d-4c730924e86f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:46.875263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8903a7-3813-4888-a3db-29fbf8dea6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:46.877280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8903a7-3813-4888-a3db-29fbf8dea6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:46.878352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8903a7-3813-4888-a3db-29fbf8dea6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:46.879100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8903a7-3813-4888-a3db-29fbf8dea6f4 admin admin] PATH_INFO: `/v3/users/ed011be1cf274d478c8c3078a695ed1f` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:46.883946 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8903a7-3813-4888-a3db-29fbf8dea6f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed011be1cf274d478c8c3078a695ed1f)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:46.885901 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8903a7-3813-4888-a3db-29fbf8dea6f4 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:46.945386 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4d8903a7-3813-4888-a3db-29fbf8dea6f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed011be1cf274d478c8c3078a695ed1f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.971240 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4d8903a7-3813-4888-a3db-29fbf8dea6f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed011be1cf274d478c8c3078a695ed1f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.972660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4d8903a7-3813-4888-a3db-29fbf8dea6f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed011be1cf274d478c8c3078a695ed1f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.982003 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4d8903a7-3813-4888-a3db-29fbf8dea6f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed011be1cf274d478c8c3078a695ed1f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.982537 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e5466-1888-4d14-9c1d-4c730924e86f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:46.983104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4d8903a7-3813-4888-a3db-29fbf8dea6f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed011be1cf274d478c8c3078a695ed1f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:46.983930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e5466-1888-4d14-9c1d-4c730924e86f service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:46.994976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1072/2086] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:46.995926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e5466-1888-4d14-9c1d-4c730924e86f service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:46.997326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e47e5466-1888-4d14-9c1d-4c730924e86f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:46.999283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1015/2087] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:46 2022] DELETE /identity/v3/users/ed011be1cf274d478c8c3078a695ed1f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:47.000484 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8903a7-3813-4888-a3db-29fbf8dea6f4 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:47.004183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4d8903a7-3813-4888-a3db-29fbf8dea6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:47.069881 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:47.085929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8903a7-3813-4888-a3db-29fbf8dea6f4 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:47.092806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f079b-f076-44d8-b9ad-fdc6124054f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:47.093832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f079b-f076-44d8-b9ad-fdc6124054f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:47.094103 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f079b-f076-44d8-b9ad-fdc6124054f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:47.095830 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f079b-f076-44d8-b9ad-fdc6124054f7 admin admin] PATH_INFO: `/v3/projects/9e1b5147f25842278e5f8af982b5c15a` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:47.097065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f079b-f076-44d8-b9ad-fdc6124054f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e1b5147f25842278e5f8af982b5c15a)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:47.097480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e5466-1888-4d14-9c1d-4c730924e86f service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:47.099722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f079b-f076-44d8-b9ad-fdc6124054f7 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:47.105244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:47.155761 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5b7f079b-f076-44d8-b9ad-fdc6124054f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e1b5147f25842278e5f8af982b5c15a', 'request_id': 'req-5b7f079b-f076-44d8-b9ad-fdc6124054f7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.163652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5b7f079b-f076-44d8-b9ad-fdc6124054f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e1b5147f25842278e5f8af982b5c15a', 'request_id': 'req-5b7f079b-f076-44d8-b9ad-fdc6124054f7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.167637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179d04a-bf2a-4365-8000-564c5e6b488a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:47.168519 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179d04a-bf2a-4365-8000-564c5e6b488a service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:47.173884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179d04a-bf2a-4365-8000-564c5e6b488a service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:47.173884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179d04a-bf2a-4365-8000-564c5e6b488a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:47.173884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3179d04a-bf2a-4365-8000-564c5e6b488a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:47.176846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5b7f079b-f076-44d8-b9ad-fdc6124054f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e1b5147f25842278e5f8af982b5c15a', 'request_id': 'req-5b7f079b-f076-44d8-b9ad-fdc6124054f7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.187545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179d04a-bf2a-4365-8000-564c5e6b488a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:47.187545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179d04a-bf2a-4365-8000-564c5e6b488a service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:47.200145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5b7f079b-f076-44d8-b9ad-fdc6124054f7 admin admin] The token cache is being invalidate because project 9e1b5147f25842278e5f8af982b5c15a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:47.200959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5b7f079b-f076-44d8-b9ad-fdc6124054f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.202304 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5b7f079b-f076-44d8-b9ad-fdc6124054f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.204782 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1073/2088] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:47.205282 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1016/2089] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:46 2022] DELETE /identity/v3/projects/9e1b5147f25842278e5f8af982b5c15a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:47.206247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179d04a-bf2a-4365-8000-564c5e6b488a service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:47.207746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3179d04a-bf2a-4365-8000-564c5e6b488a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:47.207928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3d462-5e54-4e87-be73-7d33f0c065f4 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:47.208564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3d462-5e54-4e87-be73-7d33f0c065f4 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:47.209126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3d462-5e54-4e87-be73-7d33f0c065f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:47.223819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179d04a-bf2a-4365-8000-564c5e6b488a service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:47.238518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-70a3d462-5e54-4e87-be73-7d33f0c065f4 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:47.252423 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-70a3d462-5e54-4e87-be73-7d33f0c065f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:47.345995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1017/2090] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:47.347347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3d462-5e54-4e87-be73-7d33f0c065f4 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:47.348751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-70a3d462-5e54-4e87-be73-7d33f0c065f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:47.361942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:47.363118 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:47.363596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:47.364067 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3d462-5e54-4e87-be73-7d33f0c065f4 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:47.364393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] PATH_INFO: `/v3/projects/d1d936e20e5a4b66bf174a4bdf22a24e` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:47.366335 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d936e20e5a4b66bf174a4bdf22a24e)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:47.370847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:47.371326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765c0ea-006e-4e5e-ac5c-cc665a495798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:47.372677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c0ea-006e-4e5e-ac5c-cc665a495798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:47.373463 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c0ea-006e-4e5e-ac5c-cc665a495798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:47.373880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765c0ea-006e-4e5e-ac5c-cc665a495798 admin admin] PATH_INFO: `/v3/users/68d39ed77c5745cdaa072586d412b93d` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:47.376439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765c0ea-006e-4e5e-ac5c-cc665a495798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d39ed77c5745cdaa072586d412b93d)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:47.378543 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765c0ea-006e-4e5e-ac5c-cc665a495798 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:47.467017 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1765c0ea-006e-4e5e-ac5c-cc665a495798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d39ed77c5745cdaa072586d412b93d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.476977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d936e20e5a4b66bf174a4bdf22a24e', 'request_id': 'req-398c13c2-323a-4f6b-9e8d-84d990caebe9'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.485115 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d936e20e5a4b66bf174a4bdf22a24e', 'request_id': 'req-398c13c2-323a-4f6b-9e8d-84d990caebe9'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.494264 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d936e20e5a4b66bf174a4bdf22a24e', 'request_id': 'req-398c13c2-323a-4f6b-9e8d-84d990caebe9'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.503978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1765c0ea-006e-4e5e-ac5c-cc665a495798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d39ed77c5745cdaa072586d412b93d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.504761 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1765c0ea-006e-4e5e-ac5c-cc665a495798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d39ed77c5745cdaa072586d412b93d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.510184 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] The token cache is being invalidate because project d1d936e20e5a4b66bf174a4bdf22a24e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:47.510574 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.512101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.513770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1074/2091] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:47 2022] DELETE /identity/v3/projects/d1d936e20e5a4b66bf174a4bdf22a24e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:47.517522 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1765c0ea-006e-4e5e-ac5c-cc665a495798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d39ed77c5745cdaa072586d412b93d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.517960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:47.518474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1765c0ea-006e-4e5e-ac5c-cc665a495798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d39ed77c5745cdaa072586d412b93d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:47.519441 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:47.521737 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:47.539912 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1018/2092] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:47 2022] DELETE /identity/v3/users/68d39ed77c5745cdaa072586d412b93d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:47.540711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765c0ea-006e-4e5e-ac5c-cc665a495798 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:47.542901 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1765c0ea-006e-4e5e-ac5c-cc665a495798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:47.579434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:47.604599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c13c2-323a-4f6b-9e8d-84d990caebe9 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:47.650414 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765c0ea-006e-4e5e-ac5c-cc665a495798 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:47.660413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc41e01-f25e-4391-806f-a000ef480a61 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af21daf33bd4c61a1174d5bff68d18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6788f80971704622bdb76e3de6dca51a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:47.661327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc41e01-f25e-4391-806f-a000ef480a61 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:47.661635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc41e01-f25e-4391-806f-a000ef480a61 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:47.662098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc41e01-f25e-4391-806f-a000ef480a61 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:47.662969 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc41e01-f25e-4391-806f-a000ef480a61 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:47.663406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc41e01-f25e-4391-806f-a000ef480a61 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:47.665330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc41e01-f25e-4391-806f-a000ef480a61 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:47.692973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1019/2093] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:47.692973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dd0b9-d58c-4680-bc64-7158e14ca6e0 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:47.692973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dd0b9-d58c-4680-bc64-7158e14ca6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:47.692973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dd0b9-d58c-4680-bc64-7158e14ca6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:47.713803 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-209dd0b9-d58c-4680-bc64-7158e14ca6e0 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:47.715107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-209dd0b9-d58c-4680-bc64-7158e14ca6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:47.716368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ead49-ba19-4d5d-91c7-1765f2ddbc9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:47.717354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ead49-ba19-4d5d-91c7-1765f2ddbc9f service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:47.717994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ead49-ba19-4d5d-91c7-1765f2ddbc9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:47.718460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ead49-ba19-4d5d-91c7-1765f2ddbc9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:47.720803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6d7ead49-ba19-4d5d-91c7-1765f2ddbc9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:47.793642 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1020/2094] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:47.793642 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dd0b9-d58c-4680-bc64-7158e14ca6e0 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:47.795661 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-209dd0b9-d58c-4680-bc64-7158e14ca6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:47.806336 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ead49-ba19-4d5d-91c7-1765f2ddbc9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:47.808436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ead49-ba19-4d5d-91c7-1765f2ddbc9f service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:47.812762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dd0b9-d58c-4680-bc64-7158e14ca6e0 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:47.818178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9283dc7-1d66-4814-a3fc-1e2ee11b664f tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af21daf33bd4c61a1174d5bff68d18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6788f80971704622bdb76e3de6dca51a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:47.819628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283dc7-1d66-4814-a3fc-1e2ee11b664f tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:47.820035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283dc7-1d66-4814-a3fc-1e2ee11b664f tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:47.820442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283dc7-1d66-4814-a3fc-1e2ee11b664f tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:47.821250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9283dc7-1d66-4814-a3fc-1e2ee11b664f tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:47.823361 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9283dc7-1d66-4814-a3fc-1e2ee11b664f tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:47.828660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1075/2095] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:47.830890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f9120-fa38-4d04-a755-1ae7551afe35 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:47.831582 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f9120-fa38-4d04-a755-1ae7551afe35 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:47.832237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f9120-fa38-4d04-a755-1ae7551afe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:47.862293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-105f9120-fa38-4d04-a755-1ae7551afe35 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:47.864381 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-105f9120-fa38-4d04-a755-1ae7551afe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:47.865672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1021/2096] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:47 2022] POST /identity/v3/projects => generated 354 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:47.872259 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9283dc7-1d66-4814-a3fc-1e2ee11b664f tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:47.976553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1076/2097] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:47.978101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f9120-fa38-4d04-a755-1ae7551afe35 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:47.989434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f9120-fa38-4d04-a755-1ae7551afe35 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:47.996873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f839b-390a-488d-934f-c9b7e44862e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:47.997724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f839b-390a-488d-934f-c9b7e44862e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:47.998481 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f839b-390a-488d-934f-c9b7e44862e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:47.998481 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f839b-390a-488d-934f-c9b7e44862e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:48.000646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f839b-390a-488d-934f-c9b7e44862e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:48.001020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f839b-390a-488d-934f-c9b7e44862e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:48.003075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f839b-390a-488d-934f-c9b7e44862e1 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:48.023330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1077/2098] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:48.028621 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f839b-390a-488d-934f-c9b7e44862e1 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:48.042836 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f839b-390a-488d-934f-c9b7e44862e1 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:48.047703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9283dc7-1d66-4814-a3fc-1e2ee11b664f tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:48.052062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e380a75-4f89-4a13-b08b-bb1ce959ab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:48.053342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e380a75-4f89-4a13-b08b-bb1ce959ab75 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:48.054687 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e380a75-4f89-4a13-b08b-bb1ce959ab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:48.055193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e380a75-4f89-4a13-b08b-bb1ce959ab75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:48.056901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e380a75-4f89-4a13-b08b-bb1ce959ab75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:48.059643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e380a75-4f89-4a13-b08b-bb1ce959ab75 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:48.065515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c202f7-563e-45fb-863b-146821ffa019 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af21daf33bd4c61a1174d5bff68d18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6788f80971704622bdb76e3de6dca51a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:48.067153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c202f7-563e-45fb-863b-146821ffa019 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:48.067753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c202f7-563e-45fb-863b-146821ffa019 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:48.068212 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c202f7-563e-45fb-863b-146821ffa019 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:48.069185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c202f7-563e-45fb-863b-146821ffa019 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:48.070682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c202f7-563e-45fb-863b-146821ffa019 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:48.072635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c202f7-563e-45fb-863b-146821ffa019 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:48.084420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:48.095664 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1022/2099] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:48.100006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1078/2100] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:48 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:48.104947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c202f7-563e-45fb-863b-146821ffa019 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:48.121323 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c202f7-563e-45fb-863b-146821ffa019 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:48.152786 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e380a75-4f89-4a13-b08b-bb1ce959ab75 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:48.176323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:48.203402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac06b3-dd68-4a31-bb12-b58dd12b3d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:48.204566 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac06b3-dd68-4a31-bb12-b58dd12b3d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:48.204921 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac06b3-dd68-4a31-bb12-b58dd12b3d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:48.205332 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac06b3-dd68-4a31-bb12-b58dd12b3d7d admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:48.206655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac06b3-dd68-4a31-bb12-b58dd12b3d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:48.208944 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac06b3-dd68-4a31-bb12-b58dd12b3d7d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:48.244823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1023/2101] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:48 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:48.252091 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac06b3-dd68-4a31-bb12-b58dd12b3d7d admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:48.284161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac06b3-dd68-4a31-bb12-b58dd12b3d7d admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:48.296819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe91f29-fcd4-4997-9614-b819d88e3c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:48.297530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe91f29-fcd4-4997-9614-b819d88e3c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:48.297938 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe91f29-fcd4-4997-9614-b819d88e3c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:48.298141 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe91f29-fcd4-4997-9614-b819d88e3c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:48.298962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe91f29-fcd4-4997-9614-b819d88e3c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:48.307527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe91f29-fcd4-4997-9614-b819d88e3c9b admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:48.326720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e380a75-4f89-4a13-b08b-bb1ce959ab75 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:48.328460 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1024/2102] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:48.329408 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe91f29-fcd4-4997-9614-b819d88e3c9b admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:48.331559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ffe91f29-fcd4-4997-9614-b819d88e3c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:48.347593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1af21daf33bd4c61a1174d5bff68d18e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6788f80971704622bdb76e3de6dca51a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:48.347947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe91f29-fcd4-4997-9614-b819d88e3c9b admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:48.348657 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:48.349664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:48.350206 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] PATH_INFO: `/v3/projects/af7028ec070e4a67bdcf8ae74da5b115` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:48.352734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] RBAC: Authorizing `identity:delete_project(project_id=af7028ec070e4a67bdcf8ae74da5b115)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:48.355008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:48.355208 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:48.356139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:48.357771 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:48.357771 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] PATH_INFO: `/v3/projects/28dd0644c4d24373b417cebf7695cf06` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:48.358245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] RBAC: Authorizing `identity:delete_project(project_id=28dd0644c4d24373b417cebf7695cf06)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:48.360611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:48.428231 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af7028ec070e4a67bdcf8ae74da5b115', 'request_id': 'req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.439294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28dd0644c4d24373b417cebf7695cf06', 'request_id': 'req-ca96e74b-656e-4bda-af6b-206544cf793e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.441554 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af7028ec070e4a67bdcf8ae74da5b115', 'request_id': 'req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.452763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28dd0644c4d24373b417cebf7695cf06', 'request_id': 'req-ca96e74b-656e-4bda-af6b-206544cf793e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.458456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af7028ec070e4a67bdcf8ae74da5b115', 'request_id': 'req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.466022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28dd0644c4d24373b417cebf7695cf06', 'request_id': 'req-ca96e74b-656e-4bda-af6b-206544cf793e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.472985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] The token cache is being invalidate because project af7028ec070e4a67bdcf8ae74da5b115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:48.473407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.474505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.478263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1079/2103] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:48 2022] DELETE /identity/v3/projects/af7028ec070e4a67bdcf8ae74da5b115 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:48.479113 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:48.480578 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:48.493822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] The token cache is being invalidate because project 28dd0644c4d24373b417cebf7695cf06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:48.494124 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.495769 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.498314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1025/2104] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:48 2022] DELETE /identity/v3/projects/28dd0644c4d24373b417cebf7695cf06 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:48.504694 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:48.508965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:48.571625 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a897f-5be4-4bcd-be1b-56e0707d0b75 tempest-VolumeQuotaClassesTest-1839811851 tempest-VolumeQuotaClassesTest-1839811851-project-admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:48.641004 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:48.670424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef069a9-562b-4af8-81e1-031d6f3bb44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:48.671580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef069a9-562b-4af8-81e1-031d6f3bb44a admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:48.674260 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef069a9-562b-4af8-81e1-031d6f3bb44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:48.674802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef069a9-562b-4af8-81e1-031d6f3bb44a admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:48.676072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef069a9-562b-4af8-81e1-031d6f3bb44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:48.676369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96e74b-656e-4bda-af6b-206544cf793e admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:48.679980 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef069a9-562b-4af8-81e1-031d6f3bb44a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:48.687694 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798182c4-8cdf-4b4a-b785-80096f3d1bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:48.690945 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798182c4-8cdf-4b4a-b785-80096f3d1bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:48.691352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798182c4-8cdf-4b4a-b785-80096f3d1bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:48.691763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798182c4-8cdf-4b4a-b785-80096f3d1bd7 admin admin] PATH_INFO: `/v3/projects/a34c21e469b5424b9bd7e7aeabe31308` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:48.694522 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798182c4-8cdf-4b4a-b785-80096f3d1bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34c21e469b5424b9bd7e7aeabe31308)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:48.696672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798182c4-8cdf-4b4a-b785-80096f3d1bd7 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:48.701568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:48.710302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1080/2105] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:48.711773 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780671-410e-4712-b6d1-011b0d844bae None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:48.717083 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780671-410e-4712-b6d1-011b0d844bae None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:48.717652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780671-410e-4712-b6d1-011b0d844bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:48.754623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-0e780671-410e-4712-b6d1-011b0d844bae None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:48.757604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0e780671-410e-4712-b6d1-011b0d844bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:48.767161 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1081/2106] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:48.768323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e780671-410e-4712-b6d1-011b0d844bae None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:48.778219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0e780671-410e-4712-b6d1-011b0d844bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:48.800250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-798182c4-8cdf-4b4a-b785-80096f3d1bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34c21e469b5424b9bd7e7aeabe31308', 'request_id': 'req-798182c4-8cdf-4b4a-b785-80096f3d1bd7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.806649 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e780671-410e-4712-b6d1-011b0d844bae None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:48.810248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-798182c4-8cdf-4b4a-b785-80096f3d1bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34c21e469b5424b9bd7e7aeabe31308', 'request_id': 'req-798182c4-8cdf-4b4a-b785-80096f3d1bd7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.817910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-798182c4-8cdf-4b4a-b785-80096f3d1bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34c21e469b5424b9bd7e7aeabe31308', 'request_id': 'req-798182c4-8cdf-4b4a-b785-80096f3d1bd7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.835283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-798182c4-8cdf-4b4a-b785-80096f3d1bd7 admin admin] The token cache is being invalidate because project a34c21e469b5424b9bd7e7aeabe31308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:48.836145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-798182c4-8cdf-4b4a-b785-80096f3d1bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.837126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-798182c4-8cdf-4b4a-b785-80096f3d1bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:48.839487 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1026/2107] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:48 2022] DELETE /identity/v3/projects/a34c21e469b5424b9bd7e7aeabe31308 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:48.841650 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71588db5-eca0-4f46-a47a-f4a5a8f07e89 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:48.842373 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71588db5-eca0-4f46-a47a-f4a5a8f07e89 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:48.842667 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71588db5-eca0-4f46-a47a-f4a5a8f07e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:48.874480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-71588db5-eca0-4f46-a47a-f4a5a8f07e89 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:48.876581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-71588db5-eca0-4f46-a47a-f4a5a8f07e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:48.887953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d734a9-e078-49b8-bb85-38f0231f43c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:48.889419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d734a9-e078-49b8-bb85-38f0231f43c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:48.889708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d734a9-e078-49b8-bb85-38f0231f43c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:48.890033 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d734a9-e078-49b8-bb85-38f0231f43c2 admin admin] PATH_INFO: `/v3/projects/d8f7d1c8cb4b49128692f1d63aec75c6/users/c0d09c8cb5ed42b0879af26119dfe7a7/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:48.912213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d734a9-e078-49b8-bb85-38f0231f43c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f7d1c8cb4b49128692f1d63aec75c6, user_id=c0d09c8cb5ed42b0879af26119dfe7a7, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:48.916244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d734a9-e078-49b8-bb85-38f0231f43c2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:48.939640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1082/2108] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:48 2022] PUT /identity/v3/projects/d8f7d1c8cb4b49128692f1d63aec75c6/users/c0d09c8cb5ed42b0879af26119dfe7a7/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:48.940830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d734a9-e078-49b8-bb85-38f0231f43c2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:48.942787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-13d734a9-e078-49b8-bb85-38f0231f43c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:48.950980 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1027/2109] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:48.954273 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71588db5-eca0-4f46-a47a-f4a5a8f07e89 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:48.954273 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-71588db5-eca0-4f46-a47a-f4a5a8f07e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:48.966331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71588db5-eca0-4f46-a47a-f4a5a8f07e89 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:49.021608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d734a9-e078-49b8-bb85-38f0231f43c2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:49.028572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff33fa2-1074-4d28-9558-fcb6db80c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:49.029454 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff33fa2-1074-4d28-9558-fcb6db80c6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.029732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff33fa2-1074-4d28-9558-fcb6db80c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.030009 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff33fa2-1074-4d28-9558-fcb6db80c6c2 admin admin] PATH_INFO: `/v3/users/c44f1ff65e9e4aa59db4e989795beaf8` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.031225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff33fa2-1074-4d28-9558-fcb6db80c6c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44f1ff65e9e4aa59db4e989795beaf8)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:49.033524 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff33fa2-1074-4d28-9558-fcb6db80c6c2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:49.035456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b770409-f0da-46bf-8518-bb85bc5b98cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:49.037126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b770409-f0da-46bf-8518-bb85bc5b98cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.038460 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b770409-f0da-46bf-8518-bb85bc5b98cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.039408 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b770409-f0da-46bf-8518-bb85bc5b98cf admin admin] PATH_INFO: `/v3/users/0790d1f69825429fb8bbc63092fab797` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.040903 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b770409-f0da-46bf-8518-bb85bc5b98cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0790d1f69825429fb8bbc63092fab797)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:49.043451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b770409-f0da-46bf-8518-bb85bc5b98cf admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:49.091821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:49.097769 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4ff33fa2-1074-4d28-9558-fcb6db80c6c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44f1ff65e9e4aa59db4e989795beaf8'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:49.112780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3b770409-f0da-46bf-8518-bb85bc5b98cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0790d1f69825429fb8bbc63092fab797'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:49.115901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:49.117514 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4ff33fa2-1074-4d28-9558-fcb6db80c6c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44f1ff65e9e4aa59db4e989795beaf8'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:49.118779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4ff33fa2-1074-4d28-9558-fcb6db80c6c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44f1ff65e9e4aa59db4e989795beaf8'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:49.129029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4ff33fa2-1074-4d28-9558-fcb6db80c6c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44f1ff65e9e4aa59db4e989795beaf8'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:49.133540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3b770409-f0da-46bf-8518-bb85bc5b98cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0790d1f69825429fb8bbc63092fab797'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:49.134954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3b770409-f0da-46bf-8518-bb85bc5b98cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0790d1f69825429fb8bbc63092fab797'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:49.141965 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4ff33fa2-1074-4d28-9558-fcb6db80c6c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44f1ff65e9e4aa59db4e989795beaf8'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:49.149860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3b770409-f0da-46bf-8518-bb85bc5b98cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0790d1f69825429fb8bbc63092fab797'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:49.151592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3b770409-f0da-46bf-8518-bb85bc5b98cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0790d1f69825429fb8bbc63092fab797'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:49.153975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1083/2110] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:48 2022] DELETE /identity/v3/users/c44f1ff65e9e4aa59db4e989795beaf8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:49.156916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7c733-e7a4-43de-a5ad-c0a738f4d4b8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.157964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7c733-e7a4-43de-a5ad-c0a738f4d4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.158407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7c733-e7a4-43de-a5ad-c0a738f4d4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.179914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1028/2111] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:48 2022] DELETE /identity/v3/users/0790d1f69825429fb8bbc63092fab797 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:49.179914 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b770409-f0da-46bf-8518-bb85bc5b98cf admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:49.180240 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-3b770409-f0da-46bf-8518-bb85bc5b98cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:49.217732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d0e7c733-e7a4-43de-a5ad-c0a738f4d4b8 None None] MFA Rules not processed for user `c0d09c8cb5ed42b0879af26119dfe7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:49.219087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d0e7c733-e7a4-43de-a5ad-c0a738f4d4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:49.277419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b770409-f0da-46bf-8518-bb85bc5b98cf admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:49.289871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a592d-3684-4d3c-953e-c7de6f32f9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:49.290730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a592d-3684-4d3c-953e-c7de6f32f9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.290879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a592d-3684-4d3c-953e-c7de6f32f9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.291261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a592d-3684-4d3c-953e-c7de6f32f9eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.292490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a592d-3684-4d3c-953e-c7de6f32f9eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:49.292807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a592d-3684-4d3c-953e-c7de6f32f9eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:49.294867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a592d-3684-4d3c-953e-c7de6f32f9eb admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:49.313208 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1029/2112] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:49.314837 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d3635-e6fd-424f-bee8-874db5860aab None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.315130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d3635-e6fd-424f-bee8-874db5860aab None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.315712 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d3635-e6fd-424f-bee8-874db5860aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.327982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1084/2113] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:49.329161 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7c733-e7a4-43de-a5ad-c0a738f4d4b8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:49.345583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7c733-e7a4-43de-a5ad-c0a738f4d4b8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:49.350890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ec5d3635-e6fd-424f-bee8-874db5860aab None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:49.352803 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ec5d3635-e6fd-424f-bee8-874db5860aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:49.353083 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc65705-47e1-464b-bf19-d3a99890a880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:49.353949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc65705-47e1-464b-bf19-d3a99890a880 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.354435 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc65705-47e1-464b-bf19-d3a99890a880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.354850 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc65705-47e1-464b-bf19-d3a99890a880 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.356252 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc65705-47e1-464b-bf19-d3a99890a880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:49.359119 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc65705-47e1-464b-bf19-d3a99890a880 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:49.379638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1030/2114] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:49.395630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d3635-e6fd-424f-bee8-874db5860aab None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:49.398320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ec5d3635-e6fd-424f-bee8-874db5860aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:49.416418 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d3635-e6fd-424f-bee8-874db5860aab None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:49.421958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b92637-8d75-4803-90d8-42320b16d9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:49.422631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b92637-8d75-4803-90d8-42320b16d9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.422943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b92637-8d75-4803-90d8-42320b16d9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.423229 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b92637-8d75-4803-90d8-42320b16d9d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.424177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b92637-8d75-4803-90d8-42320b16d9d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:49.426550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b92637-8d75-4803-90d8-42320b16d9d9 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:49.437440 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1085/2115] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:49 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:49.438427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc65705-47e1-464b-bf19-d3a99890a880 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:49.443788 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-adc65705-47e1-464b-bf19-d3a99890a880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:49.478049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1031/2116] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:49 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:49.479208 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b92637-8d75-4803-90d8-42320b16d9d9 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:49.543329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc65705-47e1-464b-bf19-d3a99890a880 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:49.578007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b92637-8d75-4803-90d8-42320b16d9d9 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:49.586345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79a6b9-f0b7-4135-bd67-448e7cfb1fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:49.587581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79a6b9-f0b7-4135-bd67-448e7cfb1fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.588086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79a6b9-f0b7-4135-bd67-448e7cfb1fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.589077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79a6b9-f0b7-4135-bd67-448e7cfb1fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.589609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79a6b9-f0b7-4135-bd67-448e7cfb1fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:49.593439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79a6b9-f0b7-4135-bd67-448e7cfb1fa2 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:49.622036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1032/2117] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:49 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:49.622932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79a6b9-f0b7-4135-bd67-448e7cfb1fa2 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:49.630218 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:49.635910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79a6b9-f0b7-4135-bd67-448e7cfb1fa2 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:49.647240 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cef722-dafc-4753-99b9-26c65439b25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:49.647885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972a639-3849-4b40-955f-d99786ee2fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:49.648200 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef722-dafc-4753-99b9-26c65439b25c service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.648487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef722-dafc-4753-99b9-26c65439b25c service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.648762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cef722-dafc-4753-99b9-26c65439b25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.649330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972a639-3849-4b40-955f-d99786ee2fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.650071 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972a639-3849-4b40-955f-d99786ee2fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.650695 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972a639-3849-4b40-955f-d99786ee2fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.656202 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972a639-3849-4b40-955f-d99786ee2fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:49.662223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972a639-3849-4b40-955f-d99786ee2fe8 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:49.666982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cef722-dafc-4753-99b9-26c65439b25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:49.669139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cef722-dafc-4753-99b9-26c65439b25c service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:49.686926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1086/2118] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:49.688718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cef722-dafc-4753-99b9-26c65439b25c service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:49.699775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1033/2119] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:49 2022] POST /identity/v3/users => generated 289 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:49.703269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cef722-dafc-4753-99b9-26c65439b25c service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:49.703986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972a639-3849-4b40-955f-d99786ee2fe8 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:49.709220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58748f15-d957-45fd-a242-7284cc469835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:49.710324 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58748f15-d957-45fd-a242-7284cc469835 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.710760 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58748f15-d957-45fd-a242-7284cc469835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.711231 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58748f15-d957-45fd-a242-7284cc469835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.712201 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58748f15-d957-45fd-a242-7284cc469835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:49.714355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58748f15-d957-45fd-a242-7284cc469835 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:49.716154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:49.718178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972a639-3849-4b40-955f-d99786ee2fe8 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:49.724577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da471e7f-0cf3-4127-88ff-cdb784496725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:49.724889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da471e7f-0cf3-4127-88ff-cdb784496725 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.725783 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da471e7f-0cf3-4127-88ff-cdb784496725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.726886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da471e7f-0cf3-4127-88ff-cdb784496725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.728046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da471e7f-0cf3-4127-88ff-cdb784496725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:49.729761 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da471e7f-0cf3-4127-88ff-cdb784496725 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:49.739809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1087/2120] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:49.743645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58748f15-d957-45fd-a242-7284cc469835 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:49.752782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1034/2121] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:49.753802 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da471e7f-0cf3-4127-88ff-cdb784496725 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:49.757294 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58748f15-d957-45fd-a242-7284cc469835 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:49.764441 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce7849-46a4-4b33-9db2-a8e10f0dafa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:49.765634 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce7849-46a4-4b33-9db2-a8e10f0dafa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.766121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce7849-46a4-4b33-9db2-a8e10f0dafa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.766505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce7849-46a4-4b33-9db2-a8e10f0dafa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.767383 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da471e7f-0cf3-4127-88ff-cdb784496725 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:49.767793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce7849-46a4-4b33-9db2-a8e10f0dafa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:49.770530 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce7849-46a4-4b33-9db2-a8e10f0dafa7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:49.773950 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee240c-252f-426f-8f59-373e817a54ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:49.775106 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee240c-252f-426f-8f59-373e817a54ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.775574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee240c-252f-426f-8f59-373e817a54ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.775930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee240c-252f-426f-8f59-373e817a54ed admin admin] PATH_INFO: `/v3/projects/f21384a3c7c242c1b44225dc0c5cd8f3/users/5b7dcf8812b9482f9558ed6f2bc9f25c/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.790225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1088/2122] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:49.801507 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce7849-46a4-4b33-9db2-a8e10f0dafa7 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:49.804650 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee240c-252f-426f-8f59-373e817a54ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21384a3c7c242c1b44225dc0c5cd8f3, user_id=5b7dcf8812b9482f9558ed6f2bc9f25c, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:49.809433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee240c-252f-426f-8f59-373e817a54ed admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:49.815508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce7849-46a4-4b33-9db2-a8e10f0dafa7 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:49.823937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec4c3f-fd64-40af-b663-41c2d231e522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:49.825073 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec4c3f-fd64-40af-b663-41c2d231e522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:49.825386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec4c3f-fd64-40af-b663-41c2d231e522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:49.825750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec4c3f-fd64-40af-b663-41c2d231e522 admin admin] PATH_INFO: `/v3/projects/89a138689e8d4b968cd3eca2fd8864bd/users/00e0ad8b79b540848f313f5b5107b898/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:49.829672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1035/2123] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:49 2022] PUT /identity/v3/projects/f21384a3c7c242c1b44225dc0c5cd8f3/users/5b7dcf8812b9482f9558ed6f2bc9f25c/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:49.834250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee240c-252f-426f-8f59-373e817a54ed admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:49.847731 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec4c3f-fd64-40af-b663-41c2d231e522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a138689e8d4b968cd3eca2fd8864bd, user_id=00e0ad8b79b540848f313f5b5107b898, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:49.850882 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec4c3f-fd64-40af-b663-41c2d231e522 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:49.878653 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1089/2124] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:49 2022] PUT /identity/v3/projects/89a138689e8d4b968cd3eca2fd8864bd/users/00e0ad8b79b540848f313f5b5107b898/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:49.879847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec4c3f-fd64-40af-b663-41c2d231e522 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:49.882562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-89ec4c3f-fd64-40af-b663-41c2d231e522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:49.983582 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee240c-252f-426f-8f59-373e817a54ed admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:50.066455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec4c3f-fd64-40af-b663-41c2d231e522 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:50.087839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:50.088746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:50.089038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:50.089324 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] PATH_INFO: `/v3/projects/cbc03bba77de47758c2ca6415297dced` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:50.091563 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc03bba77de47758c2ca6415297dced)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:50.096976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:50.115665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e907a-9f77-425b-b9c7-6980479c849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:50.116526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e907a-9f77-425b-b9c7-6980479c849e admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:50.116811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e907a-9f77-425b-b9c7-6980479c849e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:50.117089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e907a-9f77-425b-b9c7-6980479c849e admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:50.117837 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e907a-9f77-425b-b9c7-6980479c849e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:50.121193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e907a-9f77-425b-b9c7-6980479c849e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:50.143180 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1036/2125] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:50.144663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066906ec-de5f-40ce-913d-3b51dbb91921 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:50.144953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066906ec-de5f-40ce-913d-3b51dbb91921 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:50.145233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066906ec-de5f-40ce-913d-3b51dbb91921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:50.223902 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc03bba77de47758c2ca6415297dced', 'request_id': 'req-9721eef1-7b3f-4fad-bfce-1dec21d3b507'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.225169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-066906ec-de5f-40ce-913d-3b51dbb91921 None None] MFA Rules not processed for user `00e0ad8b79b540848f313f5b5107b898`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:50.228735 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-066906ec-de5f-40ce-913d-3b51dbb91921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:50.239165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc03bba77de47758c2ca6415297dced', 'request_id': 'req-9721eef1-7b3f-4fad-bfce-1dec21d3b507'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.259239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc03bba77de47758c2ca6415297dced', 'request_id': 'req-9721eef1-7b3f-4fad-bfce-1dec21d3b507'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.282216 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] The token cache is being invalidate because project cbc03bba77de47758c2ca6415297dced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:50.282946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.284195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.292069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1090/2126] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:49 2022] DELETE /identity/v3/projects/cbc03bba77de47758c2ca6415297dced => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:50.293147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:50.297908 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:50.368694 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:50.400978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:50.422441 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721eef1-7b3f-4fad-bfce-1dec21d3b507 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:50.425020 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1037/2127] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:50.426208 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066906ec-de5f-40ce-913d-3b51dbb91921 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:50.427642 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635cc05-565a-4dbe-ac09-4974464d1553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:50.428436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-066906ec-de5f-40ce-913d-3b51dbb91921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:50.428890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635cc05-565a-4dbe-ac09-4974464d1553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:50.429177 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635cc05-565a-4dbe-ac09-4974464d1553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:50.429475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635cc05-565a-4dbe-ac09-4974464d1553 admin admin] PATH_INFO: `/v3/projects/f21384a3c7c242c1b44225dc0c5cd8f3/users/5b7dcf8812b9482f9558ed6f2bc9f25c/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:50.431992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635cc05-565a-4dbe-ac09-4974464d1553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21384a3c7c242c1b44225dc0c5cd8f3, user_id=5b7dcf8812b9482f9558ed6f2bc9f25c, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:50.435044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635cc05-565a-4dbe-ac09-4974464d1553 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:50.446520 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066906ec-de5f-40ce-913d-3b51dbb91921 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:50.462411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1091/2128] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:50 2022] PUT /identity/v3/projects/f21384a3c7c242c1b44225dc0c5cd8f3/users/5b7dcf8812b9482f9558ed6f2bc9f25c/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:50.464258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635cc05-565a-4dbe-ac09-4974464d1553 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:50.467273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8635cc05-565a-4dbe-ac09-4974464d1553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:50.542299 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9458d3-3ed5-4461-874f-a4fb2a101217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:50.543805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9458d3-3ed5-4461-874f-a4fb2a101217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:50.544245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9458d3-3ed5-4461-874f-a4fb2a101217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:50.544552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9458d3-3ed5-4461-874f-a4fb2a101217 admin admin] PATH_INFO: `/v3/users/411cb8fbf27f43a7b742d3796d7efa2b` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:50.546150 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9458d3-3ed5-4461-874f-a4fb2a101217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=411cb8fbf27f43a7b742d3796d7efa2b)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:50.548152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9458d3-3ed5-4461-874f-a4fb2a101217 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:50.571741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635cc05-565a-4dbe-ac09-4974464d1553 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:50.579890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b57a29-6aed-46c3-a943-4643652f0e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:50.580933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b57a29-6aed-46c3-a943-4643652f0e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:50.581330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b57a29-6aed-46c3-a943-4643652f0e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:50.581666 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b57a29-6aed-46c3-a943-4643652f0e66 admin admin] PATH_INFO: `/v3/projects/7ffe20a81c0d46678742324b6a0530b7` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:50.583938 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b57a29-6aed-46c3-a943-4643652f0e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ffe20a81c0d46678742324b6a0530b7)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:50.586759 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b57a29-6aed-46c3-a943-4643652f0e66 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:50.631400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-9b9458d3-3ed5-4461-874f-a4fb2a101217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '411cb8fbf27f43a7b742d3796d7efa2b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.653747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-9b9458d3-3ed5-4461-874f-a4fb2a101217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '411cb8fbf27f43a7b742d3796d7efa2b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.655696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-9b9458d3-3ed5-4461-874f-a4fb2a101217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '411cb8fbf27f43a7b742d3796d7efa2b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.661656 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a6b57a29-6aed-46c3-a943-4643652f0e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ffe20a81c0d46678742324b6a0530b7', 'request_id': 'req-a6b57a29-6aed-46c3-a943-4643652f0e66'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.675965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-9b9458d3-3ed5-4461-874f-a4fb2a101217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '411cb8fbf27f43a7b742d3796d7efa2b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.679099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-9b9458d3-3ed5-4461-874f-a4fb2a101217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '411cb8fbf27f43a7b742d3796d7efa2b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.681611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a6b57a29-6aed-46c3-a943-4643652f0e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ffe20a81c0d46678742324b6a0530b7', 'request_id': 'req-a6b57a29-6aed-46c3-a943-4643652f0e66'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.693783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a6b57a29-6aed-46c3-a943-4643652f0e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ffe20a81c0d46678742324b6a0530b7', 'request_id': 'req-a6b57a29-6aed-46c3-a943-4643652f0e66'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.695991 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1038/2129] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:50 2022] DELETE /identity/v3/users/411cb8fbf27f43a7b742d3796d7efa2b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:50.696963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9458d3-3ed5-4461-874f-a4fb2a101217 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:50.712853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-9b9458d3-3ed5-4461-874f-a4fb2a101217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:50.724858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a6b57a29-6aed-46c3-a943-4643652f0e66 admin admin] The token cache is being invalidate because project 7ffe20a81c0d46678742324b6a0530b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:50.725974 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a6b57a29-6aed-46c3-a943-4643652f0e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.729122 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a6b57a29-6aed-46c3-a943-4643652f0e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:50.732478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1092/2130] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:50 2022] DELETE /identity/v3/projects/7ffe20a81c0d46678742324b6a0530b7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:50.735843 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656f72-dbd0-4185-9892-3131b665c9c7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:50.737683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656f72-dbd0-4185-9892-3131b665c9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:50.740182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656f72-dbd0-4185-9892-3131b665c9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:50.787184 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-08656f72-dbd0-4185-9892-3131b665c9c7 None None] MFA Rules not processed for user `5b7dcf8812b9482f9558ed6f2bc9f25c`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:50.793285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-08656f72-dbd0-4185-9892-3131b665c9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:50.839141 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9458d3-3ed5-4461-874f-a4fb2a101217 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:50.843492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38ef4-167f-4e32-bc6b-e0522af88707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:50.844317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38ef4-167f-4e32-bc6b-e0522af88707 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:50.844701 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38ef4-167f-4e32-bc6b-e0522af88707 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:50.845078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38ef4-167f-4e32-bc6b-e0522af88707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:50.847678 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a8f38ef4-167f-4e32-bc6b-e0522af88707 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:50.891062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:50.945159 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:50.969233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1093/2131] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:50.970200 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08656f72-dbd0-4185-9892-3131b665c9c7 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:50.971735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-08656f72-dbd0-4185-9892-3131b665c9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:50.987233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f38ef4-167f-4e32-bc6b-e0522af88707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:50.989741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f38ef4-167f-4e32-bc6b-e0522af88707 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:51.032989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1039/2132] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:51.034088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38ef4-167f-4e32-bc6b-e0522af88707 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:51.038111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a8f38ef4-167f-4e32-bc6b-e0522af88707 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:51.065845 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38ef4-167f-4e32-bc6b-e0522af88707 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:51.087642 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19937839-0eeb-4e4b-b762-c561b614d090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:51.088978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19937839-0eeb-4e4b-b762-c561b614d090 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:51.090377 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19937839-0eeb-4e4b-b762-c561b614d090 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:51.091785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19937839-0eeb-4e4b-b762-c561b614d090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:51.098387 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08656f72-dbd0-4185-9892-3131b665c9c7 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:51.104302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1306f6-ace5-42f7-a71d-2f4780b62413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:51.106559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1306f6-ace5-42f7-a71d-2f4780b62413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:51.107024 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1306f6-ace5-42f7-a71d-2f4780b62413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:51.107442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1306f6-ace5-42f7-a71d-2f4780b62413 admin admin] PATH_INFO: `/v3/users/1af21daf33bd4c61a1174d5bff68d18e` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:51.109252 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1306f6-ace5-42f7-a71d-2f4780b62413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af21daf33bd4c61a1174d5bff68d18e)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:51.111551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1306f6-ace5-42f7-a71d-2f4780b62413 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:51.123589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19937839-0eeb-4e4b-b762-c561b614d090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:51.129377 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19937839-0eeb-4e4b-b762-c561b614d090 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:51.160722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1040/2133] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:51.207035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-db1306f6-ace5-42f7-a71d-2f4780b62413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af21daf33bd4c61a1174d5bff68d18e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:51.239804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-db1306f6-ace5-42f7-a71d-2f4780b62413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af21daf33bd4c61a1174d5bff68d18e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:51.242199 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-db1306f6-ace5-42f7-a71d-2f4780b62413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af21daf33bd4c61a1174d5bff68d18e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:51.260914 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-db1306f6-ace5-42f7-a71d-2f4780b62413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af21daf33bd4c61a1174d5bff68d18e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:51.276078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19937839-0eeb-4e4b-b762-c561b614d090 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:51.279320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-19937839-0eeb-4e4b-b762-c561b614d090 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:51.296323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-db1306f6-ace5-42f7-a71d-2f4780b62413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af21daf33bd4c61a1174d5bff68d18e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:51.305495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19937839-0eeb-4e4b-b762-c561b614d090 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:51.314419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1094/2134] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:50 2022] DELETE /identity/v3/users/1af21daf33bd4c61a1174d5bff68d18e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:51.317387 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb96f74-2ced-4696-8bd3-909765efeb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:51.318680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb96f74-2ced-4696-8bd3-909765efeb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:51.319135 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb96f74-2ced-4696-8bd3-909765efeb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:51.319952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb96f74-2ced-4696-8bd3-909765efeb16 admin admin] PATH_INFO: `/v3/projects/724e4cd846e44389972848f2249d6bd3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:51.321651 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb96f74-2ced-4696-8bd3-909765efeb16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=724e4cd846e44389972848f2249d6bd3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:51.324081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb96f74-2ced-4696-8bd3-909765efeb16 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:51.347624 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1306f6-ace5-42f7-a71d-2f4780b62413 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:51.351736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-db1306f6-ace5-42f7-a71d-2f4780b62413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:51.469259 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3fb96f74-2ced-4696-8bd3-909765efeb16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724e4cd846e44389972848f2249d6bd3', 'request_id': 'req-3fb96f74-2ced-4696-8bd3-909765efeb16'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:51.484603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3fb96f74-2ced-4696-8bd3-909765efeb16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724e4cd846e44389972848f2249d6bd3', 'request_id': 'req-3fb96f74-2ced-4696-8bd3-909765efeb16'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:51.502479 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3fb96f74-2ced-4696-8bd3-909765efeb16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724e4cd846e44389972848f2249d6bd3', 'request_id': 'req-3fb96f74-2ced-4696-8bd3-909765efeb16'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:51.513295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1306f6-ace5-42f7-a71d-2f4780b62413 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:51.524204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3fb96f74-2ced-4696-8bd3-909765efeb16 admin admin] The token cache is being invalidate because project 724e4cd846e44389972848f2249d6bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:51.528568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3fb96f74-2ced-4696-8bd3-909765efeb16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:51.529923 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3fb96f74-2ced-4696-8bd3-909765efeb16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:51.533137 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1041/2135] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:51 2022] DELETE /identity/v3/projects/724e4cd846e44389972848f2249d6bd3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:51.539430 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396940b-d0f6-4db7-b944-c2aced3dc33f None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:51.539977 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396940b-d0f6-4db7-b944-c2aced3dc33f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:51.541254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396940b-d0f6-4db7-b944-c2aced3dc33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:51.602607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-f396940b-d0f6-4db7-b944-c2aced3dc33f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:51.605968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f396940b-d0f6-4db7-b944-c2aced3dc33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:51.612546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:51.672576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcfc1b-cdec-4551-9f0f-f1864db4eb5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:51.673075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcfc1b-cdec-4551-9f0f-f1864db4eb5a service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:51.673369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcfc1b-cdec-4551-9f0f-f1864db4eb5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:51.673632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcfc1b-cdec-4551-9f0f-f1864db4eb5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:51.680169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ecfcfc1b-cdec-4551-9f0f-f1864db4eb5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:51.797583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1042/2136] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:51.806814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a93554-b1a1-4c4b-9769-dd1475442f49 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:51.807172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a93554-b1a1-4c4b-9769-dd1475442f49 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:51.807374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a93554-b1a1-4c4b-9769-dd1475442f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:51.835492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-01a93554-b1a1-4c4b-9769-dd1475442f49 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:51.835748 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcfc1b-cdec-4551-9f0f-f1864db4eb5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:51.835920 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-01a93554-b1a1-4c4b-9769-dd1475442f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:51.836055 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcfc1b-cdec-4551-9f0f-f1864db4eb5a service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:51.847148 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1043/2137] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:51.851488 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a93554-b1a1-4c4b-9769-dd1475442f49 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:51.853221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1095/2138] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:35:51.872939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a93554-b1a1-4c4b-9769-dd1475442f49 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:51.887571 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69299ce8-7af3-4084-baf7-ae3cab3091dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:51.888389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69299ce8-7af3-4084-baf7-ae3cab3091dd admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:51.888668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69299ce8-7af3-4084-baf7-ae3cab3091dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:51.888940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69299ce8-7af3-4084-baf7-ae3cab3091dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:51.889742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69299ce8-7af3-4084-baf7-ae3cab3091dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:51.889981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69299ce8-7af3-4084-baf7-ae3cab3091dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:51.898111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69299ce8-7af3-4084-baf7-ae3cab3091dd admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:51.954392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1044/2139] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:51.956968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcfc1b-cdec-4551-9f0f-f1864db4eb5a service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:51.998749 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcfc1b-cdec-4551-9f0f-f1864db4eb5a service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:52.024663 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ce370-3c3b-424a-aa92-c9ad5efe78d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:52.031584 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ce370-3c3b-424a-aa92-c9ad5efe78d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:52.031987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ce370-3c3b-424a-aa92-c9ad5efe78d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:52.032429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ce370-3c3b-424a-aa92-c9ad5efe78d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:52.033098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ce370-3c3b-424a-aa92-c9ad5efe78d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:52.038817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ce370-3c3b-424a-aa92-c9ad5efe78d8 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:52.132011 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1096/2140] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:51 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:52.133615 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69299ce8-7af3-4084-baf7-ae3cab3091dd admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:52.157285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69299ce8-7af3-4084-baf7-ae3cab3091dd admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:52.165413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:52.211314 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ce370-3c3b-424a-aa92-c9ad5efe78d8 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:52.213115 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b59ce370-3c3b-424a-aa92-c9ad5efe78d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:52.329820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af99e3-3ae0-4e31-9382-c5c765e04340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:52.330730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af99e3-3ae0-4e31-9382-c5c765e04340 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:52.331085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af99e3-3ae0-4e31-9382-c5c765e04340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:52.333709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af99e3-3ae0-4e31-9382-c5c765e04340 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:52.333709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af99e3-3ae0-4e31-9382-c5c765e04340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:52.334873 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af99e3-3ae0-4e31-9382-c5c765e04340 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:52.413321 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ce370-3c3b-424a-aa92-c9ad5efe78d8 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:52.419263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fed600-119d-4d05-a703-8c2a448f550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:52.420905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fed600-119d-4d05-a703-8c2a448f550c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:52.421186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fed600-119d-4d05-a703-8c2a448f550c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:52.421464 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fed600-119d-4d05-a703-8c2a448f550c admin admin] PATH_INFO: `/v3/projects/6788f80971704622bdb76e3de6dca51a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:52.422750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fed600-119d-4d05-a703-8c2a448f550c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6788f80971704622bdb76e3de6dca51a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:52.425217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fed600-119d-4d05-a703-8c2a448f550c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:52.431999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1045/2141] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:52 2022] POST /identity/v3/users => generated 287 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:52.433133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af99e3-3ae0-4e31-9382-c5c765e04340 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:52.489573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af99e3-3ae0-4e31-9382-c5c765e04340 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:52.511594 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e5fed600-119d-4d05-a703-8c2a448f550c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6788f80971704622bdb76e3de6dca51a', 'request_id': 'req-e5fed600-119d-4d05-a703-8c2a448f550c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:52.520018 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e5fed600-119d-4d05-a703-8c2a448f550c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6788f80971704622bdb76e3de6dca51a', 'request_id': 'req-e5fed600-119d-4d05-a703-8c2a448f550c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:52.529517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e5fed600-119d-4d05-a703-8c2a448f550c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6788f80971704622bdb76e3de6dca51a', 'request_id': 'req-e5fed600-119d-4d05-a703-8c2a448f550c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:52.542680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:52.549833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e5fed600-119d-4d05-a703-8c2a448f550c admin admin] The token cache is being invalidate because project 6788f80971704622bdb76e3de6dca51a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:52.550123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e5fed600-119d-4d05-a703-8c2a448f550c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:52.550919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e5fed600-119d-4d05-a703-8c2a448f550c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:52.555380 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1097/2142] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:52 2022] DELETE /identity/v3/projects/6788f80971704622bdb76e3de6dca51a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:52.566219 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24242df4-4a70-4b43-b9ed-b92445e2f79c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:52.566827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24242df4-4a70-4b43-b9ed-b92445e2f79c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:52.567105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24242df4-4a70-4b43-b9ed-b92445e2f79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:52.605821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-24242df4-4a70-4b43-b9ed-b92445e2f79c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:52.607778 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-24242df4-4a70-4b43-b9ed-b92445e2f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:52.636630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc0b55-19a1-4b7d-be83-4d00380801bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:52.637347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc0b55-19a1-4b7d-be83-4d00380801bf admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:52.637638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc0b55-19a1-4b7d-be83-4d00380801bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:52.637921 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc0b55-19a1-4b7d-be83-4d00380801bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:52.638680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc0b55-19a1-4b7d-be83-4d00380801bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:52.645549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc0b55-19a1-4b7d-be83-4d00380801bf admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:52.705506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1046/2143] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:52.709273 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc0b55-19a1-4b7d-be83-4d00380801bf admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:52.718882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-2dbc0b55-19a1-4b7d-be83-4d00380801bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:52.739511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1098/2144] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:52.743882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc0b55-19a1-4b7d-be83-4d00380801bf admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:52.745466 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59af2c1-3ae6-4787-8e1a-3997db8d50e7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:52.747033 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59af2c1-3ae6-4787-8e1a-3997db8d50e7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:52.747626 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59af2c1-3ae6-4787-8e1a-3997db8d50e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:52.751127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49bd76-81a9-462b-abec-8045bfe777c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:52.753706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49bd76-81a9-462b-abec-8045bfe777c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:52.753994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49bd76-81a9-462b-abec-8045bfe777c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:52.754327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49bd76-81a9-462b-abec-8045bfe777c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:52.755302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49bd76-81a9-462b-abec-8045bfe777c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:52.758649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49bd76-81a9-462b-abec-8045bfe777c3 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:52.779774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1047/2145] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:52.783153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49bd76-81a9-462b-abec-8045bfe777c3 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:52.793333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b59af2c1-3ae6-4787-8e1a-3997db8d50e7 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:52.795143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b59af2c1-3ae6-4787-8e1a-3997db8d50e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:52.803724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49bd76-81a9-462b-abec-8045bfe777c3 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:52.810004 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f31019-fc2b-4691-9b5a-0a1827bdce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:52.811617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f31019-fc2b-4691-9b5a-0a1827bdce8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:52.811974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f31019-fc2b-4691-9b5a-0a1827bdce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:52.812329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f31019-fc2b-4691-9b5a-0a1827bdce8a admin admin] PATH_INFO: `/v3/projects/66c75acd1fe146e8984e8aaf1112d966/users/8d00016f43d94e7f948eabeefab30ee6/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:52.817421 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1099/2146] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:52.822304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59af2c1-3ae6-4787-8e1a-3997db8d50e7 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:52.834550 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59af2c1-3ae6-4787-8e1a-3997db8d50e7 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:52.837884 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f31019-fc2b-4691-9b5a-0a1827bdce8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c75acd1fe146e8984e8aaf1112d966, user_id=8d00016f43d94e7f948eabeefab30ee6, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:52.840942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f31019-fc2b-4691-9b5a-0a1827bdce8a admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:52.844193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26c281-7945-4c6b-92f1-40f04b7f4d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:52.844978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26c281-7945-4c6b-92f1-40f04b7f4d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:52.845351 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26c281-7945-4c6b-92f1-40f04b7f4d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:52.845667 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26c281-7945-4c6b-92f1-40f04b7f4d2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:52.847343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26c281-7945-4c6b-92f1-40f04b7f4d2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:52.847812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26c281-7945-4c6b-92f1-40f04b7f4d2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:52.851512 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26c281-7945-4c6b-92f1-40f04b7f4d2a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:52.859640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1048/2147] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:52 2022] PUT /identity/v3/projects/66c75acd1fe146e8984e8aaf1112d966/users/8d00016f43d94e7f948eabeefab30ee6/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:52.869541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1100/2148] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:52.878790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26c281-7945-4c6b-92f1-40f04b7f4d2a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:52.879211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214e00a-fa8c-4427-81b9-034a9d881d76 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:52.879445 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214e00a-fa8c-4427-81b9-034a9d881d76 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:52.879731 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214e00a-fa8c-4427-81b9-034a9d881d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:52.895066 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26c281-7945-4c6b-92f1-40f04b7f4d2a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:52.926169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-7214e00a-fa8c-4427-81b9-034a9d881d76 None None] MFA Rules not processed for user `8d00016f43d94e7f948eabeefab30ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:52.927767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7214e00a-fa8c-4427-81b9-034a9d881d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:52.998528 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:53.000680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b0ff3-9e71-4d51-8ab4-f950bc4c0e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:53.002947 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b0ff3-9e71-4d51-8ab4-f950bc4c0e8b admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:53.004366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b0ff3-9e71-4d51-8ab4-f950bc4c0e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:53.005903 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b0ff3-9e71-4d51-8ab4-f950bc4c0e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:53.009401 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b0ff3-9e71-4d51-8ab4-f950bc4c0e8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:53.014921 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b0ff3-9e71-4d51-8ab4-f950bc4c0e8b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:53.036538 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1049/2149] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:53.051839 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214e00a-fa8c-4427-81b9-034a9d881d76 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:53.053697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7214e00a-fa8c-4427-81b9-034a9d881d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:53.056155 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1101/2150] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:52 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:53.060488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b0ff3-9e71-4d51-8ab4-f950bc4c0e8b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:53.199977 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214e00a-fa8c-4427-81b9-034a9d881d76 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:53.245493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b0ff3-9e71-4d51-8ab4-f950bc4c0e8b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:53.255806 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fbb79-04ae-4779-b349-345252094b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:53.257895 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fbb79-04ae-4779-b349-345252094b6c admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:53.258433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fbb79-04ae-4779-b349-345252094b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:53.259073 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fbb79-04ae-4779-b349-345252094b6c admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:53.260068 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fbb79-04ae-4779-b349-345252094b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:53.262770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fbb79-04ae-4779-b349-345252094b6c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:53.275885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:53.299497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b6ae7-bd97-41d8-84fc-38665b7fc8f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:53.302640 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b6ae7-bd97-41d8-84fc-38665b7fc8f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:53.303169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b6ae7-bd97-41d8-84fc-38665b7fc8f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:53.304190 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b6ae7-bd97-41d8-84fc-38665b7fc8f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:53.305337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1102/2151] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:53 2022] POST /identity/v3/users => generated 288 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:53.309677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fbb79-04ae-4779-b349-345252094b6c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:53.324094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fbb79-04ae-4779-b349-345252094b6c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:53.349472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2104c8e-fff9-4c57-bb9f-747a06f63920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:53.350614 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2104c8e-fff9-4c57-bb9f-747a06f63920 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:53.351199 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2104c8e-fff9-4c57-bb9f-747a06f63920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:53.351382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2104c8e-fff9-4c57-bb9f-747a06f63920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:53.352189 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2104c8e-fff9-4c57-bb9f-747a06f63920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:53.354218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2104c8e-fff9-4c57-bb9f-747a06f63920 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:53.382353 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1103/2152] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:53.384488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2104c8e-fff9-4c57-bb9f-747a06f63920 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:53.416435 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2104c8e-fff9-4c57-bb9f-747a06f63920 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:53.418326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b6ae7-bd97-41d8-84fc-38665b7fc8f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:53.419945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ac6df-7596-444d-9ef2-5afb55042af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:53.420134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b6ae7-bd97-41d8-84fc-38665b7fc8f4 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:53.420622 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac6df-7596-444d-9ef2-5afb55042af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:53.421285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac6df-7596-444d-9ef2-5afb55042af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:53.421285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ac6df-7596-444d-9ef2-5afb55042af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:53.422203 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ac6df-7596-444d-9ef2-5afb55042af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:53.423844 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ac6df-7596-444d-9ef2-5afb55042af5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:53.434196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1050/2153] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:35:53.440159 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1104/2154] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:53.444987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b6ae7-bd97-41d8-84fc-38665b7fc8f4 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:53.456740 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ac6df-7596-444d-9ef2-5afb55042af5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:53.469092 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ac6df-7596-444d-9ef2-5afb55042af5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:53.484548 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b6ae7-bd97-41d8-84fc-38665b7fc8f4 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:53.486849 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16f71d-55a7-4b48-be0e-23b2c4ce6637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:53.494841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16f71d-55a7-4b48-be0e-23b2c4ce6637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:53.500324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa3f9c-b950-40c0-8425-9d1d9735a917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:53.500948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16f71d-55a7-4b48-be0e-23b2c4ce6637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:53.501733 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa3f9c-b950-40c0-8425-9d1d9735a917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:53.501855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16f71d-55a7-4b48-be0e-23b2c4ce6637 admin admin] PATH_INFO: `/v3/users/8d00016f43d94e7f948eabeefab30ee6` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:53.502325 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa3f9c-b950-40c0-8425-9d1d9735a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:53.502800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa3f9c-b950-40c0-8425-9d1d9735a917 admin admin] PATH_INFO: `/v3/projects/5db4ccb25b134e7d8b3a61792a2f18c9/users/f7900511ac3f4b5cb2e238485dbca245/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:53.521332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16f71d-55a7-4b48-be0e-23b2c4ce6637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d00016f43d94e7f948eabeefab30ee6)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:53.525713 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16f71d-55a7-4b48-be0e-23b2c4ce6637 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:53.574170 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa3f9c-b950-40c0-8425-9d1d9735a917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db4ccb25b134e7d8b3a61792a2f18c9, user_id=f7900511ac3f4b5cb2e238485dbca245, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:53.582397 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa3f9c-b950-40c0-8425-9d1d9735a917 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:53.619540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1051/2155] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:53 2022] PUT /identity/v3/projects/5db4ccb25b134e7d8b3a61792a2f18c9/users/f7900511ac3f4b5cb2e238485dbca245/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:53.622769 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335b8e4-5f76-4604-910a-3cda735cd56e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:53.623072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335b8e4-5f76-4604-910a-3cda735cd56e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:53.623529 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335b8e4-5f76-4604-910a-3cda735cd56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:53.649459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9e16f71d-55a7-4b48-be0e-23b2c4ce6637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d00016f43d94e7f948eabeefab30ee6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:53.667617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-9335b8e4-5f76-4604-910a-3cda735cd56e None None] MFA Rules not processed for user `f7900511ac3f4b5cb2e238485dbca245`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:53.671776 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-9335b8e4-5f76-4604-910a-3cda735cd56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:53.672637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9e16f71d-55a7-4b48-be0e-23b2c4ce6637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d00016f43d94e7f948eabeefab30ee6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:53.673438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9e16f71d-55a7-4b48-be0e-23b2c4ce6637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d00016f43d94e7f948eabeefab30ee6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:53.685308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9e16f71d-55a7-4b48-be0e-23b2c4ce6637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d00016f43d94e7f948eabeefab30ee6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:53.702057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9e16f71d-55a7-4b48-be0e-23b2c4ce6637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d00016f43d94e7f948eabeefab30ee6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:53.712098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1105/2156] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:53 2022] DELETE /identity/v3/users/8d00016f43d94e7f948eabeefab30ee6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:53.717500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f802e-4d47-44ba-b993-ff525f2f3254 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:53.718115 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f802e-4d47-44ba-b993-ff525f2f3254 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:53.719148 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f802e-4d47-44ba-b993-ff525f2f3254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:53.729382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:53.748365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2e7f802e-4d47-44ba-b993-ff525f2f3254 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:53.752610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2e7f802e-4d47-44ba-b993-ff525f2f3254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:53.811172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1052/2157] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:53.852874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335b8e4-5f76-4604-910a-3cda735cd56e None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:53.858203 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-9335b8e4-5f76-4604-910a-3cda735cd56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:53.907150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1106/2158] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:53.926708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f802e-4d47-44ba-b993-ff525f2f3254 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:53.930357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2e7f802e-4d47-44ba-b993-ff525f2f3254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:53.960614 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335b8e4-5f76-4604-910a-3cda735cd56e None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:54.066778 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:54.076352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c399e-bee0-4772-845c-c72ac3189005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:54.077243 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c399e-bee0-4772-845c-c72ac3189005 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:54.080074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c399e-bee0-4772-845c-c72ac3189005 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:54.080275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c399e-bee0-4772-845c-c72ac3189005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:54.090625 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f802e-4d47-44ba-b993-ff525f2f3254 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:54.107075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea4933-ca16-461f-89ea-91030c3838da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:54.108200 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea4933-ca16-461f-89ea-91030c3838da service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:54.108712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea4933-ca16-461f-89ea-91030c3838da service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:54.109142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea4933-ca16-461f-89ea-91030c3838da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:54.126446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea4933-ca16-461f-89ea-91030c3838da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:54.128211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea4933-ca16-461f-89ea-91030c3838da service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:54.143835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1107/2159] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:54.237756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c399e-bee0-4772-845c-c72ac3189005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:54.241121 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c399e-bee0-4772-845c-c72ac3189005 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:54.265828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1053/2160] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:35:54.717936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab39ba-d340-4450-92f9-0342813953ba None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:54.718569 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab39ba-d340-4450-92f9-0342813953ba None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:54.719272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab39ba-d340-4450-92f9-0342813953ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:54.769022 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-dbab39ba-d340-4450-92f9-0342813953ba None None] MFA Rules not processed for user `0d6ad1725257401888617fdcf7e57386`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:54.770256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dbab39ba-d340-4450-92f9-0342813953ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:54.879479 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c399e-bee0-4772-845c-c72ac3189005 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:54.880958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-133c399e-bee0-4772-845c-c72ac3189005 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:54.905073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c399e-bee0-4772-845c-c72ac3189005 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:54.922156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46af033-0bdd-4154-9773-76fbd9ec6462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:54.923004 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46af033-0bdd-4154-9773-76fbd9ec6462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:54.923287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46af033-0bdd-4154-9773-76fbd9ec6462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:54.923593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46af033-0bdd-4154-9773-76fbd9ec6462 admin admin] PATH_INFO: `/v3/projects/66c75acd1fe146e8984e8aaf1112d966` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:54.929949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46af033-0bdd-4154-9773-76fbd9ec6462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c75acd1fe146e8984e8aaf1112d966)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:54.942068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46af033-0bdd-4154-9773-76fbd9ec6462 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:54.957782 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1108/2161] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:54.966552 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab39ba-d340-4450-92f9-0342813953ba None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:54.971614 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dbab39ba-d340-4450-92f9-0342813953ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:55.025781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:55.052696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a46af033-0bdd-4154-9773-76fbd9ec6462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c75acd1fe146e8984e8aaf1112d966', 'request_id': 'req-a46af033-0bdd-4154-9773-76fbd9ec6462'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:55.062577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a46af033-0bdd-4154-9773-76fbd9ec6462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c75acd1fe146e8984e8aaf1112d966', 'request_id': 'req-a46af033-0bdd-4154-9773-76fbd9ec6462'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:55.079747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a46af033-0bdd-4154-9773-76fbd9ec6462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c75acd1fe146e8984e8aaf1112d966', 'request_id': 'req-a46af033-0bdd-4154-9773-76fbd9ec6462'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:55.099371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a46af033-0bdd-4154-9773-76fbd9ec6462 admin admin] The token cache is being invalidate because project 66c75acd1fe146e8984e8aaf1112d966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:55.099700 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a46af033-0bdd-4154-9773-76fbd9ec6462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:55.100458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a46af033-0bdd-4154-9773-76fbd9ec6462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:55.102256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1054/2162] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:54 2022] DELETE /identity/v3/projects/66c75acd1fe146e8984e8aaf1112d966 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:55.107061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900ec07-96ab-4ac6-8023-2370360ad341 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:55.107419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900ec07-96ab-4ac6-8023-2370360ad341 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:55.107816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900ec07-96ab-4ac6-8023-2370360ad341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:55.117548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab39ba-d340-4450-92f9-0342813953ba None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:55.133215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-6900ec07-96ab-4ac6-8023-2370360ad341 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:55.134863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6900ec07-96ab-4ac6-8023-2370360ad341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:55.227839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7bdcb-35b7-4fc6-818e-1f0637474acc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:55.229551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7bdcb-35b7-4fc6-818e-1f0637474acc service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:55.229739 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1055/2163] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:35:55.230221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7bdcb-35b7-4fc6-818e-1f0637474acc service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:55.230795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7bdcb-35b7-4fc6-818e-1f0637474acc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:55.233948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-06c7bdcb-35b7-4fc6-818e-1f0637474acc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:55.241271 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e0599-bdba-49b6-9110-6559c4cf4d7a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:55.241271 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e0599-bdba-49b6-9110-6559c4cf4d7a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:55.241271 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e0599-bdba-49b6-9110-6559c4cf4d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:55.254832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:55.262480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-fe0e0599-bdba-49b6-9110-6559c4cf4d7a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:55.264096 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-fe0e0599-bdba-49b6-9110-6559c4cf4d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:55.276630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1056/2164] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:55.281391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e0599-bdba-49b6-9110-6559c4cf4d7a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:55.291696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e0599-bdba-49b6-9110-6559c4cf4d7a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:55.298086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a663b-16e3-4061-bc69-b4c757d6449c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:55.298873 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a663b-16e3-4061-bc69-b4c757d6449c admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:55.299228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a663b-16e3-4061-bc69-b4c757d6449c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:55.299690 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a663b-16e3-4061-bc69-b4c757d6449c admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:55.300755 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a663b-16e3-4061-bc69-b4c757d6449c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:35:55.300755 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a663b-16e3-4061-bc69-b4c757d6449c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:55.303451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a663b-16e3-4061-bc69-b4c757d6449c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:55.329280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1057/2165] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:35:55.333709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a663b-16e3-4061-bc69-b4c757d6449c admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:55.336472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7bdcb-35b7-4fc6-818e-1f0637474acc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:55.338515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7bdcb-35b7-4fc6-818e-1f0637474acc service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:55.345323 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a663b-16e3-4061-bc69-b4c757d6449c admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:55.350554 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c694b-be57-4a5c-9508-f1242b973cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:55.351220 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c694b-be57-4a5c-9508-f1242b973cec admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:55.351523 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c694b-be57-4a5c-9508-f1242b973cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:55.351912 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c694b-be57-4a5c-9508-f1242b973cec admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:55.352622 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c694b-be57-4a5c-9508-f1242b973cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:55.354715 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c694b-be57-4a5c-9508-f1242b973cec admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:55.363274 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1109/2166] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:55.399109 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1058/2167] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:55 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:55.401230 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7bdcb-35b7-4fc6-818e-1f0637474acc service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:55.415323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7bdcb-35b7-4fc6-818e-1f0637474acc service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:55.514470 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba08d10-c85d-4228-bd3c-36e516305672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:55.515390 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba08d10-c85d-4228-bd3c-36e516305672 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:55.516486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba08d10-c85d-4228-bd3c-36e516305672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:55.517023 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba08d10-c85d-4228-bd3c-36e516305672 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:55.517938 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba08d10-c85d-4228-bd3c-36e516305672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:55.520517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba08d10-c85d-4228-bd3c-36e516305672 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:55.555706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1110/2168] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:55 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:55.560309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c694b-be57-4a5c-9508-f1242b973cec admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:55.572405 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c694b-be57-4a5c-9508-f1242b973cec admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:55.580614 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018da02-fc86-4a90-b1c5-044587abf43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:55.581560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018da02-fc86-4a90-b1c5-044587abf43d admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:55.581943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018da02-fc86-4a90-b1c5-044587abf43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:55.582324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018da02-fc86-4a90-b1c5-044587abf43d admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:55.583168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018da02-fc86-4a90-b1c5-044587abf43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:55.585747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018da02-fc86-4a90-b1c5-044587abf43d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:55.600479 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1059/2169] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:55.601779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba08d10-c85d-4228-bd3c-36e516305672 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:55.621967 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba08d10-c85d-4228-bd3c-36e516305672 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:55.627771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edca787-d3c7-4327-8f8d-b88b5455fdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:55.628694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edca787-d3c7-4327-8f8d-b88b5455fdac admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:55.628974 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edca787-d3c7-4327-8f8d-b88b5455fdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:55.629182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edca787-d3c7-4327-8f8d-b88b5455fdac admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:55.629927 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edca787-d3c7-4327-8f8d-b88b5455fdac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:55.632294 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edca787-d3c7-4327-8f8d-b88b5455fdac admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:55.647946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1111/2170] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:55.649167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018da02-fc86-4a90-b1c5-044587abf43d admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:55.674170 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018da02-fc86-4a90-b1c5-044587abf43d admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:55.688080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df4ac1-71fb-4f74-b722-3af19a3b0635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:55.689138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4ac1-71fb-4f74-b722-3af19a3b0635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:55.689494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4ac1-71fb-4f74-b722-3af19a3b0635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:55.689877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df4ac1-71fb-4f74-b722-3af19a3b0635 admin admin] PATH_INFO: `/v3/projects/063d60298c1e4ccda74f0a3597866bb3/users/76f8682f21a94b44affc8b536c1d701e/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:55.727077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df4ac1-71fb-4f74-b722-3af19a3b0635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=063d60298c1e4ccda74f0a3597866bb3, user_id=76f8682f21a94b44affc8b536c1d701e, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:55.740496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df4ac1-71fb-4f74-b722-3af19a3b0635 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:55.771055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1060/2171] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:55 2022] PUT /identity/v3/projects/063d60298c1e4ccda74f0a3597866bb3/users/76f8682f21a94b44affc8b536c1d701e/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:55.782095 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad4721-eda2-4d6d-958c-8d2a47c53c64 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:55.782674 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad4721-eda2-4d6d-958c-8d2a47c53c64 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:55.783303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad4721-eda2-4d6d-958c-8d2a47c53c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:55.844843 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2dad4721-eda2-4d6d-958c-8d2a47c53c64 None None] MFA Rules not processed for user `76f8682f21a94b44affc8b536c1d701e`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:55.846716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2dad4721-eda2-4d6d-958c-8d2a47c53c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:55.946089 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1112/2172] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:55.950739 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df4ac1-71fb-4f74-b722-3af19a3b0635 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:56.080669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:56.112139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df4ac1-71fb-4f74-b722-3af19a3b0635 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:56.119571 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b82ff-7eaa-413e-acbb-06adf05e3396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:56.120782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b82ff-7eaa-413e-acbb-06adf05e3396 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:56.121299 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b82ff-7eaa-413e-acbb-06adf05e3396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:56.121675 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b82ff-7eaa-413e-acbb-06adf05e3396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:56.122506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b82ff-7eaa-413e-acbb-06adf05e3396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:56.125268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b82ff-7eaa-413e-acbb-06adf05e3396 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:56.150381 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad4721-eda2-4d6d-958c-8d2a47c53c64 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:56.151897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2dad4721-eda2-4d6d-958c-8d2a47c53c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:56.172860 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad4721-eda2-4d6d-958c-8d2a47c53c64 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:56.180023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1061/2173] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:55 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:56.186093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b82ff-7eaa-413e-acbb-06adf05e3396 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:56.190560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b098d0c-930a-4d8a-ae39-c8ab35c3b521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:56.191484 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b098d0c-930a-4d8a-ae39-c8ab35c3b521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:56.191795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b098d0c-930a-4d8a-ae39-c8ab35c3b521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:56.192083 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b098d0c-930a-4d8a-ae39-c8ab35c3b521 admin admin] PATH_INFO: `/v3/users/00e0ad8b79b540848f313f5b5107b898` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:56.195528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b098d0c-930a-4d8a-ae39-c8ab35c3b521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e0ad8b79b540848f313f5b5107b898)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:56.201132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b098d0c-930a-4d8a-ae39-c8ab35c3b521 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:56.256058 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:56.335381 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9b098d0c-930a-4d8a-ae39-c8ab35c3b521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e0ad8b79b540848f313f5b5107b898'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:56.369373 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9b098d0c-930a-4d8a-ae39-c8ab35c3b521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e0ad8b79b540848f313f5b5107b898'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:56.372148 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9b098d0c-930a-4d8a-ae39-c8ab35c3b521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e0ad8b79b540848f313f5b5107b898'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:56.380677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b82ff-7eaa-413e-acbb-06adf05e3396 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:56.393686 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9b098d0c-930a-4d8a-ae39-c8ab35c3b521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e0ad8b79b540848f313f5b5107b898'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:56.396974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c4822-a05a-48ab-b37c-71bf3a7b34f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:56.401634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c4822-a05a-48ab-b37c-71bf3a7b34f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:56.401988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c4822-a05a-48ab-b37c-71bf3a7b34f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:56.403093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c4822-a05a-48ab-b37c-71bf3a7b34f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:56.404302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c4822-a05a-48ab-b37c-71bf3a7b34f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:56.410561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c4822-a05a-48ab-b37c-71bf3a7b34f4 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:56.426765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9b098d0c-930a-4d8a-ae39-c8ab35c3b521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e0ad8b79b540848f313f5b5107b898'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:56.450537 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1113/2174] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:56 2022] DELETE /identity/v3/users/00e0ad8b79b540848f313f5b5107b898 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:35:56.478224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a9a32-e1e1-4cbc-b297-ebe270f91b2b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:56.479684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a9a32-e1e1-4cbc-b297-ebe270f91b2b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:56.479976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a9a32-e1e1-4cbc-b297-ebe270f91b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:56.539400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1062/2175] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:56 2022] POST /identity/v3/users => generated 293 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:56.540843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c4822-a05a-48ab-b37c-71bf3a7b34f4 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:56.548032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-028c4822-a05a-48ab-b37c-71bf3a7b34f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:56.574997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5c0a9a32-e1e1-4cbc-b297-ebe270f91b2b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:56.576273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5c0a9a32-e1e1-4cbc-b297-ebe270f91b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:56.587267 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c4822-a05a-48ab-b37c-71bf3a7b34f4 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:56.667517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1114/2176] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:56.677943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a9a32-e1e1-4cbc-b297-ebe270f91b2b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:56.679916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5c0a9a32-e1e1-4cbc-b297-ebe270f91b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:56.684818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09a125-02c4-4f0a-a963-349917557835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:56.685680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09a125-02c4-4f0a-a963-349917557835 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:56.686065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09a125-02c4-4f0a-a963-349917557835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:56.686437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09a125-02c4-4f0a-a963-349917557835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:56.687411 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09a125-02c4-4f0a-a963-349917557835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:56.689410 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09a125-02c4-4f0a-a963-349917557835 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:56.702602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1063/2177] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:56.706943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09a125-02c4-4f0a-a963-349917557835 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:56.724411 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09a125-02c4-4f0a-a963-349917557835 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:56.732452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742ff6c-b020-48ed-b0cb-78b044e8130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:56.733513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742ff6c-b020-48ed-b0cb-78b044e8130c admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:56.734046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742ff6c-b020-48ed-b0cb-78b044e8130c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:56.734468 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742ff6c-b020-48ed-b0cb-78b044e8130c admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:56.735402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742ff6c-b020-48ed-b0cb-78b044e8130c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:56.737457 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742ff6c-b020-48ed-b0cb-78b044e8130c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:56.755994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1064/2178] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:56.757747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742ff6c-b020-48ed-b0cb-78b044e8130c admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:56.769277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742ff6c-b020-48ed-b0cb-78b044e8130c admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:56.771494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a9a32-e1e1-4cbc-b297-ebe270f91b2b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:56.778224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c641cc5-73f2-4808-8328-19d41bb1fd71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:56.778943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c641cc5-73f2-4808-8328-19d41bb1fd71 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:56.779230 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c641cc5-73f2-4808-8328-19d41bb1fd71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:56.779424 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41bc12-4024-4125-9eea-d533b307daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:56.779597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c641cc5-73f2-4808-8328-19d41bb1fd71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:56.781018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41bc12-4024-4125-9eea-d533b307daaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:56.781611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41bc12-4024-4125-9eea-d533b307daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:56.782036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41bc12-4024-4125-9eea-d533b307daaa admin admin] PATH_INFO: `/v3/projects/4f320f4adb99434498a8452c36d3447a/users/0dcda0ffe3d54133b87ddba3c49ecbed/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:56.793123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c641cc5-73f2-4808-8328-19d41bb1fd71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:56.795246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c641cc5-73f2-4808-8328-19d41bb1fd71 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:56.807073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41bc12-4024-4125-9eea-d533b307daaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f320f4adb99434498a8452c36d3447a, user_id=0dcda0ffe3d54133b87ddba3c49ecbed, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:56.810960 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41bc12-4024-4125-9eea-d533b307daaa admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:56.813951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1115/2179] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:35:56.829643 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1065/2180] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:56 2022] PUT /identity/v3/projects/4f320f4adb99434498a8452c36d3447a/users/0dcda0ffe3d54133b87ddba3c49ecbed/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:56.843593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a834-e66a-44cf-8325-65bcfc0278da None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:56.844311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a834-e66a-44cf-8325-65bcfc0278da None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:56.844311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a834-e66a-44cf-8325-65bcfc0278da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:56.882768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2fb2a834-e66a-44cf-8325-65bcfc0278da None None] MFA Rules not processed for user `0dcda0ffe3d54133b87ddba3c49ecbed`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:56.885950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2fb2a834-e66a-44cf-8325-65bcfc0278da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:56.918114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:56.971911 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1116/2181] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:56.977287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41bc12-4024-4125-9eea-d533b307daaa admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:57.008689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:57.087659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41bc12-4024-4125-9eea-d533b307daaa admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:57.096981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af29d38-9489-4ee2-b6f7-7eb5bcef8d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:57.098013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29d38-9489-4ee2-b6f7-7eb5bcef8d1c admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:57.098652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29d38-9489-4ee2-b6f7-7eb5bcef8d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:57.099084 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29d38-9489-4ee2-b6f7-7eb5bcef8d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:57.100016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af29d38-9489-4ee2-b6f7-7eb5bcef8d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:57.104767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af29d38-9489-4ee2-b6f7-7eb5bcef8d1c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:57.159287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1066/2182] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:35:56 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:35:57.164076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a834-e66a-44cf-8325-65bcfc0278da None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:57.193746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a834-e66a-44cf-8325-65bcfc0278da None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:57.308950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c035c1f-99b9-4f7d-ac3c-d777d86f1673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:57.310233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c035c1f-99b9-4f7d-ac3c-d777d86f1673 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:57.310519 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c035c1f-99b9-4f7d-ac3c-d777d86f1673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:57.310895 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c035c1f-99b9-4f7d-ac3c-d777d86f1673 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:57.312097 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c035c1f-99b9-4f7d-ac3c-d777d86f1673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:57.322325 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c035c1f-99b9-4f7d-ac3c-d777d86f1673 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:57.378670 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af29d38-9489-4ee2-b6f7-7eb5bcef8d1c admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:57.379345 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1117/2183] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:35:57 2022] POST /identity/v3/users => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:35:57.391360 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af29d38-9489-4ee2-b6f7-7eb5bcef8d1c admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:57.406372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80173d4c-fc44-468d-bfa9-cb03cf81bd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:57.407335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80173d4c-fc44-468d-bfa9-cb03cf81bd15 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:57.407458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80173d4c-fc44-468d-bfa9-cb03cf81bd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:57.407685 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80173d4c-fc44-468d-bfa9-cb03cf81bd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:57.410537 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80173d4c-fc44-468d-bfa9-cb03cf81bd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:57.412254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80173d4c-fc44-468d-bfa9-cb03cf81bd15 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:57.443310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1067/2184] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:35:57.449000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c035c1f-99b9-4f7d-ac3c-d777d86f1673 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:57.468382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c035c1f-99b9-4f7d-ac3c-d777d86f1673 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:57.477024 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2d0b6-a1bb-43b5-9754-e4bbabb1a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:57.479420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2d0b6-a1bb-43b5-9754-e4bbabb1a13d admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:57.479861 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2d0b6-a1bb-43b5-9754-e4bbabb1a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:57.480265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2d0b6-a1bb-43b5-9754-e4bbabb1a13d admin admin] PATH_INFO: `/v3/projects/8c186005e09e4e6a8771bb0faaf6e1c3/users/7a0bb591e3754da19c0c1df9903e459c/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:57.524195 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80173d4c-fc44-468d-bfa9-cb03cf81bd15 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:57.527985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-80173d4c-fc44-468d-bfa9-cb03cf81bd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:57.534128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2d0b6-a1bb-43b5-9754-e4bbabb1a13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c186005e09e4e6a8771bb0faaf6e1c3, user_id=7a0bb591e3754da19c0c1df9903e459c, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:57.540492 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2d0b6-a1bb-43b5-9754-e4bbabb1a13d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:57.565861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80173d4c-fc44-468d-bfa9-cb03cf81bd15 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:57.578728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1118/2185] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:57 2022] PUT /identity/v3/projects/8c186005e09e4e6a8771bb0faaf6e1c3/users/7a0bb591e3754da19c0c1df9903e459c/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:57.583431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2d0b6-a1bb-43b5-9754-e4bbabb1a13d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:57.732174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138f74a-ef2e-4131-a57a-7345272492c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:57.737519 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138f74a-ef2e-4131-a57a-7345272492c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:57.737970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138f74a-ef2e-4131-a57a-7345272492c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:57.738559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138f74a-ef2e-4131-a57a-7345272492c2 admin admin] PATH_INFO: `/v3/projects/89a138689e8d4b968cd3eca2fd8864bd` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:57.741242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138f74a-ef2e-4131-a57a-7345272492c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a138689e8d4b968cd3eca2fd8864bd)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:57.745084 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138f74a-ef2e-4131-a57a-7345272492c2 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:57.747341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2d0b6-a1bb-43b5-9754-e4bbabb1a13d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:57.754157 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22dae46-1737-4439-8fc3-9ab02ec489da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:57.755132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dae46-1737-4439-8fc3-9ab02ec489da admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:57.755663 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dae46-1737-4439-8fc3-9ab02ec489da admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:57.756046 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dae46-1737-4439-8fc3-9ab02ec489da admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:57.756976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22dae46-1737-4439-8fc3-9ab02ec489da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:57.759309 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22dae46-1737-4439-8fc3-9ab02ec489da admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:57.774933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1119/2186] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:35:57.779191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22dae46-1737-4439-8fc3-9ab02ec489da admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:57.794686 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22dae46-1737-4439-8fc3-9ab02ec489da admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:57.802392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47966b92-0c47-4a61-ad91-4ce8d1aadb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:57.804815 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47966b92-0c47-4a61-ad91-4ce8d1aadb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:57.805531 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47966b92-0c47-4a61-ad91-4ce8d1aadb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:57.806183 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47966b92-0c47-4a61-ad91-4ce8d1aadb88 admin admin] PATH_INFO: `/v3/projects/8c186005e09e4e6a8771bb0faaf6e1c3/users/7a0bb591e3754da19c0c1df9903e459c/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:57.813008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47966b92-0c47-4a61-ad91-4ce8d1aadb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c186005e09e4e6a8771bb0faaf6e1c3, user_id=7a0bb591e3754da19c0c1df9903e459c, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:57.818306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47966b92-0c47-4a61-ad91-4ce8d1aadb88 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:57.827787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c138f74a-ef2e-4131-a57a-7345272492c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a138689e8d4b968cd3eca2fd8864bd', 'request_id': 'req-c138f74a-ef2e-4131-a57a-7345272492c2'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:57.840081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c138f74a-ef2e-4131-a57a-7345272492c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a138689e8d4b968cd3eca2fd8864bd', 'request_id': 'req-c138f74a-ef2e-4131-a57a-7345272492c2'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:57.851105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c138f74a-ef2e-4131-a57a-7345272492c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a138689e8d4b968cd3eca2fd8864bd', 'request_id': 'req-c138f74a-ef2e-4131-a57a-7345272492c2'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:57.851588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1120/2187] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:35:57 2022] PUT /identity/v3/projects/8c186005e09e4e6a8771bb0faaf6e1c3/users/7a0bb591e3754da19c0c1df9903e459c/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:57.857977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47fdc6-8e3c-4bed-84f5-758b6d75c6a3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:57.858503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47fdc6-8e3c-4bed-84f5-758b6d75c6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:57.860137 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47fdc6-8e3c-4bed-84f5-758b6d75c6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:57.880763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c138f74a-ef2e-4131-a57a-7345272492c2 admin admin] The token cache is being invalidate because project 89a138689e8d4b968cd3eca2fd8864bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:57.881070 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c138f74a-ef2e-4131-a57a-7345272492c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:57.887713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-c138f74a-ef2e-4131-a57a-7345272492c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:57.889563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1068/2188] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:57 2022] DELETE /identity/v3/projects/89a138689e8d4b968cd3eca2fd8864bd => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:57.903083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133438d8-43c6-4542-9764-07f4a88071d2 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:57.903083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133438d8-43c6-4542-9764-07f4a88071d2 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:57.903083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133438d8-43c6-4542-9764-07f4a88071d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:57.916439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3a47fdc6-8e3c-4bed-84f5-758b6d75c6a3 None None] MFA Rules not processed for user `0d6ad1725257401888617fdcf7e57386`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:57.922091 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3a47fdc6-8e3c-4bed-84f5-758b6d75c6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:57.940783 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-133438d8-43c6-4542-9764-07f4a88071d2 None None] MFA Rules not processed for user `7a0bb591e3754da19c0c1df9903e459c`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:57.942480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-133438d8-43c6-4542-9764-07f4a88071d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:57.948059 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:57.970017 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:58.061979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1121/2189] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:58.063244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47fdc6-8e3c-4bed-84f5-758b6d75c6a3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:58.065572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3a47fdc6-8e3c-4bed-84f5-758b6d75c6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:58.113419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1069/2190] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:58.130127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133438d8-43c6-4542-9764-07f4a88071d2 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:58.132611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-133438d8-43c6-4542-9764-07f4a88071d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:58.207504 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47fdc6-8e3c-4bed-84f5-758b6d75c6a3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:58.213876 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1014f-3e0f-4a4d-95c7-41430bb55a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:58.214964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1014f-3e0f-4a4d-95c7-41430bb55a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:58.215445 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1014f-3e0f-4a4d-95c7-41430bb55a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:58.216239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1014f-3e0f-4a4d-95c7-41430bb55a32 admin admin] PATH_INFO: `/v3/users/c0d09c8cb5ed42b0879af26119dfe7a7` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:58.218069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1014f-3e0f-4a4d-95c7-41430bb55a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d09c8cb5ed42b0879af26119dfe7a7)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:58.222787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1014f-3e0f-4a4d-95c7-41430bb55a32 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:58.253275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133438d8-43c6-4542-9764-07f4a88071d2 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:58.263327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e80d2-5ecf-4289-a6da-8ee0ea7796b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:58.264361 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e80d2-5ecf-4289-a6da-8ee0ea7796b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:58.264703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e80d2-5ecf-4289-a6da-8ee0ea7796b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:58.265070 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e80d2-5ecf-4289-a6da-8ee0ea7796b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:58.268508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-861e80d2-5ecf-4289-a6da-8ee0ea7796b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:58.290839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5fb1014f-3e0f-4a4d-95c7-41430bb55a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d09c8cb5ed42b0879af26119dfe7a7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:58.307331 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5fb1014f-3e0f-4a4d-95c7-41430bb55a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d09c8cb5ed42b0879af26119dfe7a7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:58.308192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5fb1014f-3e0f-4a4d-95c7-41430bb55a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d09c8cb5ed42b0879af26119dfe7a7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:58.323103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5fb1014f-3e0f-4a4d-95c7-41430bb55a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d09c8cb5ed42b0879af26119dfe7a7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:58.333531 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5fb1014f-3e0f-4a4d-95c7-41430bb55a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d09c8cb5ed42b0879af26119dfe7a7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:58.347868 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1122/2191] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:58 2022] DELETE /identity/v3/users/c0d09c8cb5ed42b0879af26119dfe7a7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:58.355903 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758911d-b5d5-432e-ba0d-bb657de5e1c5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:58.358677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758911d-b5d5-432e-ba0d-bb657de5e1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:58.359007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758911d-b5d5-432e-ba0d-bb657de5e1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:58.416790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e80d2-5ecf-4289-a6da-8ee0ea7796b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:58.418400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e80d2-5ecf-4289-a6da-8ee0ea7796b1 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:58.445383 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1070/2192] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:58.471082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6758911d-b5d5-432e-ba0d-bb657de5e1c5 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:35:58.473778 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6758911d-b5d5-432e-ba0d-bb657de5e1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:58.528082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:58.587323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1123/2193] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:35:58.599351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e80d2-5ecf-4289-a6da-8ee0ea7796b1 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:58.601558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-861e80d2-5ecf-4289-a6da-8ee0ea7796b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:58.742447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e80d2-5ecf-4289-a6da-8ee0ea7796b1 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:58.761363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:35:58.844825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892486c-f3d5-4f8a-8b1c-41a1a3800147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:58.845505 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892486c-f3d5-4f8a-8b1c-41a1a3800147 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:58.845855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892486c-f3d5-4f8a-8b1c-41a1a3800147 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:58.846052 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892486c-f3d5-4f8a-8b1c-41a1a3800147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:58.870017 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892486c-f3d5-4f8a-8b1c-41a1a3800147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:58.871685 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892486c-f3d5-4f8a-8b1c-41a1a3800147 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:58.902598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1071/2194] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:35:59.319849 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758911d-b5d5-432e-ba0d-bb657de5e1c5 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:59.321578 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6758911d-b5d5-432e-ba0d-bb657de5e1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:35:59.335596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758911d-b5d5-432e-ba0d-bb657de5e1c5 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:59.341502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:59.342496 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:59.342774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:59.343326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] PATH_INFO: `/v3/projects/d8f7d1c8cb4b49128692f1d63aec75c6` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:59.344810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f7d1c8cb4b49128692f1d63aec75c6)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:59.346723 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:59.419808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f7d1c8cb4b49128692f1d63aec75c6', 'request_id': 'req-713ccdcd-ce3b-4598-bc9a-da8eb1674785'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:59.427498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f7d1c8cb4b49128692f1d63aec75c6', 'request_id': 'req-713ccdcd-ce3b-4598-bc9a-da8eb1674785'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:59.439303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f7d1c8cb4b49128692f1d63aec75c6', 'request_id': 'req-713ccdcd-ce3b-4598-bc9a-da8eb1674785'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:59.461589 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] The token cache is being invalidate because project d8f7d1c8cb4b49128692f1d63aec75c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:35:59.461874 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:59.462650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:59.467989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1124/2195] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:35:59 2022] DELETE /identity/v3/projects/d8f7d1c8cb4b49128692f1d63aec75c6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:35:59.469121 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892486c-f3d5-4f8a-8b1c-41a1a3800147 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:35:59.481031 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892486c-f3d5-4f8a-8b1c-41a1a3800147 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:35:59.552184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eefa95-d076-4829-8bf7-e057c5806364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:35:59.553127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefa95-d076-4829-8bf7-e057c5806364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:35:59.553959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefa95-d076-4829-8bf7-e057c5806364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:35:59.554363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefa95-d076-4829-8bf7-e057c5806364 admin admin] PATH_INFO: `/v3/users/5b7dcf8812b9482f9558ed6f2bc9f25c` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:35:59.555682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eefa95-d076-4829-8bf7-e057c5806364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7dcf8812b9482f9558ed6f2bc9f25c)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:35:59.557848 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eefa95-d076-4829-8bf7-e057c5806364 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:35:59.632928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e7eefa95-d076-4829-8bf7-e057c5806364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7dcf8812b9482f9558ed6f2bc9f25c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:59.648049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e7eefa95-d076-4829-8bf7-e057c5806364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7dcf8812b9482f9558ed6f2bc9f25c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:59.648859 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e7eefa95-d076-4829-8bf7-e057c5806364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7dcf8812b9482f9558ed6f2bc9f25c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:59.660567 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e7eefa95-d076-4829-8bf7-e057c5806364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7dcf8812b9482f9558ed6f2bc9f25c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:59.661381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e7eefa95-d076-4829-8bf7-e057c5806364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7dcf8812b9482f9558ed6f2bc9f25c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:35:59.683506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1072/2196] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:35:59 2022] DELETE /identity/v3/users/5b7dcf8812b9482f9558ed6f2bc9f25c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:00.154611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:00.156290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:00.171813 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ccdcd-ce3b-4598-bc9a-da8eb1674785 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:00.212269 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eefa95-d076-4829-8bf7-e057c5806364 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:00.213691 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-e7eefa95-d076-4829-8bf7-e057c5806364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:00.278458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:00.283766 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560d4a8-86d8-475d-b8e1-b734260f8f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:00.285006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560d4a8-86d8-475d-b8e1-b734260f8f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:00.285349 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560d4a8-86d8-475d-b8e1-b734260f8f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:00.285688 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560d4a8-86d8-475d-b8e1-b734260f8f84 admin admin] PATH_INFO: `/v3/projects/f21384a3c7c242c1b44225dc0c5cd8f3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:00.287240 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560d4a8-86d8-475d-b8e1-b734260f8f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f21384a3c7c242c1b44225dc0c5cd8f3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:00.290125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560d4a8-86d8-475d-b8e1-b734260f8f84 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:00.300748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eefa95-d076-4829-8bf7-e057c5806364 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:00.312543 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938a2db-6c23-4e01-ad1d-ef4553302f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:00.313234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a2db-6c23-4e01-ad1d-ef4553302f1c service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:00.313684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a2db-6c23-4e01-ad1d-ef4553302f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:00.314589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a2db-6c23-4e01-ad1d-ef4553302f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:00.328226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f938a2db-6c23-4e01-ad1d-ef4553302f1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:00.361017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b560d4a8-86d8-475d-b8e1-b734260f8f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f21384a3c7c242c1b44225dc0c5cd8f3', 'request_id': 'req-b560d4a8-86d8-475d-b8e1-b734260f8f84'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:00.370578 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b560d4a8-86d8-475d-b8e1-b734260f8f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f21384a3c7c242c1b44225dc0c5cd8f3', 'request_id': 'req-b560d4a8-86d8-475d-b8e1-b734260f8f84'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:00.374565 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:00.379613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b560d4a8-86d8-475d-b8e1-b734260f8f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f21384a3c7c242c1b44225dc0c5cd8f3', 'request_id': 'req-b560d4a8-86d8-475d-b8e1-b734260f8f84'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:00.393771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b560d4a8-86d8-475d-b8e1-b734260f8f84 admin admin] The token cache is being invalidate because project f21384a3c7c242c1b44225dc0c5cd8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:36:00.394415 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b560d4a8-86d8-475d-b8e1-b734260f8f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:00.395373 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b560d4a8-86d8-475d-b8e1-b734260f8f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:00.401575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1125/2197] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:36:00 2022] DELETE /identity/v3/projects/f21384a3c7c242c1b44225dc0c5cd8f3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:00.403795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c09f7-4531-4f4a-97b0-452430f389f0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:00.404057 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c09f7-4531-4f4a-97b0-452430f389f0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:00.404393 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c09f7-4531-4f4a-97b0-452430f389f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:00.404548 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938a2db-6c23-4e01-ad1d-ef4553302f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:00.406156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938a2db-6c23-4e01-ad1d-ef4553302f1c service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:00.418207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1073/2198] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:36:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:36:00.424195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ff2c09f7-4531-4f4a-97b0-452430f389f0 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:00.425443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ff2c09f7-4531-4f4a-97b0-452430f389f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:00.500836 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1126/2199] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:36:00.509714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358247d-1f96-42f8-b91d-a447f0699645 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:00.510271 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358247d-1f96-42f8-b91d-a447f0699645 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:00.510377 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358247d-1f96-42f8-b91d-a447f0699645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:00.531274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8358247d-1f96-42f8-b91d-a447f0699645 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:00.532613 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8358247d-1f96-42f8-b91d-a447f0699645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:00.542315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1074/2200] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:00.546838 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c09f7-4531-4f4a-97b0-452430f389f0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:00.559584 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c09f7-4531-4f4a-97b0-452430f389f0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:00.565643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f06c01-1557-498a-aa0e-678dca07ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:00.566342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f06c01-1557-498a-aa0e-678dca07ebb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:00.566625 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f06c01-1557-498a-aa0e-678dca07ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:00.568616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f06c01-1557-498a-aa0e-678dca07ebb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:00.568616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f06c01-1557-498a-aa0e-678dca07ebb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:36:00.568616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f06c01-1557-498a-aa0e-678dca07ebb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:00.570119 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f06c01-1557-498a-aa0e-678dca07ebb5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:00.590301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1127/2201] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:36:00.594772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358247d-1f96-42f8-b91d-a447f0699645 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:00.609505 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358247d-1f96-42f8-b91d-a447f0699645 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:00.623407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a3986-d203-4d73-b67b-793e6028d528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:00.627092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a3986-d203-4d73-b67b-793e6028d528 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:00.627623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a3986-d203-4d73-b67b-793e6028d528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:00.628081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a3986-d203-4d73-b67b-793e6028d528 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:00.629832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a3986-d203-4d73-b67b-793e6028d528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:00.632546 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a3986-d203-4d73-b67b-793e6028d528 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:00.691504 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1075/2202] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:36:00 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:36:00.695536 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f06c01-1557-498a-aa0e-678dca07ebb5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:00.708764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f06c01-1557-498a-aa0e-678dca07ebb5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:00.792503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47077095-5b36-416b-966e-515401d74277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:00.793247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077095-5b36-416b-966e-515401d74277 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:00.793529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077095-5b36-416b-966e-515401d74277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:00.793815 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077095-5b36-416b-966e-515401d74277 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:00.794524 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47077095-5b36-416b-966e-515401d74277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:00.796761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47077095-5b36-416b-966e-515401d74277 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:00.827636 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1128/2203] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:36:00 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:36:00.832029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a3986-d203-4d73-b67b-793e6028d528 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:00.846678 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a3986-d203-4d73-b67b-793e6028d528 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:00.854806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98da71-532c-4954-a595-3830c42a4611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:00.855510 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98da71-532c-4954-a595-3830c42a4611 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:00.855895 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98da71-532c-4954-a595-3830c42a4611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:00.856173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98da71-532c-4954-a595-3830c42a4611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:00.857576 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98da71-532c-4954-a595-3830c42a4611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:00.859506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98da71-532c-4954-a595-3830c42a4611 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:00.873122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1076/2204] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:36:00.877998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47077095-5b36-416b-966e-515401d74277 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:00.892693 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47077095-5b36-416b-966e-515401d74277 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:00.900001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149712-e15a-4e0e-bfc6-cb08063b7a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:00.900811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149712-e15a-4e0e-bfc6-cb08063b7a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:00.901126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149712-e15a-4e0e-bfc6-cb08063b7a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:00.901490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149712-e15a-4e0e-bfc6-cb08063b7a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:00.902519 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97149712-e15a-4e0e-bfc6-cb08063b7a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:00.904505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97149712-e15a-4e0e-bfc6-cb08063b7a7d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:00.920459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1129/2205] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:36:00.921777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98da71-532c-4954-a595-3830c42a4611 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:00.933308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98da71-532c-4954-a595-3830c42a4611 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:00.938109 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44703d55-4d85-4876-8330-e20bddae0cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:00.938992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44703d55-4d85-4876-8330-e20bddae0cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:00.939264 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44703d55-4d85-4876-8330-e20bddae0cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:00.939583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44703d55-4d85-4876-8330-e20bddae0cfc admin admin] PATH_INFO: `/v3/projects/c6533f6f633049a59463cefca0c38ecd/users/6c83f5854e9940429858fd746b7ba57e/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:00.958645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44703d55-4d85-4876-8330-e20bddae0cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6533f6f633049a59463cefca0c38ecd, user_id=6c83f5854e9940429858fd746b7ba57e, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:00.961948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44703d55-4d85-4876-8330-e20bddae0cfc admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:00.985243 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1077/2206] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:36:00 2022] PUT /identity/v3/projects/c6533f6f633049a59463cefca0c38ecd/users/6c83f5854e9940429858fd746b7ba57e/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:00.991296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d96865-0467-4b96-a288-db0b216141eb None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:00.991896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d96865-0467-4b96-a288-db0b216141eb None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:00.992269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d96865-0467-4b96-a288-db0b216141eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:01.015690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f7d96865-0467-4b96-a288-db0b216141eb None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:01.017292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f7d96865-0467-4b96-a288-db0b216141eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:01.079856 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:01.100268 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1130/2207] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:01.110420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44703d55-4d85-4876-8330-e20bddae0cfc admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:01.112695 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-44703d55-4d85-4876-8330-e20bddae0cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:01.121537 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d96865-0467-4b96-a288-db0b216141eb None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:01.123115 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f7d96865-0467-4b96-a288-db0b216141eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:01.194194 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44703d55-4d85-4876-8330-e20bddae0cfc admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:01.197814 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d96865-0467-4b96-a288-db0b216141eb None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:01.198283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee7efe-2635-4c86-8256-1e40023146aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:01.199145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee7efe-2635-4c86-8256-1e40023146aa service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:01.199432 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee7efe-2635-4c86-8256-1e40023146aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:01.199730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee7efe-2635-4c86-8256-1e40023146aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:01.206119 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a0c68-9ff3-4658-bad5-f394ff0b6d66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:01.206924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0c68-9ff3-4658-bad5-f394ff0b6d66 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:01.207391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0c68-9ff3-4658-bad5-f394ff0b6d66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:01.207766 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0c68-9ff3-4658-bad5-f394ff0b6d66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:01.210049 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-619a0c68-9ff3-4658-bad5-f394ff0b6d66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:01.213937 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee7efe-2635-4c86-8256-1e40023146aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:01.215832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee7efe-2635-4c86-8256-1e40023146aa service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:01.235382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1078/2208] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:36:01.285663 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a0c68-9ff3-4658-bad5-f394ff0b6d66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:01.285663 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a0c68-9ff3-4658-bad5-f394ff0b6d66 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:01.296252 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1131/2209] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:36:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:36:02.560168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf1d58-04a0-4c71-8c01-00815a559196 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:02.561178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf1d58-04a0-4c71-8c01-00815a559196 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:02.561666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf1d58-04a0-4c71-8c01-00815a559196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:02.630248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8ccf1d58-04a0-4c71-8c01-00815a559196 None None] MFA Rules not processed for user `6c83f5854e9940429858fd746b7ba57e`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:02.633211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8ccf1d58-04a0-4c71-8c01-00815a559196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:02.690379 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:02.789857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1079/2210] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:02.794291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a0c68-9ff3-4658-bad5-f394ff0b6d66 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:02.810388 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a0c68-9ff3-4658-bad5-f394ff0b6d66 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:02.822110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920ca77-790b-4f74-99dd-19453fe6cc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:02.824595 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920ca77-790b-4f74-99dd-19453fe6cc03 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:02.826120 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920ca77-790b-4f74-99dd-19453fe6cc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:02.826120 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920ca77-790b-4f74-99dd-19453fe6cc03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:02.826341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920ca77-790b-4f74-99dd-19453fe6cc03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:02.832110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920ca77-790b-4f74-99dd-19453fe6cc03 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:02.884918 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1132/2211] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:36:02 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:36:02.888706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf1d58-04a0-4c71-8c01-00815a559196 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:02.913858 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf1d58-04a0-4c71-8c01-00815a559196 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:03.036413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895f8a8-60b6-45a5-9d3e-94c62df67d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:03.037325 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f8a8-60b6-45a5-9d3e-94c62df67d8a admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:03.038233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f8a8-60b6-45a5-9d3e-94c62df67d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:03.038516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f8a8-60b6-45a5-9d3e-94c62df67d8a admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:03.039222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895f8a8-60b6-45a5-9d3e-94c62df67d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:03.041462 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895f8a8-60b6-45a5-9d3e-94c62df67d8a admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:03.069445 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1080/2212] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:36:02 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:36:03.074609 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920ca77-790b-4f74-99dd-19453fe6cc03 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:03.089867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920ca77-790b-4f74-99dd-19453fe6cc03 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:03.098690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0c1bb-f194-45e1-a21a-6202ff94f44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:03.099569 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0c1bb-f194-45e1-a21a-6202ff94f44b admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:03.100128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0c1bb-f194-45e1-a21a-6202ff94f44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:03.101846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0c1bb-f194-45e1-a21a-6202ff94f44b admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:03.103707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0c1bb-f194-45e1-a21a-6202ff94f44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:03.105396 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0c1bb-f194-45e1-a21a-6202ff94f44b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:03.123042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1133/2213] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:36:03.127457 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895f8a8-60b6-45a5-9d3e-94c62df67d8a admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:03.141378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895f8a8-60b6-45a5-9d3e-94c62df67d8a admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:03.149415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce56f2-cc08-4eff-8d04-90896ac3937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:03.150820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce56f2-cc08-4eff-8d04-90896ac3937e admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:03.151459 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce56f2-cc08-4eff-8d04-90896ac3937e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:03.152010 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce56f2-cc08-4eff-8d04-90896ac3937e admin admin] PATH_INFO: `/v3/projects/ad1bbf22c2b54906b2139a119aa79440/users/041e32ab81e744a2b0e2714573c0dc85/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:03.184960 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce56f2-cc08-4eff-8d04-90896ac3937e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1bbf22c2b54906b2139a119aa79440, user_id=041e32ab81e744a2b0e2714573c0dc85, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:03.188025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce56f2-cc08-4eff-8d04-90896ac3937e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:03.222849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1081/2214] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:36:03 2022] PUT /identity/v3/projects/ad1bbf22c2b54906b2139a119aa79440/users/041e32ab81e744a2b0e2714573c0dc85/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:03.224504 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0c1bb-f194-45e1-a21a-6202ff94f44b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:03.235260 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0c1bb-f194-45e1-a21a-6202ff94f44b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:03.303727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8cd49-46e5-49cd-a98d-9d618ec665fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:03.304740 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8cd49-46e5-49cd-a98d-9d618ec665fb admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:03.305117 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8cd49-46e5-49cd-a98d-9d618ec665fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:03.305474 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8cd49-46e5-49cd-a98d-9d618ec665fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:03.306298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8cd49-46e5-49cd-a98d-9d618ec665fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:03.308009 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8cd49-46e5-49cd-a98d-9d618ec665fb admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:03.327524 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1134/2215] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:36:03.329304 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce56f2-cc08-4eff-8d04-90896ac3937e admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:03.349251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce56f2-cc08-4eff-8d04-90896ac3937e admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:03.355189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e05a3-7679-40ba-b910-55cbe89180b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:03.356407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e05a3-7679-40ba-b910-55cbe89180b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:03.356663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e05a3-7679-40ba-b910-55cbe89180b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:03.357005 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e05a3-7679-40ba-b910-55cbe89180b8 admin admin] PATH_INFO: `/v3/projects/ad1bbf22c2b54906b2139a119aa79440/users/041e32ab81e744a2b0e2714573c0dc85/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:03.365000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e05a3-7679-40ba-b910-55cbe89180b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1bbf22c2b54906b2139a119aa79440, user_id=041e32ab81e744a2b0e2714573c0dc85, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:03.367758 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e05a3-7679-40ba-b910-55cbe89180b8 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:03.380268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1082/2216] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:36:03 2022] PUT /identity/v3/projects/ad1bbf22c2b54906b2139a119aa79440/users/041e32ab81e744a2b0e2714573c0dc85/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:36:04.377181 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483288f-a222-4c47-bbad-05d2c3351f5e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:04.378126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483288f-a222-4c47-bbad-05d2c3351f5e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:04.379041 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483288f-a222-4c47-bbad-05d2c3351f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:04.406127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:04.418802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6483288f-a222-4c47-bbad-05d2c3351f5e None None] MFA Rules not processed for user `041e32ab81e744a2b0e2714573c0dc85`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:04.423660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6483288f-a222-4c47-bbad-05d2c3351f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:04.522591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1135/2217] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:04.533476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c7bd2-e992-4ae0-968a-1b96fdd5897f None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:04.534586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c7bd2-e992-4ae0-968a-1b96fdd5897f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:04.534863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c7bd2-e992-4ae0-968a-1b96fdd5897f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:04.557119 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8b9c7bd2-e992-4ae0-968a-1b96fdd5897f None None] MFA Rules not processed for user `6c83f5854e9940429858fd746b7ba57e`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:04.558490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8b9c7bd2-e992-4ae0-968a-1b96fdd5897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:04.635824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1083/2218] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:04.652639 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483288f-a222-4c47-bbad-05d2c3351f5e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:04.655593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6483288f-a222-4c47-bbad-05d2c3351f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:04.757535 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483288f-a222-4c47-bbad-05d2c3351f5e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:04.764720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585155b-77ce-41c1-a080-751b93f4c5fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:04.765374 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585155b-77ce-41c1-a080-751b93f4c5fa service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:04.765653 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585155b-77ce-41c1-a080-751b93f4c5fa service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:04.765926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585155b-77ce-41c1-a080-751b93f4c5fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:04.774906 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585155b-77ce-41c1-a080-751b93f4c5fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:04.776753 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585155b-77ce-41c1-a080-751b93f4c5fa service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:04.787908 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1136/2219] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:36:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:36:05.623136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c7bd2-e992-4ae0-968a-1b96fdd5897f None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:05.625672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8b9c7bd2-e992-4ae0-968a-1b96fdd5897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:05.656464 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:05.699917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c7bd2-e992-4ae0-968a-1b96fdd5897f None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:05.704879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f55fa2-87d5-4700-ab40-62c5b1fb4c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:05.705787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f55fa2-87d5-4700-ab40-62c5b1fb4c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:05.706235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f55fa2-87d5-4700-ab40-62c5b1fb4c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:05.706618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f55fa2-87d5-4700-ab40-62c5b1fb4c6e admin admin] PATH_INFO: `/v3/users/76f8682f21a94b44affc8b536c1d701e` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:05.707952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f55fa2-87d5-4700-ab40-62c5b1fb4c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f8682f21a94b44affc8b536c1d701e)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:05.709905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f55fa2-87d5-4700-ab40-62c5b1fb4c6e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:05.777815 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-95f55fa2-87d5-4700-ab40-62c5b1fb4c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f8682f21a94b44affc8b536c1d701e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:05.790792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-95f55fa2-87d5-4700-ab40-62c5b1fb4c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f8682f21a94b44affc8b536c1d701e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:05.791494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-95f55fa2-87d5-4700-ab40-62c5b1fb4c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f8682f21a94b44affc8b536c1d701e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:05.798845 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-95f55fa2-87d5-4700-ab40-62c5b1fb4c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f8682f21a94b44affc8b536c1d701e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:05.799514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-95f55fa2-87d5-4700-ab40-62c5b1fb4c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f8682f21a94b44affc8b536c1d701e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:05.813235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1084/2220] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:36:05 2022] DELETE /identity/v3/users/76f8682f21a94b44affc8b536c1d701e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:05.817815 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa75ed3-44fe-471f-b93c-992f06d7c5a0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:05.818334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa75ed3-44fe-471f-b93c-992f06d7c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:05.818429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa75ed3-44fe-471f-b93c-992f06d7c5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:05.836424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1aa75ed3-44fe-471f-b93c-992f06d7c5a0 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:05.837617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1aa75ed3-44fe-471f-b93c-992f06d7c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:05.898497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1137/2221] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:05.908582 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f55fa2-87d5-4700-ab40-62c5b1fb4c6e admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:05.910059 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-95f55fa2-87d5-4700-ab40-62c5b1fb4c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:05.968245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f55fa2-87d5-4700-ab40-62c5b1fb4c6e admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:05.971956 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4a08c-5d7b-4e4b-aad0-e98446ac199a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:05.972646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4a08c-5d7b-4e4b-aad0-e98446ac199a service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:05.972924 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4a08c-5d7b-4e4b-aad0-e98446ac199a service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:05.973199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4a08c-5d7b-4e4b-aad0-e98446ac199a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:05.983685 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4a08c-5d7b-4e4b-aad0-e98446ac199a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:05.985198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4a08c-5d7b-4e4b-aad0-e98446ac199a service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:05.994928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1085/2222] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:36:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:36:06.273444 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa75ed3-44fe-471f-b93c-992f06d7c5a0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:06.274886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1aa75ed3-44fe-471f-b93c-992f06d7c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:06.289249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa75ed3-44fe-471f-b93c-992f06d7c5a0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:06.294084 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:06.294980 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:06.295261 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:06.295561 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] PATH_INFO: `/v3/projects/063d60298c1e4ccda74f0a3597866bb3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:06.296771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=063d60298c1e4ccda74f0a3597866bb3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:06.298661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:06.316068 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:06.348522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '063d60298c1e4ccda74f0a3597866bb3', 'request_id': 'req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:06.354043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '063d60298c1e4ccda74f0a3597866bb3', 'request_id': 'req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:06.361319 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '063d60298c1e4ccda74f0a3597866bb3', 'request_id': 'req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:06.372806 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] The token cache is being invalidate because project 063d60298c1e4ccda74f0a3597866bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:36:06.373112 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:06.373710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:06.375547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1138/2223] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:36:06 2022] DELETE /identity/v3/projects/063d60298c1e4ccda74f0a3597866bb3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:06.379440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4a08c-5d7b-4e4b-aad0-e98446ac199a service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:06.389407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4a08c-5d7b-4e4b-aad0-e98446ac199a service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:06.428981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:06.447223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb38a72-dd5d-4da4-9de9-fdeb4b0ed103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:06.448140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb38a72-dd5d-4da4-9de9-fdeb4b0ed103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:06.448423 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb38a72-dd5d-4da4-9de9-fdeb4b0ed103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:06.448710 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb38a72-dd5d-4da4-9de9-fdeb4b0ed103 admin admin] PATH_INFO: `/v3/users/0dcda0ffe3d54133b87ddba3c49ecbed` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:06.450876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb38a72-dd5d-4da4-9de9-fdeb4b0ed103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcda0ffe3d54133b87ddba3c49ecbed)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:06.452108 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb38a72-dd5d-4da4-9de9-fdeb4b0ed103 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:06.501430 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0bb38a72-dd5d-4da4-9de9-fdeb4b0ed103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcda0ffe3d54133b87ddba3c49ecbed'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:06.514002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0bb38a72-dd5d-4da4-9de9-fdeb4b0ed103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcda0ffe3d54133b87ddba3c49ecbed'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:06.514675 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0bb38a72-dd5d-4da4-9de9-fdeb4b0ed103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcda0ffe3d54133b87ddba3c49ecbed'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:06.524146 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0bb38a72-dd5d-4da4-9de9-fdeb4b0ed103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcda0ffe3d54133b87ddba3c49ecbed'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:06.524746 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0bb38a72-dd5d-4da4-9de9-fdeb4b0ed103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcda0ffe3d54133b87ddba3c49ecbed'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:06.537287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1086/2224] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:36:06 2022] DELETE /identity/v3/users/0dcda0ffe3d54133b87ddba3c49ecbed => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:07.143678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:07.145150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:07.159162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1edf6d-1f2c-4ccd-a460-1dfe59465283 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:07.225502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:07.226389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:07.226670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:07.226947 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] PATH_INFO: `/v3/projects/4f320f4adb99434498a8452c36d3447a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:07.228191 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f320f4adb99434498a8452c36d3447a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:07.230128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:07.282665 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f320f4adb99434498a8452c36d3447a', 'request_id': 'req-1aeaec13-b5f3-46c8-82d9-98a49f67be02'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:07.289204 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f320f4adb99434498a8452c36d3447a', 'request_id': 'req-1aeaec13-b5f3-46c8-82d9-98a49f67be02'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:07.297054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f320f4adb99434498a8452c36d3447a', 'request_id': 'req-1aeaec13-b5f3-46c8-82d9-98a49f67be02'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:07.310271 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] The token cache is being invalidate because project 4f320f4adb99434498a8452c36d3447a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:36:07.310867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:07.311650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:07.313287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1139/2225] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:36:07 2022] DELETE /identity/v3/projects/4f320f4adb99434498a8452c36d3447a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:36:07.317265 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb38a72-dd5d-4da4-9de9-fdeb4b0ed103 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:07.318868 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-0bb38a72-dd5d-4da4-9de9-fdeb4b0ed103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:07.332417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb38a72-dd5d-4da4-9de9-fdeb4b0ed103 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:07.393521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f62ad-d9ff-4ecc-baf2-3355f7137b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:07.394395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f62ad-d9ff-4ecc-baf2-3355f7137b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:07.394678 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f62ad-d9ff-4ecc-baf2-3355f7137b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:07.394954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f62ad-d9ff-4ecc-baf2-3355f7137b2d admin admin] PATH_INFO: `/v3/users/7a0bb591e3754da19c0c1df9903e459c` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:07.396162 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f62ad-d9ff-4ecc-baf2-3355f7137b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a0bb591e3754da19c0c1df9903e459c)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:07.398605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f62ad-d9ff-4ecc-baf2-3355f7137b2d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:07.448320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-290f62ad-d9ff-4ecc-baf2-3355f7137b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a0bb591e3754da19c0c1df9903e459c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:07.461340 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:07.463587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-290f62ad-d9ff-4ecc-baf2-3355f7137b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a0bb591e3754da19c0c1df9903e459c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:07.466248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-290f62ad-d9ff-4ecc-baf2-3355f7137b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a0bb591e3754da19c0c1df9903e459c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:07.477719 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-290f62ad-d9ff-4ecc-baf2-3355f7137b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a0bb591e3754da19c0c1df9903e459c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:07.478541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-290f62ad-d9ff-4ecc-baf2-3355f7137b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a0bb591e3754da19c0c1df9903e459c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:07.493548 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1087/2226] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:36:07 2022] DELETE /identity/v3/users/7a0bb591e3754da19c0c1df9903e459c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:07.936022 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:07.938367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:07.971103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeaec13-b5f3-46c8-82d9-98a49f67be02 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:08.087963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:08.144314 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acd09f-d503-4e90-9a11-39c0d06b5ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:08.147724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acd09f-d503-4e90-9a11-39c0d06b5ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:08.148014 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acd09f-d503-4e90-9a11-39c0d06b5ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:08.148577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acd09f-d503-4e90-9a11-39c0d06b5ce7 admin admin] PATH_INFO: `/v3/projects/8c186005e09e4e6a8771bb0faaf6e1c3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:08.153457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acd09f-d503-4e90-9a11-39c0d06b5ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c186005e09e4e6a8771bb0faaf6e1c3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:08.157304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acd09f-d503-4e90-9a11-39c0d06b5ce7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:08.222023 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-33acd09f-d503-4e90-9a11-39c0d06b5ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c186005e09e4e6a8771bb0faaf6e1c3', 'request_id': 'req-33acd09f-d503-4e90-9a11-39c0d06b5ce7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:08.228921 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-33acd09f-d503-4e90-9a11-39c0d06b5ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c186005e09e4e6a8771bb0faaf6e1c3', 'request_id': 'req-33acd09f-d503-4e90-9a11-39c0d06b5ce7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:08.237865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-33acd09f-d503-4e90-9a11-39c0d06b5ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c186005e09e4e6a8771bb0faaf6e1c3', 'request_id': 'req-33acd09f-d503-4e90-9a11-39c0d06b5ce7'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:08.258520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-33acd09f-d503-4e90-9a11-39c0d06b5ce7 admin admin] The token cache is being invalidate because project 8c186005e09e4e6a8771bb0faaf6e1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:36:08.258889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-33acd09f-d503-4e90-9a11-39c0d06b5ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:08.259669 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-33acd09f-d503-4e90-9a11-39c0d06b5ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:08.263383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1140/2227] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:36:07 2022] DELETE /identity/v3/projects/8c186005e09e4e6a8771bb0faaf6e1c3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:08.268391 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f51443-8b4b-4c04-bbbf-4d8f421fa9cc None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:08.268764 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f51443-8b4b-4c04-bbbf-4d8f421fa9cc None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:08.269112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f51443-8b4b-4c04-bbbf-4d8f421fa9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:08.294497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-b1f51443-8b4b-4c04-bbbf-4d8f421fa9cc None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:08.295804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b1f51443-8b4b-4c04-bbbf-4d8f421fa9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:08.414195 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1088/2228] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:36:08.416728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b12348-89cd-492e-af08-82caa66a79d1 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:08.417386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b12348-89cd-492e-af08-82caa66a79d1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:08.417845 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b12348-89cd-492e-af08-82caa66a79d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:08.450000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e8b12348-89cd-492e-af08-82caa66a79d1 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:08.452435 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e8b12348-89cd-492e-af08-82caa66a79d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:08.469319 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1141/2229] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:08.469587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f51443-8b4b-4c04-bbbf-4d8f421fa9cc None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:08.485402 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f51443-8b4b-4c04-bbbf-4d8f421fa9cc None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:08.491774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5258d-4a2e-4dea-9a68-04c7f2260d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:08.492654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5258d-4a2e-4dea-9a68-04c7f2260d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:08.493263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5258d-4a2e-4dea-9a68-04c7f2260d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:08.493782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5258d-4a2e-4dea-9a68-04c7f2260d4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:08.495896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5258d-4a2e-4dea-9a68-04c7f2260d4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:36:08.496314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5258d-4a2e-4dea-9a68-04c7f2260d4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:08.499507 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5258d-4a2e-4dea-9a68-04c7f2260d4c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:08.519448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1089/2230] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:36:08.521535 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b12348-89cd-492e-af08-82caa66a79d1 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:08.533644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b12348-89cd-492e-af08-82caa66a79d1 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:08.584506 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f495266-062b-4dee-91a4-5837807555cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:08.586011 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f495266-062b-4dee-91a4-5837807555cb admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:08.586522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f495266-062b-4dee-91a4-5837807555cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:08.587053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f495266-062b-4dee-91a4-5837807555cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:08.588333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f495266-062b-4dee-91a4-5837807555cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:08.592562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f495266-062b-4dee-91a4-5837807555cb admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:08.644493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1142/2231] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:36:08 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:36:08.646450 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5258d-4a2e-4dea-9a68-04c7f2260d4c admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:08.658231 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5258d-4a2e-4dea-9a68-04c7f2260d4c admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:08.748659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037069f-68cd-4f54-9300-d35ad3f4f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:08.749485 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037069f-68cd-4f54-9300-d35ad3f4f833 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:08.749775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037069f-68cd-4f54-9300-d35ad3f4f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:08.750316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037069f-68cd-4f54-9300-d35ad3f4f833 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:08.751011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037069f-68cd-4f54-9300-d35ad3f4f833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:08.753020 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037069f-68cd-4f54-9300-d35ad3f4f833 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:08.783552 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1090/2232] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:36:08 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:36:08.788283 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f495266-062b-4dee-91a4-5837807555cb admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:08.799382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f495266-062b-4dee-91a4-5837807555cb admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:08.805032 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db60ce-2a3e-4bd6-881e-d9e5f8f961a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:08.805721 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db60ce-2a3e-4bd6-881e-d9e5f8f961a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:08.806007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db60ce-2a3e-4bd6-881e-d9e5f8f961a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:08.806284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db60ce-2a3e-4bd6-881e-d9e5f8f961a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:08.807007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db60ce-2a3e-4bd6-881e-d9e5f8f961a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:08.808618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db60ce-2a3e-4bd6-881e-d9e5f8f961a5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:08.820844 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1143/2233] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:36:08.825994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037069f-68cd-4f54-9300-d35ad3f4f833 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:08.837298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037069f-68cd-4f54-9300-d35ad3f4f833 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:08.842186 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb7164-472a-4c3f-b2b0-ab4c15f304ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:08.842843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb7164-472a-4c3f-b2b0-ab4c15f304ba admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:08.843122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb7164-472a-4c3f-b2b0-ab4c15f304ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:08.843396 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb7164-472a-4c3f-b2b0-ab4c15f304ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:08.844152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb7164-472a-4c3f-b2b0-ab4c15f304ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:08.845741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb7164-472a-4c3f-b2b0-ab4c15f304ba admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:08.859809 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1091/2234] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:36:08.863831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db60ce-2a3e-4bd6-881e-d9e5f8f961a5 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:08.873869 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db60ce-2a3e-4bd6-881e-d9e5f8f961a5 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:08.878691 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739fdfc-b289-4c00-b771-b5a074697aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:08.879599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739fdfc-b289-4c00-b771-b5a074697aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:08.879881 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739fdfc-b289-4c00-b771-b5a074697aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:08.880155 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739fdfc-b289-4c00-b771-b5a074697aa0 admin admin] PATH_INFO: `/v3/projects/61e0b30a7fcb4ba7a03fa8789609c806/users/c8d021a31593434bb0e673d59bd79135/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:08.894548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739fdfc-b289-4c00-b771-b5a074697aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e0b30a7fcb4ba7a03fa8789609c806, user_id=c8d021a31593434bb0e673d59bd79135, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:08.897720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739fdfc-b289-4c00-b771-b5a074697aa0 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:08.910597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1144/2235] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:36:08 2022] PUT /identity/v3/projects/61e0b30a7fcb4ba7a03fa8789609c806/users/c8d021a31593434bb0e673d59bd79135/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:08.916454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38acb0-d2a3-4b74-877c-5bf7419064a9 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:08.916825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38acb0-d2a3-4b74-877c-5bf7419064a9 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:08.917263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38acb0-d2a3-4b74-877c-5bf7419064a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:08.936384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-aa38acb0-d2a3-4b74-877c-5bf7419064a9 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:08.937601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-aa38acb0-d2a3-4b74-877c-5bf7419064a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:08.980054 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:08.999072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1092/2236] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:09.010334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739fdfc-b289-4c00-b771-b5a074697aa0 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:09.012296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c739fdfc-b289-4c00-b771-b5a074697aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:09.073356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739fdfc-b289-4c00-b771-b5a074697aa0 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:09.077108 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6443d8-314c-42f5-bb13-8e0aae5a37ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:09.077746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6443d8-314c-42f5-bb13-8e0aae5a37ac service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:09.078027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6443d8-314c-42f5-bb13-8e0aae5a37ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:09.078302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6443d8-314c-42f5-bb13-8e0aae5a37ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:09.088027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6443d8-314c-42f5-bb13-8e0aae5a37ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:09.089445 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6443d8-314c-42f5-bb13-8e0aae5a37ac service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:09.099019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1145/2237] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:36:09.603167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38acb0-d2a3-4b74-877c-5bf7419064a9 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:09.605722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-aa38acb0-d2a3-4b74-877c-5bf7419064a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:09.621725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38acb0-d2a3-4b74-877c-5bf7419064a9 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:09.628756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f774ba-2d17-4c3b-be04-e4d67b243aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:09.629822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f774ba-2d17-4c3b-be04-e4d67b243aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:09.630310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f774ba-2d17-4c3b-be04-e4d67b243aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:09.630728 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f774ba-2d17-4c3b-be04-e4d67b243aea admin admin] PATH_INFO: `/v3/users/f7900511ac3f4b5cb2e238485dbca245` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:09.632960 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f774ba-2d17-4c3b-be04-e4d67b243aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7900511ac3f4b5cb2e238485dbca245)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:09.634970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f774ba-2d17-4c3b-be04-e4d67b243aea admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:09.699899 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-70f774ba-2d17-4c3b-be04-e4d67b243aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7900511ac3f4b5cb2e238485dbca245'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:09.713767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-70f774ba-2d17-4c3b-be04-e4d67b243aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7900511ac3f4b5cb2e238485dbca245'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:09.714818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-70f774ba-2d17-4c3b-be04-e4d67b243aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7900511ac3f4b5cb2e238485dbca245'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:09.723657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-70f774ba-2d17-4c3b-be04-e4d67b243aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7900511ac3f4b5cb2e238485dbca245'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:09.724338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-70f774ba-2d17-4c3b-be04-e4d67b243aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7900511ac3f4b5cb2e238485dbca245'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:09.737789 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1093/2238] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:36:09 2022] DELETE /identity/v3/users/f7900511ac3f4b5cb2e238485dbca245 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:09.743277 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ef9e9-0a83-4e51-ae47-cd2f7ea09cd9 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:09.743840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ef9e9-0a83-4e51-ae47-cd2f7ea09cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:09.743936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ef9e9-0a83-4e51-ae47-cd2f7ea09cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:09.750884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:09.764770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-091ef9e9-0a83-4e51-ae47-cd2f7ea09cd9 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:09.766017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-091ef9e9-0a83-4e51-ae47-cd2f7ea09cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:09.834627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1146/2239] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:09.844829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f774ba-2d17-4c3b-be04-e4d67b243aea admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:09.846446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-70f774ba-2d17-4c3b-be04-e4d67b243aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:09.928707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f774ba-2d17-4c3b-be04-e4d67b243aea admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:09.933026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff871984-cf03-480e-9ac6-3464bc9cefe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:09.933692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff871984-cf03-480e-9ac6-3464bc9cefe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:09.933972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff871984-cf03-480e-9ac6-3464bc9cefe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:09.934396 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff871984-cf03-480e-9ac6-3464bc9cefe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:09.948982 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff871984-cf03-480e-9ac6-3464bc9cefe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:09.950625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff871984-cf03-480e-9ac6-3464bc9cefe1 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:09.970072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1094/2240] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:36:10.313976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ef9e9-0a83-4e51-ae47-cd2f7ea09cd9 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:10.315562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-091ef9e9-0a83-4e51-ae47-cd2f7ea09cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:10.361974 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ef9e9-0a83-4e51-ae47-cd2f7ea09cd9 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:10.380707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fa605-70e6-4f2e-a276-2b4a2fad5156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:10.382224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fa605-70e6-4f2e-a276-2b4a2fad5156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:10.382558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fa605-70e6-4f2e-a276-2b4a2fad5156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:10.382833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fa605-70e6-4f2e-a276-2b4a2fad5156 admin admin] PATH_INFO: `/v3/projects/5db4ccb25b134e7d8b3a61792a2f18c9` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:10.384973 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fa605-70e6-4f2e-a276-2b4a2fad5156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db4ccb25b134e7d8b3a61792a2f18c9)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:10.387301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fa605-70e6-4f2e-a276-2b4a2fad5156 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:10.532307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c67fa605-70e6-4f2e-a276-2b4a2fad5156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db4ccb25b134e7d8b3a61792a2f18c9', 'request_id': 'req-c67fa605-70e6-4f2e-a276-2b4a2fad5156'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:10.547395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c67fa605-70e6-4f2e-a276-2b4a2fad5156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db4ccb25b134e7d8b3a61792a2f18c9', 'request_id': 'req-c67fa605-70e6-4f2e-a276-2b4a2fad5156'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:10.563762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c67fa605-70e6-4f2e-a276-2b4a2fad5156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db4ccb25b134e7d8b3a61792a2f18c9', 'request_id': 'req-c67fa605-70e6-4f2e-a276-2b4a2fad5156'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:10.578314 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c67fa605-70e6-4f2e-a276-2b4a2fad5156 admin admin] The token cache is being invalidate because project 5db4ccb25b134e7d8b3a61792a2f18c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:36:10.578526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c67fa605-70e6-4f2e-a276-2b4a2fad5156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:10.579204 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c67fa605-70e6-4f2e-a276-2b4a2fad5156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:10.580809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1147/2241] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:36:10 2022] DELETE /identity/v3/projects/5db4ccb25b134e7d8b3a61792a2f18c9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:10.585846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821b2e-3aca-435f-87eb-5deed356b13d None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:10.586295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821b2e-3aca-435f-87eb-5deed356b13d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:10.586663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39821b2e-3aca-435f-87eb-5deed356b13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:10.613852 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-39821b2e-3aca-435f-87eb-5deed356b13d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:10.616478 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-39821b2e-3aca-435f-87eb-5deed356b13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:10.741195 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1095/2242] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:10.747901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3b03e-b741-4178-8b09-60e18dcdb086 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:10.748482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3b03e-b741-4178-8b09-60e18dcdb086 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:10.749069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3b03e-b741-4178-8b09-60e18dcdb086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:10.793327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f6b3b03e-b741-4178-8b09-60e18dcdb086 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:10.796577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f6b3b03e-b741-4178-8b09-60e18dcdb086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:10.812611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1148/2243] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:10.817429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39821b2e-3aca-435f-87eb-5deed356b13d None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:10.826758 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:10.840224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39821b2e-3aca-435f-87eb-5deed356b13d None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:10.851929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7e55c-5b74-463b-95c7-0b8005702db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:10.853044 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7e55c-5b74-463b-95c7-0b8005702db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:10.857338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7e55c-5b74-463b-95c7-0b8005702db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:10.858055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7e55c-5b74-463b-95c7-0b8005702db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:10.859739 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7e55c-5b74-463b-95c7-0b8005702db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:36:10.860315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7e55c-5b74-463b-95c7-0b8005702db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:10.864117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7e55c-5b74-463b-95c7-0b8005702db1 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:10.890495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1096/2244] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:36:10.895292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3b03e-b741-4178-8b09-60e18dcdb086 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:10.909943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3b03e-b741-4178-8b09-60e18dcdb086 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:10.921090 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a16d4-a906-48ec-8854-f571af9f44d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:10.926654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a16d4-a906-48ec-8854-f571af9f44d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:10.927211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a16d4-a906-48ec-8854-f571af9f44d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:10.928685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a16d4-a906-48ec-8854-f571af9f44d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:10.929568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a16d4-a906-48ec-8854-f571af9f44d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:10.934762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a16d4-a906-48ec-8854-f571af9f44d6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:10.994596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1149/2245] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:36:10 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:36:10.995762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7e55c-5b74-463b-95c7-0b8005702db1 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:11.011530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7e55c-5b74-463b-95c7-0b8005702db1 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:11.113364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6e65d-d896-44d7-b75e-741a30af211f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:11.114274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e65d-d896-44d7-b75e-741a30af211f admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:11.114729 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e65d-d896-44d7-b75e-741a30af211f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:11.115203 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e65d-d896-44d7-b75e-741a30af211f admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:11.117847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6e65d-d896-44d7-b75e-741a30af211f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:11.121042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6e65d-d896-44d7-b75e-741a30af211f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:11.164905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a16d4-a906-48ec-8854-f571af9f44d6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:11.176339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1097/2246] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:36:10 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:36:11.177727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a16d4-a906-48ec-8854-f571af9f44d6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:11.183518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71982df0-e61b-4ae7-a96f-999e3d8768e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:11.184454 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71982df0-e61b-4ae7-a96f-999e3d8768e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:11.184738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71982df0-e61b-4ae7-a96f-999e3d8768e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:11.185011 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71982df0-e61b-4ae7-a96f-999e3d8768e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:11.185752 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71982df0-e61b-4ae7-a96f-999e3d8768e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:11.187397 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71982df0-e61b-4ae7-a96f-999e3d8768e3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:11.218477 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6e65d-d896-44d7-b75e-741a30af211f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:11.228180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1150/2247] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:36:11.275134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6e65d-d896-44d7-b75e-741a30af211f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:11.291174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399dd3f-2cc2-49c4-b7f5-d8c7797af039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:11.292713 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399dd3f-2cc2-49c4-b7f5-d8c7797af039 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:11.292853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399dd3f-2cc2-49c4-b7f5-d8c7797af039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:11.293280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399dd3f-2cc2-49c4-b7f5-d8c7797af039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:11.294958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399dd3f-2cc2-49c4-b7f5-d8c7797af039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:11.298830 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399dd3f-2cc2-49c4-b7f5-d8c7797af039 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:11.334595 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71982df0-e61b-4ae7-a96f-999e3d8768e3 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:11.358429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1098/2248] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:36:11.368118 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71982df0-e61b-4ae7-a96f-999e3d8768e3 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:11.375839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097aee09-21e8-4a2a-902a-c1c57c30f291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:11.376951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aee09-21e8-4a2a-902a-c1c57c30f291 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:11.377435 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aee09-21e8-4a2a-902a-c1c57c30f291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:11.377776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aee09-21e8-4a2a-902a-c1c57c30f291 admin admin] PATH_INFO: `/v3/projects/e1e2697511564228ad8cc157c8143d09/users/2f665d4a8eec4096925fca3ea6dafcec/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:11.398506 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097aee09-21e8-4a2a-902a-c1c57c30f291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e2697511564228ad8cc157c8143d09, user_id=2f665d4a8eec4096925fca3ea6dafcec, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:11.404700 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097aee09-21e8-4a2a-902a-c1c57c30f291 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:11.447394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1151/2249] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:36:11 2022] PUT /identity/v3/projects/e1e2697511564228ad8cc157c8143d09/users/2f665d4a8eec4096925fca3ea6dafcec/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:11.449279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411cddd-07cd-47ce-a498-c4b81e0481a0 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:11.449576 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411cddd-07cd-47ce-a498-c4b81e0481a0 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:11.449882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411cddd-07cd-47ce-a498-c4b81e0481a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:11.497036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8411cddd-07cd-47ce-a498-c4b81e0481a0 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:11.499136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8411cddd-07cd-47ce-a498-c4b81e0481a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:11.581265 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1099/2250] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:11.590942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097aee09-21e8-4a2a-902a-c1c57c30f291 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:11.593217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-097aee09-21e8-4a2a-902a-c1c57c30f291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:11.625995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:11.664695 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097aee09-21e8-4a2a-902a-c1c57c30f291 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:11.672926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4197af9-61cc-4791-b335-61a1b36dd21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:11.674082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4197af9-61cc-4791-b335-61a1b36dd21e service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:11.674533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4197af9-61cc-4791-b335-61a1b36dd21e service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:11.674979 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4197af9-61cc-4791-b335-61a1b36dd21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:11.692670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4197af9-61cc-4791-b335-61a1b36dd21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:11.695839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4197af9-61cc-4791-b335-61a1b36dd21e service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:11.715116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1152/2251] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:36:13.059509 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8f1fc-8748-45c0-8bd5-ec6fae2d6fb4 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:13.060088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8f1fc-8748-45c0-8bd5-ec6fae2d6fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:13.060088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8f1fc-8748-45c0-8bd5-ec6fae2d6fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:13.113192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-f9d8f1fc-8748-45c0-8bd5-ec6fae2d6fb4 None None] MFA Rules not processed for user `2f665d4a8eec4096925fca3ea6dafcec`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:13.114399 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f9d8f1fc-8748-45c0-8bd5-ec6fae2d6fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:13.224590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:13.234369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1100/2252] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:13.251090 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4197af9-61cc-4791-b335-61a1b36dd21e service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:13.252713 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d4197af9-61cc-4791-b335-61a1b36dd21e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:13.354081 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4197af9-61cc-4791-b335-61a1b36dd21e service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:13.368196 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec9c33-4247-459a-b1f8-975be9995231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:13.368883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9c33-4247-459a-b1f8-975be9995231 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:13.369170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9c33-4247-459a-b1f8-975be9995231 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:13.369451 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9c33-4247-459a-b1f8-975be9995231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:13.379608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec9c33-4247-459a-b1f8-975be9995231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:13.381083 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec9c33-4247-459a-b1f8-975be9995231 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:13.392103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1153/2253] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:36:14.861147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d656f4a-348a-4135-943f-2879dd78607a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:14.861607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d656f4a-348a-4135-943f-2879dd78607a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:14.867959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d656f4a-348a-4135-943f-2879dd78607a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:14.909441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8d656f4a-348a-4135-943f-2879dd78607a None None] MFA Rules not processed for user `2f665d4a8eec4096925fca3ea6dafcec`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:14.910948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8d656f4a-348a-4135-943f-2879dd78607a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:14.942261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1101/2254] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:15.111973 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680331fe-a996-40cd-af89-5a17fad45f5d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:15.112510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680331fe-a996-40cd-af89-5a17fad45f5d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:15.112510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680331fe-a996-40cd-af89-5a17fad45f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:15.153246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-680331fe-a996-40cd-af89-5a17fad45f5d None None] MFA Rules not processed for user `c8d021a31593434bb0e673d59bd79135`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:15.154032 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-680331fe-a996-40cd-af89-5a17fad45f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:15.233621 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1154/2255] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:15.237989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d656f4a-348a-4135-943f-2879dd78607a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:15.239611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8d656f4a-348a-4135-943f-2879dd78607a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:15.257935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d656f4a-348a-4135-943f-2879dd78607a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:15.264679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758822-284b-4fc8-bd02-9efe77d34dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:15.265072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758822-284b-4fc8-bd02-9efe77d34dfc admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:15.265422 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758822-284b-4fc8-bd02-9efe77d34dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:15.265773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63758822-284b-4fc8-bd02-9efe77d34dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:15.267413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63758822-284b-4fc8-bd02-9efe77d34dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:15.269415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63758822-284b-4fc8-bd02-9efe77d34dfc admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:15.297958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1102/2256] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:36:15 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:36:15.301414 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680331fe-a996-40cd-af89-5a17fad45f5d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:15.313988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680331fe-a996-40cd-af89-5a17fad45f5d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:15.373745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b30258-094a-4c49-95f1-ef7e8ca8f1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:15.374679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30258-094a-4c49-95f1-ef7e8ca8f1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:15.375224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30258-094a-4c49-95f1-ef7e8ca8f1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:15.375554 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30258-094a-4c49-95f1-ef7e8ca8f1d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:15.376246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b30258-094a-4c49-95f1-ef7e8ca8f1d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:15.378161 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b30258-094a-4c49-95f1-ef7e8ca8f1d8 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:15.385058 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:15.400543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1155/2257] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:36:15 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:36:15.404524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758822-284b-4fc8-bd02-9efe77d34dfc admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:15.415456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63758822-284b-4fc8-bd02-9efe77d34dfc admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:15.420735 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a3318-48b2-4f0d-83de-8a204ccd86ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:15.421638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3318-48b2-4f0d-83de-8a204ccd86ec admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:15.421988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3318-48b2-4f0d-83de-8a204ccd86ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:15.422330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3318-48b2-4f0d-83de-8a204ccd86ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:15.423145 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a3318-48b2-4f0d-83de-8a204ccd86ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:15.424898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a3318-48b2-4f0d-83de-8a204ccd86ec admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:15.439866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1103/2258] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:36:15.441678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b30258-094a-4c49-95f1-ef7e8ca8f1d8 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:15.455772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b30258-094a-4c49-95f1-ef7e8ca8f1d8 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:15.460628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd77a5e-baef-4b19-971f-e6d826de8bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:15.461600 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77a5e-baef-4b19-971f-e6d826de8bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:15.461997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77a5e-baef-4b19-971f-e6d826de8bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:15.462308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd77a5e-baef-4b19-971f-e6d826de8bf6 admin admin] PATH_INFO: `/v3/projects/d104dd84f3304c27b11bd2d9391b6506/users/0bdc03d6e33249d79709248a4ce20371/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:15.484570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd77a5e-baef-4b19-971f-e6d826de8bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d104dd84f3304c27b11bd2d9391b6506, user_id=0bdc03d6e33249d79709248a4ce20371, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:15.487424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd77a5e-baef-4b19-971f-e6d826de8bf6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:15.512959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1156/2259] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:36:15 2022] PUT /identity/v3/projects/d104dd84f3304c27b11bd2d9391b6506/users/0bdc03d6e33249d79709248a4ce20371/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:15.517007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a3318-48b2-4f0d-83de-8a204ccd86ec admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:15.527812 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a3318-48b2-4f0d-83de-8a204ccd86ec admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:15.607224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fe9d7-1f52-4fb5-bb25-ed7d5116601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:15.608113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fe9d7-1f52-4fb5-bb25-ed7d5116601b admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:15.608544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fe9d7-1f52-4fb5-bb25-ed7d5116601b admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:15.609131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fe9d7-1f52-4fb5-bb25-ed7d5116601b admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:15.610560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fe9d7-1f52-4fb5-bb25-ed7d5116601b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:15.612538 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fe9d7-1f52-4fb5-bb25-ed7d5116601b admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:15.625290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1104/2260] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:36:15.629811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd77a5e-baef-4b19-971f-e6d826de8bf6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:15.642101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd77a5e-baef-4b19-971f-e6d826de8bf6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:15.647524 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff1e5b-4fb8-4bae-ba69-073d7d9ac459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:15.648601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff1e5b-4fb8-4bae-ba69-073d7d9ac459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:15.648952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff1e5b-4fb8-4bae-ba69-073d7d9ac459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:15.649230 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff1e5b-4fb8-4bae-ba69-073d7d9ac459 admin admin] PATH_INFO: `/v3/projects/d104dd84f3304c27b11bd2d9391b6506/users/0bdc03d6e33249d79709248a4ce20371/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:15.651246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff1e5b-4fb8-4bae-ba69-073d7d9ac459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d104dd84f3304c27b11bd2d9391b6506, user_id=0bdc03d6e33249d79709248a4ce20371, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:15.655079 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff1e5b-4fb8-4bae-ba69-073d7d9ac459 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:15.667318 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1157/2261] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:36:15 2022] PUT /identity/v3/projects/d104dd84f3304c27b11bd2d9391b6506/users/0bdc03d6e33249d79709248a4ce20371/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:23.112427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fa61c-81d7-46ae-8950-c05515710f62 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:23.112953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fa61c-81d7-46ae-8950-c05515710f62 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:23.112953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fa61c-81d7-46ae-8950-c05515710f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:23.145786 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-388fa61c-81d7-46ae-8950-c05515710f62 None None] MFA Rules not processed for user `0bdc03d6e33249d79709248a4ce20371`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:23.147784 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-388fa61c-81d7-46ae-8950-c05515710f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:23.220065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1105/2262] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:23.235322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff1e5b-4fb8-4bae-ba69-073d7d9ac459 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:23.237144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8eff1e5b-4fb8-4bae-ba69-073d7d9ac459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:23.302915 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff1e5b-4fb8-4bae-ba69-073d7d9ac459 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:23.306833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ccf82-05a5-4c01-aa26-76621a28cea8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f1b06364a24554bba9936621127752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:23.307605 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ccf82-05a5-4c01-aa26-76621a28cea8 service glance] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:23.307960 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ccf82-05a5-4c01-aa26-76621a28cea8 service glance] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:23.308306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ccf82-05a5-4c01-aa26-76621a28cea8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:23.387952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ccf82-05a5-4c01-aa26-76621a28cea8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:23.389617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ccf82-05a5-4c01-aa26-76621a28cea8 service glance] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:23.400047 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1158/2263] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:36:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:36:23.553932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5837a-f67c-43d8-a6ee-f5594ac9f069 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:23.554293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5837a-f67c-43d8-a6ee-f5594ac9f069 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:23.554636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5837a-f67c-43d8-a6ee-f5594ac9f069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:23.574549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-34a5837a-f67c-43d8-a6ee-f5594ac9f069 None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:23.576218 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-34a5837a-f67c-43d8-a6ee-f5594ac9f069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:23.616952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:23.644984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1106/2264] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:36:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:23.704433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ccf82-05a5-4c01-aa26-76621a28cea8 service glance] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:23.706035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d29ccf82-05a5-4c01-aa26-76621a28cea8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:23.779828 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ccf82-05a5-4c01-aa26-76621a28cea8 service glance] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:23.785933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1b502-1806-4a7e-a8e4-97068cbfe148 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:23.786596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b502-1806-4a7e-a8e4-97068cbfe148 service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:23.786878 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b502-1806-4a7e-a8e4-97068cbfe148 service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:23.787186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b502-1806-4a7e-a8e4-97068cbfe148 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:23.794013 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:23.796875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1b502-1806-4a7e-a8e4-97068cbfe148 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:23.799182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1b502-1806-4a7e-a8e4-97068cbfe148 service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:23.809779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1159/2265] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:36:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 10:36:26.427868 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5837a-f67c-43d8-a6ee-f5594ac9f069 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:26.623193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5837a-f67c-43d8-a6ee-f5594ac9f069 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:26.692196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca39401-0141-4dbc-b387-395e742ee48b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:26.692196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca39401-0141-4dbc-b387-395e742ee48b service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:26.692196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca39401-0141-4dbc-b387-395e742ee48b service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:26.692196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca39401-0141-4dbc-b387-395e742ee48b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:26.708816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-cca39401-0141-4dbc-b387-395e742ee48b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:26.820283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca39401-0141-4dbc-b387-395e742ee48b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:26.822295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca39401-0141-4dbc-b387-395e742ee48b service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:26.837226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1107/2266] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:36:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:36:33.805946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:33.872606 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304ff64-c344-4c26-b193-f2081c16606c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:33.872891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304ff64-c344-4c26-b193-f2081c16606c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:33.873261 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304ff64-c344-4c26-b193-f2081c16606c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:33.899819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2304ff64-c344-4c26-b193-f2081c16606c None None] MFA Rules not processed for user `c8d021a31593434bb0e673d59bd79135`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:33.901228 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2304ff64-c344-4c26-b193-f2081c16606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:33.908643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1160/2267] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:36.829187 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=57 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:39.214253 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0d2b6-8aae-40dc-b84f-32ac6cb498e9 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:39.214871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0d2b6-8aae-40dc-b84f-32ac6cb498e9 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:39.214978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0d2b6-8aae-40dc-b84f-32ac6cb498e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:39.235260 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-b2d0d2b6-8aae-40dc-b84f-32ac6cb498e9 None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:39.236504 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b2d0d2b6-8aae-40dc-b84f-32ac6cb498e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:39.244772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1108/2268] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:36:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:39.260714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304ff64-c344-4c26-b193-f2081c16606c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:39.273301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304ff64-c344-4c26-b193-f2081c16606c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:39.280936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919e3a2-b9c4-4744-bba1-8ea48aa4047d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:39.281241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919e3a2-b9c4-4744-bba1-8ea48aa4047d service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:39.281397 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919e3a2-b9c4-4744-bba1-8ea48aa4047d service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:39.281838 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919e3a2-b9c4-4744-bba1-8ea48aa4047d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:39.291967 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919e3a2-b9c4-4744-bba1-8ea48aa4047d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:39.293695 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919e3a2-b9c4-4744-bba1-8ea48aa4047d service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:39.304533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1161/2269] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:36:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 10:36:49.230375 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:49.299520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=9 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:52.690209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0d2b6-8aae-40dc-b84f-32ac6cb498e9 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:52.691731 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b2d0d2b6-8aae-40dc-b84f-32ac6cb498e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:52.835224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0d2b6-8aae-40dc-b84f-32ac6cb498e9 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:52.840132 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b2851-7812-4c86-9937-9856697525f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:52.841140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b2851-7812-4c86-9937-9856697525f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:52.841612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b2851-7812-4c86-9937-9856697525f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:52.842204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b2851-7812-4c86-9937-9856697525f6 admin admin] PATH_INFO: `/v3/users/6c83f5854e9940429858fd746b7ba57e` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:52.846939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b2851-7812-4c86-9937-9856697525f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c83f5854e9940429858fd746b7ba57e)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:52.846939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b2851-7812-4c86-9937-9856697525f6 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:52.898763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-996b2851-7812-4c86-9937-9856697525f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c83f5854e9940429858fd746b7ba57e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:52.917022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-996b2851-7812-4c86-9937-9856697525f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c83f5854e9940429858fd746b7ba57e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:52.917954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-996b2851-7812-4c86-9937-9856697525f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c83f5854e9940429858fd746b7ba57e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:52.928007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-996b2851-7812-4c86-9937-9856697525f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c83f5854e9940429858fd746b7ba57e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:52.928853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-996b2851-7812-4c86-9937-9856697525f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c83f5854e9940429858fd746b7ba57e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:52.946622 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1109/2270] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:36:52 2022] DELETE /identity/v3/users/6c83f5854e9940429858fd746b7ba57e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:53.159939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919e3a2-b9c4-4744-bba1-8ea48aa4047d service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:53.202152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919e3a2-b9c4-4744-bba1-8ea48aa4047d service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:53.269302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:53.270210 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:53.270498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:53.270784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] PATH_INFO: `/v3/projects/c6533f6f633049a59463cefca0c38ecd` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:53.272623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6533f6f633049a59463cefca0c38ecd)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:53.274585 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:53.323563 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6533f6f633049a59463cefca0c38ecd', 'request_id': 'req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.329025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6533f6f633049a59463cefca0c38ecd', 'request_id': 'req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.336982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6533f6f633049a59463cefca0c38ecd', 'request_id': 'req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.348559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] The token cache is being invalidate because project c6533f6f633049a59463cefca0c38ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:36:53.348842 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.350085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.351597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1162/2271] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:36:53 2022] DELETE /identity/v3/projects/c6533f6f633049a59463cefca0c38ecd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:53.355416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b2851-7812-4c86-9937-9856697525f6 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:53.356861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-996b2851-7812-4c86-9937-9856697525f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:53.370205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b2851-7812-4c86-9937-9856697525f6 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:53.385279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:53.439180 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4e568-9883-4eae-8ce1-d2e4d4f35da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:53.440152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4e568-9883-4eae-8ce1-d2e4d4f35da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:53.440437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4e568-9883-4eae-8ce1-d2e4d4f35da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:53.440714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4e568-9883-4eae-8ce1-d2e4d4f35da7 admin admin] PATH_INFO: `/v3/users/041e32ab81e744a2b0e2714573c0dc85` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:53.442120 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4e568-9883-4eae-8ce1-d2e4d4f35da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=041e32ab81e744a2b0e2714573c0dc85)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:53.444287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4e568-9883-4eae-8ce1-d2e4d4f35da7 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:53.498088 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-60b4e568-9883-4eae-8ce1-d2e4d4f35da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041e32ab81e744a2b0e2714573c0dc85'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.513728 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-60b4e568-9883-4eae-8ce1-d2e4d4f35da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041e32ab81e744a2b0e2714573c0dc85'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.514067 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-60b4e568-9883-4eae-8ce1-d2e4d4f35da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041e32ab81e744a2b0e2714573c0dc85'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.525521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-60b4e568-9883-4eae-8ce1-d2e4d4f35da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041e32ab81e744a2b0e2714573c0dc85'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.526161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-60b4e568-9883-4eae-8ce1-d2e4d4f35da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041e32ab81e744a2b0e2714573c0dc85'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.541737 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1110/2272] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:36:53 2022] DELETE /identity/v3/users/041e32ab81e744a2b0e2714573c0dc85 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:53.739302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:53.740780 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:53.758635 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee870b0-d093-4cc2-a2ab-03485a2c19a6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:53.819153 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c30776-62c1-4660-a719-ca3252c1409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:53.820035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c30776-62c1-4660-a719-ca3252c1409f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:53.820313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c30776-62c1-4660-a719-ca3252c1409f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:53.820580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c30776-62c1-4660-a719-ca3252c1409f admin admin] PATH_INFO: `/v3/projects/ad1bbf22c2b54906b2139a119aa79440` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:53.821750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c30776-62c1-4660-a719-ca3252c1409f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1bbf22c2b54906b2139a119aa79440)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:53.823675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c30776-62c1-4660-a719-ca3252c1409f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:53.831763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:53.876174 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b6c30776-62c1-4660-a719-ca3252c1409f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1bbf22c2b54906b2139a119aa79440', 'request_id': 'req-b6c30776-62c1-4660-a719-ca3252c1409f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.882213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b6c30776-62c1-4660-a719-ca3252c1409f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1bbf22c2b54906b2139a119aa79440', 'request_id': 'req-b6c30776-62c1-4660-a719-ca3252c1409f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.889623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b6c30776-62c1-4660-a719-ca3252c1409f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1bbf22c2b54906b2139a119aa79440', 'request_id': 'req-b6c30776-62c1-4660-a719-ca3252c1409f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.901325 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b6c30776-62c1-4660-a719-ca3252c1409f admin admin] The token cache is being invalidate because project ad1bbf22c2b54906b2139a119aa79440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:36:53.901603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b6c30776-62c1-4660-a719-ca3252c1409f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.902284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b6c30776-62c1-4660-a719-ca3252c1409f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:36:53.904018 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1163/2273] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:36:53 2022] DELETE /identity/v3/projects/ad1bbf22c2b54906b2139a119aa79440 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:36:53.909063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187323df-9eee-473b-b7ea-30abb9e9a0cd None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:53.909550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187323df-9eee-473b-b7ea-30abb9e9a0cd None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:53.909653 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187323df-9eee-473b-b7ea-30abb9e9a0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:53.964860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-187323df-9eee-473b-b7ea-30abb9e9a0cd None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:53.966211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-187323df-9eee-473b-b7ea-30abb9e9a0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:54.029863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1111/2274] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:54.037545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e6ab0-b74f-4fca-a739-1fd090b6ddd3 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:54.037810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e6ab0-b74f-4fca-a739-1fd090b6ddd3 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:54.038186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e6ab0-b74f-4fca-a739-1fd090b6ddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:54.059085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1c4e6ab0-b74f-4fca-a739-1fd090b6ddd3 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:54.060507 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1c4e6ab0-b74f-4fca-a739-1fd090b6ddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:54.069675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1164/2275] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:54.074313 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187323df-9eee-473b-b7ea-30abb9e9a0cd None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:54.084702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187323df-9eee-473b-b7ea-30abb9e9a0cd None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:54.090168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ad9a0-3044-445d-9194-ac6ddf447695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:54.090828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ad9a0-3044-445d-9194-ac6ddf447695 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:54.091101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ad9a0-3044-445d-9194-ac6ddf447695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:54.091413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ad9a0-3044-445d-9194-ac6ddf447695 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:54.092170 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ad9a0-3044-445d-9194-ac6ddf447695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:36:54.092473 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ad9a0-3044-445d-9194-ac6ddf447695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:54.094621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ad9a0-3044-445d-9194-ac6ddf447695 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:54.107196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1112/2276] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:36:54.111938 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e6ab0-b74f-4fca-a739-1fd090b6ddd3 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:54.122050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e6ab0-b74f-4fca-a739-1fd090b6ddd3 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:54.127434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbcca8-4322-4ced-85ce-1e448cbbc6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:54.127904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbcca8-4322-4ced-85ce-1e448cbbc6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:54.128317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbcca8-4322-4ced-85ce-1e448cbbc6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:54.128626 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbcca8-4322-4ced-85ce-1e448cbbc6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:54.129324 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbcca8-4322-4ced-85ce-1e448cbbc6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:54.131911 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbcca8-4322-4ced-85ce-1e448cbbc6a8 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:54.158909 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1165/2277] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:36:54 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:36:54.163394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ad9a0-3044-445d-9194-ac6ddf447695 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:54.168888 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:36:54.175955 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ad9a0-3044-445d-9194-ac6ddf447695 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:54.245285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee6be9-098d-4814-a9b4-ab8742c8e8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:54.246116 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee6be9-098d-4814-a9b4-ab8742c8e8be admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:54.246503 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee6be9-098d-4814-a9b4-ab8742c8e8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:54.246918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee6be9-098d-4814-a9b4-ab8742c8e8be admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:54.247691 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee6be9-098d-4814-a9b4-ab8742c8e8be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:54.249727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee6be9-098d-4814-a9b4-ab8742c8e8be admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:54.273803 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1113/2278] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:36:54 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:36:54.278166 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbcca8-4322-4ced-85ce-1e448cbbc6a8 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:54.290683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbcca8-4322-4ced-85ce-1e448cbbc6a8 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:54.295675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629ab3f-a0b9-46fe-97d1-8f1e8967d6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:54.296638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629ab3f-a0b9-46fe-97d1-8f1e8967d6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:54.297031 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629ab3f-a0b9-46fe-97d1-8f1e8967d6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:54.298585 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629ab3f-a0b9-46fe-97d1-8f1e8967d6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:54.299642 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629ab3f-a0b9-46fe-97d1-8f1e8967d6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:54.306337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629ab3f-a0b9-46fe-97d1-8f1e8967d6b7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:54.320415 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1166/2279] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:36:54.324608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee6be9-098d-4814-a9b4-ab8742c8e8be admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:54.334810 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee6be9-098d-4814-a9b4-ab8742c8e8be admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:54.340618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76936faf-998d-4e0a-b9f5-2ca148940173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:54.341418 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936faf-998d-4e0a-b9f5-2ca148940173 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:54.341693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936faf-998d-4e0a-b9f5-2ca148940173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:54.341989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76936faf-998d-4e0a-b9f5-2ca148940173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:54.342722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76936faf-998d-4e0a-b9f5-2ca148940173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:54.344371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76936faf-998d-4e0a-b9f5-2ca148940173 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:54.355256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1114/2280] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:36:54.359600 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629ab3f-a0b9-46fe-97d1-8f1e8967d6b7 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:54.370567 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629ab3f-a0b9-46fe-97d1-8f1e8967d6b7 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:54.375217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513e53f-44b0-4281-a4b2-81399d345d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:54.376387 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513e53f-44b0-4281-a4b2-81399d345d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:54.376906 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513e53f-44b0-4281-a4b2-81399d345d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:54.376906 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513e53f-44b0-4281-a4b2-81399d345d3e admin admin] PATH_INFO: `/v3/projects/aa2d1bf2591c47b19db1e2fe78f93ab1/users/0ea3155c3ce44ee882a683282fc730c6/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:54.392755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513e53f-44b0-4281-a4b2-81399d345d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2d1bf2591c47b19db1e2fe78f93ab1, user_id=0ea3155c3ce44ee882a683282fc730c6, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:54.395411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513e53f-44b0-4281-a4b2-81399d345d3e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:54.410951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1167/2281] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:36:54 2022] PUT /identity/v3/projects/aa2d1bf2591c47b19db1e2fe78f93ab1/users/0ea3155c3ce44ee882a683282fc730c6/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:36:54.422440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18153c-4d51-4d38-a0a6-d56ef9ba1834 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:54.422731 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18153c-4d51-4d38-a0a6-d56ef9ba1834 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:54.423011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18153c-4d51-4d38-a0a6-d56ef9ba1834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:54.450222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-7f18153c-4d51-4d38-a0a6-d56ef9ba1834 None None] MFA Rules not processed for user `0ea3155c3ce44ee882a683282fc730c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:36:54.451505 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7f18153c-4d51-4d38-a0a6-d56ef9ba1834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:54.520169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1115/2282] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:36:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:36:54.532288 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513e53f-44b0-4281-a4b2-81399d345d3e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:36:54.534410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2513e53f-44b0-4281-a4b2-81399d345d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:36:54.636643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513e53f-44b0-4281-a4b2-81399d345d3e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:36:54.641232 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375aee14-6083-4ba3-b5b9-dd477d72ce8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f1b06364a24554bba9936621127752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:36:54.642365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aee14-6083-4ba3-b5b9-dd477d72ce8a service glance] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:36:54.642365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aee14-6083-4ba3-b5b9-dd477d72ce8a service glance] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:36:54.642365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aee14-6083-4ba3-b5b9-dd477d72ce8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:36:54.652431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aee14-6083-4ba3-b5b9-dd477d72ce8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:36:54.657258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aee14-6083-4ba3-b5b9-dd477d72ce8a service glance] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:36:54.679587 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1168/2283] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:36:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:37:04.516843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:04.663940 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:20.352762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e73e4-4cd9-428a-af42-6cdd45b63bc0 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:20.353295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e73e4-4cd9-428a-af42-6cdd45b63bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:20.353504 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e73e4-4cd9-428a-af42-6cdd45b63bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:20.372918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-603e73e4-4cd9-428a-af42-6cdd45b63bc0 None None] MFA Rules not processed for user `76ccc16f729b4042916db8c1183d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:20.374089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-603e73e4-4cd9-428a-af42-6cdd45b63bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:20.453383 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1116/2284] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:37:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:37:21.677611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5284ed-1968-475c-a4cc-950d752034b7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:21.678848 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5284ed-1968-475c-a4cc-950d752034b7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:21.679042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5284ed-1968-475c-a4cc-950d752034b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:21.720883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2c5284ed-1968-475c-a4cc-950d752034b7 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:21.722245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2c5284ed-1968-475c-a4cc-950d752034b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:21.791436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1169/2285] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Jun 15 10:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:37:21.923256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e73e4-4cd9-428a-af42-6cdd45b63bc0 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:21.924790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-603e73e4-4cd9-428a-af42-6cdd45b63bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:22.027170 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603e73e4-4cd9-428a-af42-6cdd45b63bc0 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:22.033162 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7c3f1-338c-4125-a060-fe19bec4d44a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:22.033852 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c3f1-338c-4125-a060-fe19bec4d44a service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:22.034134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c3f1-338c-4125-a060-fe19bec4d44a service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:22.034409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7c3f1-338c-4125-a060-fe19bec4d44a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:22.043173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7c3f1-338c-4125-a060-fe19bec4d44a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:22.044932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7c3f1-338c-4125-a060-fe19bec4d44a service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:22.054601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1117/2286] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:37:22.875201 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5284ed-1968-475c-a4cc-950d752034b7 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:22.885292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5284ed-1968-475c-a4cc-950d752034b7 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:22.889839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853fd39-cc14-498f-82a4-f8296a5eb619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:22.890714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853fd39-cc14-498f-82a4-f8296a5eb619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:22.890990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853fd39-cc14-498f-82a4-f8296a5eb619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:22.891265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853fd39-cc14-498f-82a4-f8296a5eb619 admin admin] PATH_INFO: `/v3/users/0ea3155c3ce44ee882a683282fc730c6` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:22.892548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853fd39-cc14-498f-82a4-f8296a5eb619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea3155c3ce44ee882a683282fc730c6)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:22.894443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853fd39-cc14-498f-82a4-f8296a5eb619 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:22.953015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7853fd39-cc14-498f-82a4-f8296a5eb619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea3155c3ce44ee882a683282fc730c6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:22.965284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7853fd39-cc14-498f-82a4-f8296a5eb619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea3155c3ce44ee882a683282fc730c6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:22.966043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7853fd39-cc14-498f-82a4-f8296a5eb619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea3155c3ce44ee882a683282fc730c6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:22.973337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7853fd39-cc14-498f-82a4-f8296a5eb619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea3155c3ce44ee882a683282fc730c6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:22.982356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7853fd39-cc14-498f-82a4-f8296a5eb619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea3155c3ce44ee882a683282fc730c6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:22.988571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1170/2287] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:37:22 2022] DELETE /identity/v3/users/0ea3155c3ce44ee882a683282fc730c6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:37:22.994183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9138d3-8251-421b-868b-e124e55295b0 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:22.995797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9138d3-8251-421b-868b-e124e55295b0 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:22.995797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9138d3-8251-421b-868b-e124e55295b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:23.018981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-7b9138d3-8251-421b-868b-e124e55295b0 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:23.018981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7b9138d3-8251-421b-868b-e124e55295b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:23.092085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1118/2288] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:37:23.103674 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853fd39-cc14-498f-82a4-f8296a5eb619 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:23.105410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7853fd39-cc14-498f-82a4-f8296a5eb619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:23.179839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:23.188598 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853fd39-cc14-498f-82a4-f8296a5eb619 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:23.192729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c85e4-fa12-4122-8e01-dca24873ab17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:23.193493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c85e4-fa12-4122-8e01-dca24873ab17 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:23.193775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c85e4-fa12-4122-8e01-dca24873ab17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:23.194070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c85e4-fa12-4122-8e01-dca24873ab17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:23.203267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c85e4-fa12-4122-8e01-dca24873ab17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:23.204715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c85e4-fa12-4122-8e01-dca24873ab17 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:23.214438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1171/2289] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:37:23.520648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9138d3-8251-421b-868b-e124e55295b0 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:23.522767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7b9138d3-8251-421b-868b-e124e55295b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:23.539275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:23.545046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9138d3-8251-421b-868b-e124e55295b0 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:23.550959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b088f86-ac7e-4953-92e4-e3dec7520447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:23.552457 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b088f86-ac7e-4953-92e4-e3dec7520447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:23.552457 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b088f86-ac7e-4953-92e4-e3dec7520447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:23.552750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b088f86-ac7e-4953-92e4-e3dec7520447 admin admin] PATH_INFO: `/v3/projects/aa2d1bf2591c47b19db1e2fe78f93ab1` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:23.554267 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b088f86-ac7e-4953-92e4-e3dec7520447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa2d1bf2591c47b19db1e2fe78f93ab1)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:23.556610 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b088f86-ac7e-4953-92e4-e3dec7520447 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:23.617942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3b088f86-ac7e-4953-92e4-e3dec7520447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa2d1bf2591c47b19db1e2fe78f93ab1', 'request_id': 'req-3b088f86-ac7e-4953-92e4-e3dec7520447'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:23.626021 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3b088f86-ac7e-4953-92e4-e3dec7520447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa2d1bf2591c47b19db1e2fe78f93ab1', 'request_id': 'req-3b088f86-ac7e-4953-92e4-e3dec7520447'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:23.633458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3b088f86-ac7e-4953-92e4-e3dec7520447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa2d1bf2591c47b19db1e2fe78f93ab1', 'request_id': 'req-3b088f86-ac7e-4953-92e4-e3dec7520447'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:23.653429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3b088f86-ac7e-4953-92e4-e3dec7520447 admin admin] The token cache is being invalidate because project aa2d1bf2591c47b19db1e2fe78f93ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:37:23.653799 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3b088f86-ac7e-4953-92e4-e3dec7520447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:23.654371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-3b088f86-ac7e-4953-92e4-e3dec7520447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:23.656223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1119/2290] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:37:23 2022] DELETE /identity/v3/projects/aa2d1bf2591c47b19db1e2fe78f93ab1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:37:23.660847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17a88a-4780-4a58-b6bc-99edafed9afa None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:23.661207 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17a88a-4780-4a58-b6bc-99edafed9afa None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:23.661569 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17a88a-4780-4a58-b6bc-99edafed9afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:23.681648 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6f17a88a-4780-4a58-b6bc-99edafed9afa None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:23.682290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6f17a88a-4780-4a58-b6bc-99edafed9afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:23.769629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1172/2291] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:37:23.777807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98260092-8d49-4df3-b436-0fc069b060c1 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:23.778101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98260092-8d49-4df3-b436-0fc069b060c1 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:23.778384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98260092-8d49-4df3-b436-0fc069b060c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:23.797486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-98260092-8d49-4df3-b436-0fc069b060c1 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:23.798687 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-98260092-8d49-4df3-b436-0fc069b060c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:23.807333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1120/2292] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:37:23.811418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17a88a-4780-4a58-b6bc-99edafed9afa None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:23.821599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17a88a-4780-4a58-b6bc-99edafed9afa None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:23.826194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94d7b6-b2d6-4f11-a3fd-959b0f392e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:23.826842 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94d7b6-b2d6-4f11-a3fd-959b0f392e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:23.827124 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94d7b6-b2d6-4f11-a3fd-959b0f392e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:23.827401 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94d7b6-b2d6-4f11-a3fd-959b0f392e49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:23.828154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94d7b6-b2d6-4f11-a3fd-959b0f392e49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:37:23.828465 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94d7b6-b2d6-4f11-a3fd-959b0f392e49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:23.830070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94d7b6-b2d6-4f11-a3fd-959b0f392e49 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:23.842081 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1173/2293] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:37:23.846557 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98260092-8d49-4df3-b436-0fc069b060c1 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:23.855887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98260092-8d49-4df3-b436-0fc069b060c1 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:23.860673 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa99570-ba3c-450a-b258-42418d4d31d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:23.861322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa99570-ba3c-450a-b258-42418d4d31d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:23.861608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa99570-ba3c-450a-b258-42418d4d31d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:23.861881 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa99570-ba3c-450a-b258-42418d4d31d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:23.862557 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa99570-ba3c-450a-b258-42418d4d31d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:23.864504 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa99570-ba3c-450a-b258-42418d4d31d0 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:23.891941 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1121/2294] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:37:23 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:37:23.896277 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94d7b6-b2d6-4f11-a3fd-959b0f392e49 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:23.907033 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94d7b6-b2d6-4f11-a3fd-959b0f392e49 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:23.965389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b7666-5052-463a-926a-cdbcccbcabc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:23.966087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b7666-5052-463a-926a-cdbcccbcabc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:23.966365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b7666-5052-463a-926a-cdbcccbcabc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:23.966638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b7666-5052-463a-926a-cdbcccbcabc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:23.967345 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b7666-5052-463a-926a-cdbcccbcabc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:23.969308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b7666-5052-463a-926a-cdbcccbcabc6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:23.993804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1174/2295] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:37:23 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:37:23.998442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa99570-ba3c-450a-b258-42418d4d31d0 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:24.010372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa99570-ba3c-450a-b258-42418d4d31d0 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:24.016277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a4ce6-d9ce-49f5-8735-08ad452354b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:24.017089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4ce6-d9ce-49f5-8735-08ad452354b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:24.017351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4ce6-d9ce-49f5-8735-08ad452354b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:24.017637 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a4ce6-d9ce-49f5-8735-08ad452354b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:24.018355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a4ce6-d9ce-49f5-8735-08ad452354b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:24.019988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a4ce6-d9ce-49f5-8735-08ad452354b0 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:24.031042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1122/2296] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:37:24.034975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b7666-5052-463a-926a-cdbcccbcabc6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:24.046019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b7666-5052-463a-926a-cdbcccbcabc6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:24.051487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eedbcd-2fe6-42ad-9ba8-c3c03074da89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:24.052150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eedbcd-2fe6-42ad-9ba8-c3c03074da89 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:24.052428 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eedbcd-2fe6-42ad-9ba8-c3c03074da89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:24.052701 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eedbcd-2fe6-42ad-9ba8-c3c03074da89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:24.054006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eedbcd-2fe6-42ad-9ba8-c3c03074da89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:24.055641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eedbcd-2fe6-42ad-9ba8-c3c03074da89 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:24.066262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1175/2297] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:37:24.071149 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a4ce6-d9ce-49f5-8735-08ad452354b0 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:24.082189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a4ce6-d9ce-49f5-8735-08ad452354b0 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:24.086842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6836a2-0004-496f-b751-f7c3cee788e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:24.087827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6836a2-0004-496f-b751-f7c3cee788e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:24.088107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6836a2-0004-496f-b751-f7c3cee788e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:24.088379 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6836a2-0004-496f-b751-f7c3cee788e2 admin admin] PATH_INFO: `/v3/projects/5b1fb77fdd774b3ebd082c1b3a2f462c/users/16ffe29b3101418aa2bacc5cadb96ab6/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:24.103861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6836a2-0004-496f-b751-f7c3cee788e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1fb77fdd774b3ebd082c1b3a2f462c, user_id=16ffe29b3101418aa2bacc5cadb96ab6, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:24.106662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6836a2-0004-496f-b751-f7c3cee788e2 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:24.123655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1123/2298] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:37:24 2022] PUT /identity/v3/projects/5b1fb77fdd774b3ebd082c1b3a2f462c/users/16ffe29b3101418aa2bacc5cadb96ab6/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:37:24.135762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025726e-e63c-4e82-a2d9-46817310a4e8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:24.136417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025726e-e63c-4e82-a2d9-46817310a4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:24.136829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025726e-e63c-4e82-a2d9-46817310a4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:24.166300 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-0025726e-e63c-4e82-a2d9-46817310a4e8 None None] MFA Rules not processed for user `16ffe29b3101418aa2bacc5cadb96ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:24.167629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0025726e-e63c-4e82-a2d9-46817310a4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:24.212556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:24.238718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1176/2299] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:37:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:37:24.250829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6836a2-0004-496f-b751-f7c3cee788e2 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:24.252957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-fd6836a2-0004-496f-b751-f7c3cee788e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:24.333933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6836a2-0004-496f-b751-f7c3cee788e2 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:24.337686 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610a8ea-f38c-4409-80fd-cc57a3243c58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:24.338344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610a8ea-f38c-4409-80fd-cc57a3243c58 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:24.338627 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610a8ea-f38c-4409-80fd-cc57a3243c58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:24.338924 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610a8ea-f38c-4409-80fd-cc57a3243c58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:24.350587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610a8ea-f38c-4409-80fd-cc57a3243c58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:24.352042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610a8ea-f38c-4409-80fd-cc57a3243c58 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:24.363767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1124/2300] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:37:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:37:24.395899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025726e-e63c-4e82-a2d9-46817310a4e8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:24.472616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025726e-e63c-4e82-a2d9-46817310a4e8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:24.478013 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24892c11-8a5b-4c79-a1fa-9dd85a70e2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:24.478887 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24892c11-8a5b-4c79-a1fa-9dd85a70e2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:24.479165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24892c11-8a5b-4c79-a1fa-9dd85a70e2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:24.479632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24892c11-8a5b-4c79-a1fa-9dd85a70e2a3 admin admin] PATH_INFO: `/v3/users/16ffe29b3101418aa2bacc5cadb96ab6` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:24.480683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24892c11-8a5b-4c79-a1fa-9dd85a70e2a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ffe29b3101418aa2bacc5cadb96ab6)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:24.482599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24892c11-8a5b-4c79-a1fa-9dd85a70e2a3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:24.536832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-24892c11-8a5b-4c79-a1fa-9dd85a70e2a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ffe29b3101418aa2bacc5cadb96ab6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:24.557269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-24892c11-8a5b-4c79-a1fa-9dd85a70e2a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ffe29b3101418aa2bacc5cadb96ab6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:24.558085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-24892c11-8a5b-4c79-a1fa-9dd85a70e2a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ffe29b3101418aa2bacc5cadb96ab6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:24.565992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-24892c11-8a5b-4c79-a1fa-9dd85a70e2a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ffe29b3101418aa2bacc5cadb96ab6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:24.579913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-24892c11-8a5b-4c79-a1fa-9dd85a70e2a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ffe29b3101418aa2bacc5cadb96ab6'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:24.587858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1177/2301] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:37:24 2022] DELETE /identity/v3/users/16ffe29b3101418aa2bacc5cadb96ab6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:37:24.592089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514a27-0287-4b37-ac20-37abd273b042 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:24.592587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514a27-0287-4b37-ac20-37abd273b042 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:24.592878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52514a27-0287-4b37-ac20-37abd273b042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:24.605928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:24.625869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-52514a27-0287-4b37-ac20-37abd273b042 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:24.627080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-52514a27-0287-4b37-ac20-37abd273b042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:24.694881 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1125/2302] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:37:24.704602 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24892c11-8a5b-4c79-a1fa-9dd85a70e2a3 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:24.706039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-24892c11-8a5b-4c79-a1fa-9dd85a70e2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:24.764769 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24892c11-8a5b-4c79-a1fa-9dd85a70e2a3 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:24.768342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a68060-fc65-4748-ab9e-a4e0b61d3c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:24.768980 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a68060-fc65-4748-ab9e-a4e0b61d3c37 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:24.769260 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a68060-fc65-4748-ab9e-a4e0b61d3c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:24.769546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a68060-fc65-4748-ab9e-a4e0b61d3c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:24.778964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a68060-fc65-4748-ab9e-a4e0b61d3c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:24.780410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a68060-fc65-4748-ab9e-a4e0b61d3c37 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:24.790675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1178/2303] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:37:25.141672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52514a27-0287-4b37-ac20-37abd273b042 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:25.143235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-52514a27-0287-4b37-ac20-37abd273b042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:25.156893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52514a27-0287-4b37-ac20-37abd273b042 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:25.162733 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d478e7-756a-478d-90fe-51236336820b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:25.163947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d478e7-756a-478d-90fe-51236336820b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:25.164448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d478e7-756a-478d-90fe-51236336820b admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:25.164931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d478e7-756a-478d-90fe-51236336820b admin admin] PATH_INFO: `/v3/projects/5b1fb77fdd774b3ebd082c1b3a2f462c` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:25.166679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d478e7-756a-478d-90fe-51236336820b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1fb77fdd774b3ebd082c1b3a2f462c)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:25.170081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d478e7-756a-478d-90fe-51236336820b admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:25.225703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-49d478e7-756a-478d-90fe-51236336820b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1fb77fdd774b3ebd082c1b3a2f462c', 'request_id': 'req-49d478e7-756a-478d-90fe-51236336820b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:25.233156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-49d478e7-756a-478d-90fe-51236336820b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1fb77fdd774b3ebd082c1b3a2f462c', 'request_id': 'req-49d478e7-756a-478d-90fe-51236336820b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:25.238827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-49d478e7-756a-478d-90fe-51236336820b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1fb77fdd774b3ebd082c1b3a2f462c', 'request_id': 'req-49d478e7-756a-478d-90fe-51236336820b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:25.252988 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-49d478e7-756a-478d-90fe-51236336820b admin admin] The token cache is being invalidate because project 5b1fb77fdd774b3ebd082c1b3a2f462c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:37:25.253288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-49d478e7-756a-478d-90fe-51236336820b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:25.253989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-49d478e7-756a-478d-90fe-51236336820b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:37:25.255723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1126/2304] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:37:25 2022] DELETE /identity/v3/projects/5b1fb77fdd774b3ebd082c1b3a2f462c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:37:25.261482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea939c7-b5d0-48c1-8cfe-181321e9c484 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:25.262037 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea939c7-b5d0-48c1-8cfe-181321e9c484 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:25.262133 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea939c7-b5d0-48c1-8cfe-181321e9c484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:25.269328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:25.282452 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-4ea939c7-b5d0-48c1-8cfe-181321e9c484 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:25.284331 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4ea939c7-b5d0-48c1-8cfe-181321e9c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:25.359190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1179/2305] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:37:25.368867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d6e3f-b5d3-4558-83f6-9ea512bf8e79 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:25.369155 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d6e3f-b5d3-4558-83f6-9ea512bf8e79 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:25.369435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d6e3f-b5d3-4558-83f6-9ea512bf8e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:25.393490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-dd8d6e3f-b5d3-4558-83f6-9ea512bf8e79 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:25.394758 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-dd8d6e3f-b5d3-4558-83f6-9ea512bf8e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:25.405561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1127/2306] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:37:25.411755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea939c7-b5d0-48c1-8cfe-181321e9c484 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:25.421778 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea939c7-b5d0-48c1-8cfe-181321e9c484 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:25.431875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35219d58-d738-49b5-bcf0-b69fe03667ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:25.432625 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35219d58-d738-49b5-bcf0-b69fe03667ca admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:25.432927 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35219d58-d738-49b5-bcf0-b69fe03667ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:25.433213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35219d58-d738-49b5-bcf0-b69fe03667ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:25.433956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35219d58-d738-49b5-bcf0-b69fe03667ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:37:25.434267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35219d58-d738-49b5-bcf0-b69fe03667ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:25.435934 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35219d58-d738-49b5-bcf0-b69fe03667ca admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:25.452465 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1180/2307] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:37:25.461435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d6e3f-b5d3-4558-83f6-9ea512bf8e79 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:25.477752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d6e3f-b5d3-4558-83f6-9ea512bf8e79 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:25.484996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02292b46-5206-46a4-be5e-9d32b7bf74ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:25.486265 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02292b46-5206-46a4-be5e-9d32b7bf74ae admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:25.486733 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02292b46-5206-46a4-be5e-9d32b7bf74ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:25.487388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02292b46-5206-46a4-be5e-9d32b7bf74ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:25.488593 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02292b46-5206-46a4-be5e-9d32b7bf74ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:25.492274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02292b46-5206-46a4-be5e-9d32b7bf74ae admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:25.540706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1128/2308] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:37:25 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:37:25.545152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35219d58-d738-49b5-bcf0-b69fe03667ca admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:25.564782 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35219d58-d738-49b5-bcf0-b69fe03667ca admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:25.650590 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5e812-96e6-4106-8070-bc54423deb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:25.651270 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5e812-96e6-4106-8070-bc54423deb00 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:25.651616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5e812-96e6-4106-8070-bc54423deb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:25.651877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5e812-96e6-4106-8070-bc54423deb00 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:25.653245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5e812-96e6-4106-8070-bc54423deb00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:25.655350 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5e812-96e6-4106-8070-bc54423deb00 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:25.701883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1181/2309] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:37:25 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:37:25.706393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02292b46-5206-46a4-be5e-9d32b7bf74ae admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:25.724628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02292b46-5206-46a4-be5e-9d32b7bf74ae admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:25.741992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6fa6b-2193-4486-8f61-ad754aa4918c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:25.743913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6fa6b-2193-4486-8f61-ad754aa4918c admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:25.746551 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6fa6b-2193-4486-8f61-ad754aa4918c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:25.746931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6fa6b-2193-4486-8f61-ad754aa4918c admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:25.747926 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6fa6b-2193-4486-8f61-ad754aa4918c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:25.749684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6fa6b-2193-4486-8f61-ad754aa4918c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:25.766672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1129/2310] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:37:25.770758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5e812-96e6-4106-8070-bc54423deb00 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:25.788122 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5e812-96e6-4106-8070-bc54423deb00 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:25.796633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b636211-dc2f-4194-a421-e479c8df820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:25.797261 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b636211-dc2f-4194-a421-e479c8df820e admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:25.797524 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b636211-dc2f-4194-a421-e479c8df820e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:25.797801 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b636211-dc2f-4194-a421-e479c8df820e admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:25.798596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b636211-dc2f-4194-a421-e479c8df820e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:25.800473 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b636211-dc2f-4194-a421-e479c8df820e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:25.822932 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1182/2311] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:37:25.828295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6fa6b-2193-4486-8f61-ad754aa4918c admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:25.844104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6fa6b-2193-4486-8f61-ad754aa4918c admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:25.857377 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c1e41-a1a4-4a47-8f9b-a0f27e567677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:25.858606 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1e41-a1a4-4a47-8f9b-a0f27e567677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:25.859018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1e41-a1a4-4a47-8f9b-a0f27e567677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:25.860733 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1e41-a1a4-4a47-8f9b-a0f27e567677 admin admin] PATH_INFO: `/v3/projects/9e67e3d950cd4856826425b6396d9eaa/users/e446b09bde664c3c8ec39f2e8db27f24/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:25.880295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626be8-81a1-44a1-b43c-dc41fb8e3ef7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:25.880678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626be8-81a1-44a1-b43c-dc41fb8e3ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:25.881069 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626be8-81a1-44a1-b43c-dc41fb8e3ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:25.891603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c1e41-a1a4-4a47-8f9b-a0f27e567677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e67e3d950cd4856826425b6396d9eaa, user_id=e446b09bde664c3c8ec39f2e8db27f24, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:25.897862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c1e41-a1a4-4a47-8f9b-a0f27e567677 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:25.913526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-41626be8-81a1-44a1-b43c-dc41fb8e3ef7 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:25.916237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-41626be8-81a1-44a1-b43c-dc41fb8e3ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:25.934658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1130/2312] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:37:25 2022] PUT /identity/v3/projects/9e67e3d950cd4856826425b6396d9eaa/users/e446b09bde664c3c8ec39f2e8db27f24/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:37:25.939249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e29f-90a1-4e8d-bb97-8e6d4485e9b9 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:25.940024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e29f-90a1-4e8d-bb97-8e6d4485e9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:25.940398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e29f-90a1-4e8d-bb97-8e6d4485e9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:25.982710 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-3fc9e29f-90a1-4e8d-bb97-8e6d4485e9b9 None None] MFA Rules not processed for user `e446b09bde664c3c8ec39f2e8db27f24`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:25.984436 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-3fc9e29f-90a1-4e8d-bb97-8e6d4485e9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:26.001485 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:26.014244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1183/2313] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Jun 15 10:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:37:26.040046 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41626be8-81a1-44a1-b43c-dc41fb8e3ef7 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:26.041431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-41626be8-81a1-44a1-b43c-dc41fb8e3ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:26.060772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:26.066895 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1131/2314] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:37:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:37:26.078218 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e29f-90a1-4e8d-bb97-8e6d4485e9b9 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:26.080529 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-3fc9e29f-90a1-4e8d-bb97-8e6d4485e9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:26.136908 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41626be8-81a1-44a1-b43c-dc41fb8e3ef7 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:26.142645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08d3fe-c92f-41d1-8ddb-1a17b5388cba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:26.143427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08d3fe-c92f-41d1-8ddb-1a17b5388cba service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:26.144013 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08d3fe-c92f-41d1-8ddb-1a17b5388cba service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:26.144376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e29f-90a1-4e8d-bb97-8e6d4485e9b9 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:26.144839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08d3fe-c92f-41d1-8ddb-1a17b5388cba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:26.150401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8229d-f049-491f-aca3-845541df5d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:26.151163 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8229d-f049-491f-aca3-845541df5d17 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:26.151538 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8229d-f049-491f-aca3-845541df5d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:26.152022 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8229d-f049-491f-aca3-845541df5d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:26.155109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08d3fe-c92f-41d1-8ddb-1a17b5388cba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:26.156843 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08d3fe-c92f-41d1-8ddb-1a17b5388cba service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:26.164032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8229d-f049-491f-aca3-845541df5d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:26.166046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8229d-f049-491f-aca3-845541df5d17 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:26.169147 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1184/2315] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:37:26.176345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1132/2316] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:37:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:37:27.538634 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b3521-6892-44c2-80f9-8baf5a56858a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:27.539172 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b3521-6892-44c2-80f9-8baf5a56858a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:27.539172 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b3521-6892-44c2-80f9-8baf5a56858a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:27.556858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b72b3521-6892-44c2-80f9-8baf5a56858a None None] MFA Rules not processed for user `e446b09bde664c3c8ec39f2e8db27f24`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:27.557972 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b72b3521-6892-44c2-80f9-8baf5a56858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:27.564700 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1185/2317] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:37:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:37:29.551422 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8229d-f049-491f-aca3-845541df5d17 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:29.552905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-eaa8229d-f049-491f-aca3-845541df5d17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:29.611125 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8229d-f049-491f-aca3-845541df5d17 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:29.615173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6e017-a40d-4292-b461-b7e77c558c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:29.615843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6e017-a40d-4292-b461-b7e77c558c9c service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:29.616125 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6e017-a40d-4292-b461-b7e77c558c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:29.616397 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6e017-a40d-4292-b461-b7e77c558c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:29.618728 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-14f6e017-a40d-4292-b461-b7e77c558c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:29.686700 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6e017-a40d-4292-b461-b7e77c558c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:29.688176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6e017-a40d-4292-b461-b7e77c558c9c service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:29.697770 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1133/2318] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:37:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:37:30.247023 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b74aa7-358d-427f-84f1-0dad0d1687c7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:30.247603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b74aa7-358d-427f-84f1-0dad0d1687c7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:30.247719 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b74aa7-358d-427f-84f1-0dad0d1687c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:30.267092 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-80b74aa7-358d-427f-84f1-0dad0d1687c7 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:30.268608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-80b74aa7-358d-427f-84f1-0dad0d1687c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:30.277475 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1186/2319] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Jun 15 10:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:37:30.299778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6e017-a40d-4292-b461-b7e77c558c9c service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:30.301501 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-14f6e017-a40d-4292-b461-b7e77c558c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:30.317938 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6e017-a40d-4292-b461-b7e77c558c9c service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:30.326907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d8141-0b71-4515-9007-9e6f24370c04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:30.327891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d8141-0b71-4515-9007-9e6f24370c04 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:30.328313 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d8141-0b71-4515-9007-9e6f24370c04 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:30.329087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d8141-0b71-4515-9007-9e6f24370c04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:30.336966 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:30.340333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d8141-0b71-4515-9007-9e6f24370c04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:30.342389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d8141-0b71-4515-9007-9e6f24370c04 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:30.360036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1134/2320] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:37:37.495950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76eda-3f21-4603-ada0-05cccd54a9d5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:37.496499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76eda-3f21-4603-ada0-05cccd54a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:37.496499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced76eda-3f21-4603-ada0-05cccd54a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:37.514821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ced76eda-3f21-4603-ada0-05cccd54a9d5 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:37.516072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ced76eda-3f21-4603-ada0-05cccd54a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:37.524753 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1187/2321] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Jun 15 10:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:37:37.552001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d8141-0b71-4515-9007-9e6f24370c04 service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:37.563184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d8141-0b71-4515-9007-9e6f24370c04 service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:37.568533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae82df-ccde-48c7-89da-52f6da3292fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:37.569159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae82df-ccde-48c7-89da-52f6da3292fb service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:37.569440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae82df-ccde-48c7-89da-52f6da3292fb service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:37.569718 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae82df-ccde-48c7-89da-52f6da3292fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:37.578016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae82df-ccde-48c7-89da-52f6da3292fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:37.579873 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae82df-ccde-48c7-89da-52f6da3292fb service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:37.589594 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1135/2322] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:37:47.509937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=38 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:47.584993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=8 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:37:47.911621 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d3aee-6f85-4cce-bfb2-90b95392621b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:47.911843 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d3aee-6f85-4cce-bfb2-90b95392621b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:47.912084 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d3aee-6f85-4cce-bfb2-90b95392621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:47.931774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ad4d3aee-6f85-4cce-bfb2-90b95392621b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:47.933029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ad4d3aee-6f85-4cce-bfb2-90b95392621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:47.941427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1188/2323] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Jun 15 10:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:37:47.964662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae82df-ccde-48c7-89da-52f6da3292fb service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:47.976745 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae82df-ccde-48c7-89da-52f6da3292fb service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:47.983320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feab7a7-dd25-4ba6-9297-ecec151975c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:47.984330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feab7a7-dd25-4ba6-9297-ecec151975c2 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:47.984603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feab7a7-dd25-4ba6-9297-ecec151975c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:47.985059 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feab7a7-dd25-4ba6-9297-ecec151975c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:47.995203 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feab7a7-dd25-4ba6-9297-ecec151975c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:47.997172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feab7a7-dd25-4ba6-9297-ecec151975c2 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:48.013709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1136/2324] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:37:55.206911 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4702dc2-0f5a-47a0-8890-79be110eab4d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:55.207670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4702dc2-0f5a-47a0-8890-79be110eab4d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:55.207670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4702dc2-0f5a-47a0-8890-79be110eab4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:55.226586 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b4702dc2-0f5a-47a0-8890-79be110eab4d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:37:55.228542 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b4702dc2-0f5a-47a0-8890-79be110eab4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:37:55.237117 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1189/2325] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Jun 15 10:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:37:55.262499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feab7a7-dd25-4ba6-9297-ecec151975c2 service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:55.273731 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feab7a7-dd25-4ba6-9297-ecec151975c2 service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:37:55.279777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58b815-ba15-4f4b-9b7d-7da3b43fe12d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:37:55.280417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b815-ba15-4f4b-9b7d-7da3b43fe12d service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:37:55.280700 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b815-ba15-4f4b-9b7d-7da3b43fe12d service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:37:55.280980 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58b815-ba15-4f4b-9b7d-7da3b43fe12d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:37:55.289446 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58b815-ba15-4f4b-9b7d-7da3b43fe12d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:37:55.291647 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58b815-ba15-4f4b-9b7d-7da3b43fe12d service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:37:55.301574 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1137/2326] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:37:59.906898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4702dc2-0f5a-47a0-8890-79be110eab4d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:37:59.908474 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b4702dc2-0f5a-47a0-8890-79be110eab4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:00.015954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4702dc2-0f5a-47a0-8890-79be110eab4d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:00.022176 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1202bc-2da6-44af-9787-7d114c385685 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2729cb0b9adb44f7ba5c968b6158a93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:00.022823 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1202bc-2da6-44af-9787-7d114c385685 service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:00.023106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1202bc-2da6-44af-9787-7d114c385685 service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:00.023383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1202bc-2da6-44af-9787-7d114c385685 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:00.025287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-db1202bc-2da6-44af-9787-7d114c385685 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:00.037723 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1202bc-2da6-44af-9787-7d114c385685 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:00.039359 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1202bc-2da6-44af-9787-7d114c385685 service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:00.051128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1190/2327] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:37:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:38:01.329881 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaea79-fb97-487d-b988-fd686db52a9d None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:01.330401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaea79-fb97-487d-b988-fd686db52a9d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:01.330518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaea79-fb97-487d-b988-fd686db52a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:01.409553 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-9adaea79-fb97-487d-b988-fd686db52a9d None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:01.410952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-9adaea79-fb97-487d-b988-fd686db52a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:01.515998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1138/2328] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:38:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:01.564632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1202bc-2da6-44af-9787-7d114c385685 service placement] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:01.565946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-db1202bc-2da6-44af-9787-7d114c385685 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:01.690757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1202bc-2da6-44af-9787-7d114c385685 service placement] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:01.697731 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a813e-15d5-4357-bde2-2edf0f1fbd1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:01.698547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a813e-15d5-4357-bde2-2edf0f1fbd1f service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:01.698830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a813e-15d5-4357-bde2-2edf0f1fbd1f service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:01.699424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a813e-15d5-4357-bde2-2edf0f1fbd1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:01.708779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a813e-15d5-4357-bde2-2edf0f1fbd1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:01.710742 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a813e-15d5-4357-bde2-2edf0f1fbd1f service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:01.720280 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1191/2329] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:38:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 10:38:02.287358 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f84b7-a20f-4aed-8079-8763e87c4e7a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:02.287680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f84b7-a20f-4aed-8079-8763e87c4e7a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:02.287956 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f84b7-a20f-4aed-8079-8763e87c4e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:02.305997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-e46f84b7-a20f-4aed-8079-8763e87c4e7a None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:02.307823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-e46f84b7-a20f-4aed-8079-8763e87c4e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:02.316798 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1139/2330] 10.222.0.50 () {58 vars in 967 bytes} [Wed Jun 15 10:38:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:02.330360 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a813e-15d5-4357-bde2-2edf0f1fbd1f service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:02.343712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a813e-15d5-4357-bde2-2edf0f1fbd1f service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:02.349082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9d9e9-b3e8-4641-8fd1-b301e2d47390 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:02.349739 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9d9e9-b3e8-4641-8fd1-b301e2d47390 service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:02.350020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9d9e9-b3e8-4641-8fd1-b301e2d47390 service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:02.350291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9d9e9-b3e8-4641-8fd1-b301e2d47390 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:02.359554 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9d9e9-b3e8-4641-8fd1-b301e2d47390 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:02.361127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9d9e9-b3e8-4641-8fd1-b301e2d47390 service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:02.370722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1192/2331] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:38:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 10:38:02.578361 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7604f1-569c-436f-9b21-b17b1020c758 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:02.578937 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7604f1-569c-436f-9b21-b17b1020c758 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:02.578937 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7604f1-569c-436f-9b21-b17b1020c758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:02.598608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-3d7604f1-569c-436f-9b21-b17b1020c758 None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:02.600217 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-3d7604f1-569c-436f-9b21-b17b1020c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:02.609738 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1140/2332] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:38:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:38:02.624187 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9d9e9-b3e8-4641-8fd1-b301e2d47390 service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:02.636561 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9d9e9-b3e8-4641-8fd1-b301e2d47390 service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:02.641736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b26d67-af39-4a80-92a3-a8340d0ac5b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:02.642398 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b26d67-af39-4a80-92a3-a8340d0ac5b7 service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:02.642677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b26d67-af39-4a80-92a3-a8340d0ac5b7 service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:02.642944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b26d67-af39-4a80-92a3-a8340d0ac5b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:02.652083 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b26d67-af39-4a80-92a3-a8340d0ac5b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:02.653815 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b26d67-af39-4a80-92a3-a8340d0ac5b7 service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:02.658986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:02.664262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1193/2333] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:38:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 10:38:03.006415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320eb1b5-49ab-4af0-8706-6b7c67bfc5e5 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:03.006727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320eb1b5-49ab-4af0-8706-6b7c67bfc5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:03.007000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320eb1b5-49ab-4af0-8706-6b7c67bfc5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:03.026443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-320eb1b5-49ab-4af0-8706-6b7c67bfc5e5 None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:03.027689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-320eb1b5-49ab-4af0-8706-6b7c67bfc5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:03.035099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1141/2334] 10.222.0.50 () {58 vars in 967 bytes} [Wed Jun 15 10:38:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:03.049070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b26d67-af39-4a80-92a3-a8340d0ac5b7 service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:03.060835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b26d67-af39-4a80-92a3-a8340d0ac5b7 service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:03.065839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8c678-bc67-4f36-b648-a7fd1a5751e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:03.066488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c678-bc67-4f36-b648-a7fd1a5751e8 service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:03.066767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c678-bc67-4f36-b648-a7fd1a5751e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:03.067039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c678-bc67-4f36-b648-a7fd1a5751e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:03.079310 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8c678-bc67-4f36-b648-a7fd1a5751e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:03.080950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8c678-bc67-4f36-b648-a7fd1a5751e8 service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:03.091379 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1194/2335] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:38:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 10:38:05.296865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320eb1b5-49ab-4af0-8706-6b7c67bfc5e5 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:05.309065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320eb1b5-49ab-4af0-8706-6b7c67bfc5e5 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:05.314600 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d7ece-71ab-4e25-add1-7bcf72483aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:05.315570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d7ece-71ab-4e25-add1-7bcf72483aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:05.315827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d7ece-71ab-4e25-add1-7bcf72483aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:05.316195 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d7ece-71ab-4e25-add1-7bcf72483aa2 admin admin] PATH_INFO: `/v3/users/e446b09bde664c3c8ec39f2e8db27f24` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:05.317417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d7ece-71ab-4e25-add1-7bcf72483aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e446b09bde664c3c8ec39f2e8db27f24)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:05.319356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d7ece-71ab-4e25-add1-7bcf72483aa2 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:05.368831 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-eb1d7ece-71ab-4e25-add1-7bcf72483aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e446b09bde664c3c8ec39f2e8db27f24'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:05.382558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-eb1d7ece-71ab-4e25-add1-7bcf72483aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e446b09bde664c3c8ec39f2e8db27f24'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:05.383534 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-eb1d7ece-71ab-4e25-add1-7bcf72483aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e446b09bde664c3c8ec39f2e8db27f24'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:05.396744 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-eb1d7ece-71ab-4e25-add1-7bcf72483aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e446b09bde664c3c8ec39f2e8db27f24'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:05.397372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-eb1d7ece-71ab-4e25-add1-7bcf72483aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e446b09bde664c3c8ec39f2e8db27f24'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:05.398660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:05.412432 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1142/2336] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:38:05 2022] DELETE /identity/v3/users/e446b09bde664c3c8ec39f2e8db27f24 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:38:05.417551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf70b4-761a-4be8-81a4-55c0f482788c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:05.418012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf70b4-761a-4be8-81a4-55c0f482788c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:05.418141 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf70b4-761a-4be8-81a4-55c0f482788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:05.440482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d3bf70b4-761a-4be8-81a4-55c0f482788c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:05.441708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d3bf70b4-761a-4be8-81a4-55c0f482788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:05.509341 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1195/2337] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:05.518972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d7ece-71ab-4e25-add1-7bcf72483aa2 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:05.520475 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-eb1d7ece-71ab-4e25-add1-7bcf72483aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:05.582617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d7ece-71ab-4e25-add1-7bcf72483aa2 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:05.586794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d23e99-7f19-401a-9e79-6453640dd57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:05.587440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d23e99-7f19-401a-9e79-6453640dd57b service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:05.587752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d23e99-7f19-401a-9e79-6453640dd57b service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:05.588188 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d23e99-7f19-401a-9e79-6453640dd57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:05.598928 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d23e99-7f19-401a-9e79-6453640dd57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:05.600387 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d23e99-7f19-401a-9e79-6453640dd57b service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:05.610633 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1143/2338] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:38:05.779237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf70b4-761a-4be8-81a4-55c0f482788c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:05.780844 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d3bf70b4-761a-4be8-81a4-55c0f482788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:05.794683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf70b4-761a-4be8-81a4-55c0f482788c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:05.799837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c01bab-4183-4491-8b25-352b3cbf3fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:05.800705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c01bab-4183-4491-8b25-352b3cbf3fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:05.800987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c01bab-4183-4491-8b25-352b3cbf3fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:05.801261 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c01bab-4183-4491-8b25-352b3cbf3fee admin admin] PATH_INFO: `/v3/projects/9e67e3d950cd4856826425b6396d9eaa` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:05.802461 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c01bab-4183-4491-8b25-352b3cbf3fee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e67e3d950cd4856826425b6396d9eaa)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:05.804643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c01bab-4183-4491-8b25-352b3cbf3fee admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:05.854967 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b0c01bab-4183-4491-8b25-352b3cbf3fee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e67e3d950cd4856826425b6396d9eaa', 'request_id': 'req-b0c01bab-4183-4491-8b25-352b3cbf3fee'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:05.861240 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b0c01bab-4183-4491-8b25-352b3cbf3fee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e67e3d950cd4856826425b6396d9eaa', 'request_id': 'req-b0c01bab-4183-4491-8b25-352b3cbf3fee'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:05.868629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b0c01bab-4183-4491-8b25-352b3cbf3fee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e67e3d950cd4856826425b6396d9eaa', 'request_id': 'req-b0c01bab-4183-4491-8b25-352b3cbf3fee'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:05.880380 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b0c01bab-4183-4491-8b25-352b3cbf3fee admin admin] The token cache is being invalidate because project 9e67e3d950cd4856826425b6396d9eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:38:05.880670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b0c01bab-4183-4491-8b25-352b3cbf3fee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:05.881309 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-b0c01bab-4183-4491-8b25-352b3cbf3fee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:05.882854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1196/2339] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:38:05 2022] DELETE /identity/v3/projects/9e67e3d950cd4856826425b6396d9eaa => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:38:05.888118 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753aa0e9-df09-448e-91c0-eeb33ac20392 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:05.888407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753aa0e9-df09-448e-91c0-eeb33ac20392 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:05.888689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753aa0e9-df09-448e-91c0-eeb33ac20392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:05.906680 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-753aa0e9-df09-448e-91c0-eeb33ac20392 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:05.907721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-753aa0e9-df09-448e-91c0-eeb33ac20392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:05.970994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1144/2340] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:05.979324 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca437-03e8-412c-8207-6d56ba041f28 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:05.979718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca437-03e8-412c-8207-6d56ba041f28 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:05.980042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca437-03e8-412c-8207-6d56ba041f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:06.009443 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-873ca437-03e8-412c-8207-6d56ba041f28 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:06.010748 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-873ca437-03e8-412c-8207-6d56ba041f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:06.022169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1197/2341] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:06.030669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753aa0e9-df09-448e-91c0-eeb33ac20392 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:06.046091 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753aa0e9-df09-448e-91c0-eeb33ac20392 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:06.053259 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cc528-26e5-4e28-a70e-99f5aa297e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:06.053946 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cc528-26e5-4e28-a70e-99f5aa297e09 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:06.054232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cc528-26e5-4e28-a70e-99f5aa297e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:06.054558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cc528-26e5-4e28-a70e-99f5aa297e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:06.055424 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cc528-26e5-4e28-a70e-99f5aa297e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:38:06.055756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cc528-26e5-4e28-a70e-99f5aa297e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:06.057464 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cc528-26e5-4e28-a70e-99f5aa297e09 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:06.071119 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1145/2342] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:38:06.075997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ca437-03e8-412c-8207-6d56ba041f28 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:06.085692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ca437-03e8-412c-8207-6d56ba041f28 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:06.091174 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb13245-82c0-4513-a9c4-f82fd41dd220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:06.091946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb13245-82c0-4513-a9c4-f82fd41dd220 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:06.092307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb13245-82c0-4513-a9c4-f82fd41dd220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:06.092668 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb13245-82c0-4513-a9c4-f82fd41dd220 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:06.093629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb13245-82c0-4513-a9c4-f82fd41dd220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:06.096240 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb13245-82c0-4513-a9c4-f82fd41dd220 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:06.137791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1198/2343] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:38:06 2022] POST /identity/v3/projects => generated 397 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:38:06.138933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cc528-26e5-4e28-a70e-99f5aa297e09 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:06.149606 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cc528-26e5-4e28-a70e-99f5aa297e09 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:06.217136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6e769-d0db-4dce-92e2-d079d6581c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:06.218013 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6e769-d0db-4dce-92e2-d079d6581c7d admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:06.218448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6e769-d0db-4dce-92e2-d079d6581c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:06.218871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6e769-d0db-4dce-92e2-d079d6581c7d admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:06.219768 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6e769-d0db-4dce-92e2-d079d6581c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:06.222286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c6e769-d0db-4dce-92e2-d079d6581c7d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:06.245669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1146/2344] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:38:06 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:38:06.246883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb13245-82c0-4513-a9c4-f82fd41dd220 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:06.257822 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb13245-82c0-4513-a9c4-f82fd41dd220 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:06.263759 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18605c-e941-4742-9380-859d3d26a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:06.264431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18605c-e941-4742-9380-859d3d26a371 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:06.264710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18605c-e941-4742-9380-859d3d26a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:06.264980 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18605c-e941-4742-9380-859d3d26a371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:06.265709 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18605c-e941-4742-9380-859d3d26a371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:06.267302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18605c-e941-4742-9380-859d3d26a371 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:06.278838 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1199/2345] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:38:06.283050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6e769-d0db-4dce-92e2-d079d6581c7d admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:06.293632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6e769-d0db-4dce-92e2-d079d6581c7d admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:06.298401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922c1cc-506d-4a93-831c-821a15fe7461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:06.299061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922c1cc-506d-4a93-831c-821a15fe7461 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:06.299347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922c1cc-506d-4a93-831c-821a15fe7461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:06.299667 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922c1cc-506d-4a93-831c-821a15fe7461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:06.300398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922c1cc-506d-4a93-831c-821a15fe7461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:06.301998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922c1cc-506d-4a93-831c-821a15fe7461 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:06.304146 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:06.313353 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1147/2346] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:38:06.317499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18605c-e941-4742-9380-859d3d26a371 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:06.328446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18605c-e941-4742-9380-859d3d26a371 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:06.333130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76e58f-e1d6-43f0-8797-aa3844248c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:06.334003 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e58f-e1d6-43f0-8797-aa3844248c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:06.334282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e58f-e1d6-43f0-8797-aa3844248c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:06.334551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e58f-e1d6-43f0-8797-aa3844248c7a admin admin] PATH_INFO: `/v3/projects/d18394b6ca4e4c1f9dfec3e8a9bee155/users/9462d78569a1496aa462f32dbdbb9a10/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:06.349705 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76e58f-e1d6-43f0-8797-aa3844248c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18394b6ca4e4c1f9dfec3e8a9bee155, user_id=9462d78569a1496aa462f32dbdbb9a10, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:06.352362 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76e58f-e1d6-43f0-8797-aa3844248c7a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:06.365103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1200/2347] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:38:06 2022] PUT /identity/v3/projects/d18394b6ca4e4c1f9dfec3e8a9bee155/users/9462d78569a1496aa462f32dbdbb9a10/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:38:06.374973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205d12c-fbc1-4d0a-884f-5be2e4d70ed8 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:06.375259 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205d12c-fbc1-4d0a-884f-5be2e4d70ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:06.375572 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205d12c-fbc1-4d0a-884f-5be2e4d70ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:06.405918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-a205d12c-fbc1-4d0a-884f-5be2e4d70ed8 None None] MFA Rules not processed for user `9462d78569a1496aa462f32dbdbb9a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:06.407169 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a205d12c-fbc1-4d0a-884f-5be2e4d70ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:06.484241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1148/2348] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:38:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:06.496462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76e58f-e1d6-43f0-8797-aa3844248c7a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:06.498496 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ef76e58f-e1d6-43f0-8797-aa3844248c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:06.508818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:06.562571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76e58f-e1d6-43f0-8797-aa3844248c7a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:06.566162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edc42e-f408-4a8b-9b22-9235b0f1db70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:06.566799 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc42e-f408-4a8b-9b22-9235b0f1db70 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:06.567079 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc42e-f408-4a8b-9b22-9235b0f1db70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:06.567352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc42e-f408-4a8b-9b22-9235b0f1db70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:06.576285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edc42e-f408-4a8b-9b22-9235b0f1db70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:06.577698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edc42e-f408-4a8b-9b22-9235b0f1db70 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:06.586494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1201/2349] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:38:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:38:13.674235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205d12c-fbc1-4d0a-884f-5be2e4d70ed8 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:13.739953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205d12c-fbc1-4d0a-884f-5be2e4d70ed8 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:13.745544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139ed69-fead-4471-ad12-5c8c6d7d2ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:13.746618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139ed69-fead-4471-ad12-5c8c6d7d2ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:13.746902 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139ed69-fead-4471-ad12-5c8c6d7d2ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:13.747249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139ed69-fead-4471-ad12-5c8c6d7d2ffb admin admin] PATH_INFO: `/v3/users/9462d78569a1496aa462f32dbdbb9a10` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:13.748498 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139ed69-fead-4471-ad12-5c8c6d7d2ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9462d78569a1496aa462f32dbdbb9a10)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:13.750421 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139ed69-fead-4471-ad12-5c8c6d7d2ffb admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:13.798793 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d139ed69-fead-4471-ad12-5c8c6d7d2ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9462d78569a1496aa462f32dbdbb9a10'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:13.810817 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d139ed69-fead-4471-ad12-5c8c6d7d2ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9462d78569a1496aa462f32dbdbb9a10'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:13.811521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d139ed69-fead-4471-ad12-5c8c6d7d2ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9462d78569a1496aa462f32dbdbb9a10'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:13.819743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d139ed69-fead-4471-ad12-5c8c6d7d2ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9462d78569a1496aa462f32dbdbb9a10'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:13.821320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-d139ed69-fead-4471-ad12-5c8c6d7d2ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9462d78569a1496aa462f32dbdbb9a10'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:13.834568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1149/2350] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:38:13 2022] DELETE /identity/v3/users/9462d78569a1496aa462f32dbdbb9a10 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:38:13.839235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be3eb8-84ba-4218-9013-926e8fd6ae6d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:13.839791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be3eb8-84ba-4218-9013-926e8fd6ae6d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:13.839919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be3eb8-84ba-4218-9013-926e8fd6ae6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:13.857928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-82be3eb8-84ba-4218-9013-926e8fd6ae6d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:13.859151 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-82be3eb8-84ba-4218-9013-926e8fd6ae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:13.926942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1202/2351] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:13.937748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139ed69-fead-4471-ad12-5c8c6d7d2ffb admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:13.939203 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d139ed69-fead-4471-ad12-5c8c6d7d2ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:13.953105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:14.044020 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139ed69-fead-4471-ad12-5c8c6d7d2ffb admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:14.047301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fb05a-5b4e-4bf2-908e-966b1676333c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:14.047977 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fb05a-5b4e-4bf2-908e-966b1676333c service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:14.048258 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fb05a-5b4e-4bf2-908e-966b1676333c service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:14.048533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fb05a-5b4e-4bf2-908e-966b1676333c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:14.060236 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fb05a-5b4e-4bf2-908e-966b1676333c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:14.061597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fb05a-5b4e-4bf2-908e-966b1676333c service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:14.072887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1150/2352] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:38:14.426245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be3eb8-84ba-4218-9013-926e8fd6ae6d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:14.427964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-82be3eb8-84ba-4218-9013-926e8fd6ae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:14.444377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be3eb8-84ba-4218-9013-926e8fd6ae6d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:14.451670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:14.452690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:14.453037 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:14.453409 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] PATH_INFO: `/v3/projects/d18394b6ca4e4c1f9dfec3e8a9bee155` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:14.454989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18394b6ca4e4c1f9dfec3e8a9bee155)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:14.457010 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:14.510403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18394b6ca4e4c1f9dfec3e8a9bee155', 'request_id': 'req-adcba354-9407-4190-b05f-b913dcf9514f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:14.516089 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18394b6ca4e4c1f9dfec3e8a9bee155', 'request_id': 'req-adcba354-9407-4190-b05f-b913dcf9514f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:14.524016 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18394b6ca4e4c1f9dfec3e8a9bee155', 'request_id': 'req-adcba354-9407-4190-b05f-b913dcf9514f'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:14.536415 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] The token cache is being invalidate because project d18394b6ca4e4c1f9dfec3e8a9bee155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:38:14.536744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:14.537360 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:38:14.538926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1203/2353] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:38:14 2022] DELETE /identity/v3/projects/d18394b6ca4e4c1f9dfec3e8a9bee155 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:38:14.910236 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69f0d5-3f5e-4f28-af8e-908b355d39bb None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:14.910737 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69f0d5-3f5e-4f28-af8e-908b355d39bb None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:14.910832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69f0d5-3f5e-4f28-af8e-908b355d39bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:14.930882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-fe69f0d5-3f5e-4f28-af8e-908b355d39bb None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:14.932132 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-fe69f0d5-3f5e-4f28-af8e-908b355d39bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:14.991693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1151/2354] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:38:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:15.006746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:15.008498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:15.046395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:15.084653 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcba354-9407-4190-b05f-b913dcf9514f admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:15.090022 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a687c-9fd4-413c-9a14-98ccb225b51e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:15.090685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a687c-9fd4-413c-9a14-98ccb225b51e service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:15.090965 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a687c-9fd4-413c-9a14-98ccb225b51e service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:15.091245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a687c-9fd4-413c-9a14-98ccb225b51e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:15.100847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a687c-9fd4-413c-9a14-98ccb225b51e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:15.102450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a687c-9fd4-413c-9a14-98ccb225b51e service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:15.111130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1204/2355] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:38:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 10:38:17.763233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da18643-fe97-4e15-a909-3f9f8f410893 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:17.763233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da18643-fe97-4e15-a909-3f9f8f410893 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:17.763233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da18643-fe97-4e15-a909-3f9f8f410893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:17.794038 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-4da18643-fe97-4e15-a909-3f9f8f410893 None None] MFA Rules not processed for user `2f665d4a8eec4096925fca3ea6dafcec`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:17.795577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4da18643-fe97-4e15-a909-3f9f8f410893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:17.888576 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1152/2356] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:38:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:22.149550 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850bf67-dc1b-4d1c-a6b8-9833811599e8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:22.150112 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850bf67-dc1b-4d1c-a6b8-9833811599e8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:22.150112 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850bf67-dc1b-4d1c-a6b8-9833811599e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:22.179187 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6850bf67-dc1b-4d1c-a6b8-9833811599e8 None None] MFA Rules not processed for user `0d6ad1725257401888617fdcf7e57386`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:22.180406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6850bf67-dc1b-4d1c-a6b8-9833811599e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:22.291212 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1205/2357] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:38:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:38:27.879595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=73 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:32.279226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=42 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:32.728328 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe974c4c-af1c-47e4-9c4a-24530820b3d6 None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:32.728910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe974c4c-af1c-47e4-9c4a-24530820b3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:32.729127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe974c4c-af1c-47e4-9c4a-24530820b3d6 None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:32.730976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1153/2358] 10.222.0.50 () {54 vars in 921 bytes} [Wed Jun 15 10:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:38:32.737755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd98d-9ae2-4ba8-93cc-56dd372fab5a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:32.737755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd98d-9ae2-4ba8-93cc-56dd372fab5a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:32.737755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd98d-9ae2-4ba8-93cc-56dd372fab5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:32.786851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-dffdd98d-9ae2-4ba8-93cc-56dd372fab5a None None] MFA Rules not processed for user `81e9805ec4c44cedb658b7becf768369`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:32.788118 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-dffdd98d-9ae2-4ba8-93cc-56dd372fab5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:32.871319 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1206/2359] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Jun 15 10:38:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:32.886246 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe974c4c-af1c-47e4-9c4a-24530820b3d6 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:32.888682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-fe974c4c-af1c-47e4-9c4a-24530820b3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:32.972165 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe974c4c-af1c-47e4-9c4a-24530820b3d6 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:32.975707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf4a8c-f91f-48f6-bb14-27f3e97e329a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f1b06364a24554bba9936621127752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:32.976359 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf4a8c-f91f-48f6-bb14-27f3e97e329a service glance] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:32.976645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf4a8c-f91f-48f6-bb14-27f3e97e329a service glance] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:32.976923 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf4a8c-f91f-48f6-bb14-27f3e97e329a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:32.987846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf4a8c-f91f-48f6-bb14-27f3e97e329a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:32.989277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf4a8c-f91f-48f6-bb14-27f3e97e329a service glance] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:33.000261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1154/2360] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:38:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:38:33.069636 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7f1a1-8141-4444-9f6e-2033b7dd0c5a None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:33.069927 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7f1a1-8141-4444-9f6e-2033b7dd0c5a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:33.070231 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7f1a1-8141-4444-9f6e-2033b7dd0c5a None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:33.071754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1207/2361] 10.222.0.50 () {54 vars in 921 bytes} [Wed Jun 15 10:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:38:33.077233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d223b6-ec9f-45e3-adfd-904ae8289d9f None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:33.077528 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d223b6-ec9f-45e3-adfd-904ae8289d9f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:33.077840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d223b6-ec9f-45e3-adfd-904ae8289d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:33.096976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-35d223b6-ec9f-45e3-adfd-904ae8289d9f None None] MFA Rules not processed for user `5f2e2038f69f49019a1e528107296223`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:33.098434 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-35d223b6-ec9f-45e3-adfd-904ae8289d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:33.153790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1155/2362] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Jun 15 10:38:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:33.165379 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7f1a1-8141-4444-9f6e-2033b7dd0c5a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:33.167187 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ace7f1a1-8141-4444-9f6e-2033b7dd0c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:33.193128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7f1a1-8141-4444-9f6e-2033b7dd0c5a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:33.196822 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faa130-5a7c-4c1e-8604-954154054c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:33.197485 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faa130-5a7c-4c1e-8604-954154054c6c service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:33.197796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faa130-5a7c-4c1e-8604-954154054c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:33.198100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faa130-5a7c-4c1e-8604-954154054c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:33.206576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09faa130-5a7c-4c1e-8604-954154054c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:33.208088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09faa130-5a7c-4c1e-8604-954154054c6c service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:33.216071 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1208/2363] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:38:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:38:33.305989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3923f-abdb-46b2-b3af-f3faedc6e08d None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:33.306278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3923f-abdb-46b2-b3af-f3faedc6e08d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:33.306561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3923f-abdb-46b2-b3af-f3faedc6e08d None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:33.308536 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1156/2364] 10.222.0.50 () {54 vars in 921 bytes} [Wed Jun 15 10:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:38:33.314126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef8415-8c5a-4fd8-a159-a844a39ca028 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:33.314597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef8415-8c5a-4fd8-a159-a844a39ca028 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:33.314711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef8415-8c5a-4fd8-a159-a844a39ca028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:33.333609 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-62ef8415-8c5a-4fd8-a159-a844a39ca028 None None] MFA Rules not processed for user `81e9805ec4c44cedb658b7becf768369`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:33.334810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-62ef8415-8c5a-4fd8-a159-a844a39ca028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:33.344675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1209/2365] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Jun 15 10:38:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:33.356017 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3923f-abdb-46b2-b3af-f3faedc6e08d None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:33.366631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3923f-abdb-46b2-b3af-f3faedc6e08d None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:33.370123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f4477-1017-4850-ad2a-13c236796462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:33.370759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f4477-1017-4850-ad2a-13c236796462 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:33.371039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f4477-1017-4850-ad2a-13c236796462 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:33.371309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f4477-1017-4850-ad2a-13c236796462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:33.381537 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f4477-1017-4850-ad2a-13c236796462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:33.382953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f4477-1017-4850-ad2a-13c236796462 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:33.393623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1157/2366] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:38:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:38:40.820934 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab57bbf-476b-41bf-82b2-4c67cd9325b5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:40.821490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab57bbf-476b-41bf-82b2-4c67cd9325b5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:40.821490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab57bbf-476b-41bf-82b2-4c67cd9325b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:40.851143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-fab57bbf-476b-41bf-82b2-4c67cd9325b5 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:40.852608 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fab57bbf-476b-41bf-82b2-4c67cd9325b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:40.924387 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1210/2367] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Jun 15 10:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:40.944792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f4477-1017-4850-ad2a-13c236796462 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:40.946201 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-875f4477-1017-4850-ad2a-13c236796462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:40.961380 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f4477-1017-4850-ad2a-13c236796462 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:40.967425 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ab417-73ca-458e-84ad-de01d9509547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:40.968098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ab417-73ca-458e-84ad-de01d9509547 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:40.968378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ab417-73ca-458e-84ad-de01d9509547 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:40.968649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ab417-73ca-458e-84ad-de01d9509547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:40.978371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ab417-73ca-458e-84ad-de01d9509547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:40.980065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ab417-73ca-458e-84ad-de01d9509547 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:40.990786 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1158/2368] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:38:41.096678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c40c4-d8f7-4af1-a269-7feba81eba16 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:41.096974 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c40c4-d8f7-4af1-a269-7feba81eba16 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:41.097269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c40c4-d8f7-4af1-a269-7feba81eba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:41.118568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e83c40c4-d8f7-4af1-a269-7feba81eba16 None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:38:41.119806 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e83c40c4-d8f7-4af1-a269-7feba81eba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:38:41.129023 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1211/2369] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:38:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:38:41.144050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ab417-73ca-458e-84ad-de01d9509547 service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:38:41.156000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ab417-73ca-458e-84ad-de01d9509547 service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:38:41.161121 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4159a2-b01c-4f20-8944-928e70b59aeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:38:41.161953 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4159a2-b01c-4f20-8944-928e70b59aeb service swift] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:38:41.162244 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4159a2-b01c-4f20-8944-928e70b59aeb service swift] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:38:41.162518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4159a2-b01c-4f20-8944-928e70b59aeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:38:41.172269 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4159a2-b01c-4f20-8944-928e70b59aeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:38:41.173857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4159a2-b01c-4f20-8944-928e70b59aeb service swift] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:38:41.182279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1159/2370] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:38:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 10:38:51.111390 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=76 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:38:51.178958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=76 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:03.677342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90630e0-d03b-44c0-bdb6-2bcd4da21f79 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:03.678086 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90630e0-d03b-44c0-bdb6-2bcd4da21f79 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:03.678086 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90630e0-d03b-44c0-bdb6-2bcd4da21f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:03.705308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d90630e0-d03b-44c0-bdb6-2bcd4da21f79 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:39:03.708644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d90630e0-d03b-44c0-bdb6-2bcd4da21f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:39:03.719232 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1212/2371] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Jun 15 10:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:39:03.746128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4159a2-b01c-4f20-8944-928e70b59aeb service swift] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:39:03.747150 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-bb4159a2-b01c-4f20-8944-928e70b59aeb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:39:03.766896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4159a2-b01c-4f20-8944-928e70b59aeb service swift] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:39:03.775285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e921a15-8a7f-42cf-8938-fdb64a2b510c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:39:03.776087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e921a15-8a7f-42cf-8938-fdb64a2b510c service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:03.776582 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e921a15-8a7f-42cf-8938-fdb64a2b510c service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:03.776809 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e921a15-8a7f-42cf-8938-fdb64a2b510c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:03.786999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e921a15-8a7f-42cf-8938-fdb64a2b510c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:39:03.788719 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e921a15-8a7f-42cf-8938-fdb64a2b510c service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:39:03.799547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1160/2372] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:39:09.810613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01608607-c7cb-43ff-a028-b99a45d972d7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:09.811299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01608607-c7cb-43ff-a028-b99a45d972d7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:09.811299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01608607-c7cb-43ff-a028-b99a45d972d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:09.830751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-01608607-c7cb-43ff-a028-b99a45d972d7 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:39:09.832008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-01608607-c7cb-43ff-a028-b99a45d972d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:39:09.840432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1213/2373] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Jun 15 10:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:39:09.869470 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e921a15-8a7f-42cf-8938-fdb64a2b510c service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:39:09.881718 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e921a15-8a7f-42cf-8938-fdb64a2b510c service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:39:09.887573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195c2d1-bc23-4260-8483-5a26d2ee14da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:39:09.888225 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195c2d1-bc23-4260-8483-5a26d2ee14da service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:09.888521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195c2d1-bc23-4260-8483-5a26d2ee14da service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:09.889044 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195c2d1-bc23-4260-8483-5a26d2ee14da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:09.897824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195c2d1-bc23-4260-8483-5a26d2ee14da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:39:09.899414 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195c2d1-bc23-4260-8483-5a26d2ee14da service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:39:09.910106 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1161/2374] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:39:13.311662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd85bc8-f524-497a-94a5-296023216036 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:13.312189 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd85bc8-f524-497a-94a5-296023216036 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:13.312299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd85bc8-f524-497a-94a5-296023216036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:13.336368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5cd85bc8-f524-497a-94a5-296023216036 None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:39:13.337570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5cd85bc8-f524-497a-94a5-296023216036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:39:13.344710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1214/2375] 10.222.0.50 () {58 vars in 967 bytes} [Wed Jun 15 10:39:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:39:13.367852 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195c2d1-bc23-4260-8483-5a26d2ee14da service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:39:13.380352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195c2d1-bc23-4260-8483-5a26d2ee14da service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:39:13.385858 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0b2e0-bef6-4aaf-abae-8bc8d814dcf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:39:13.386514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0b2e0-bef6-4aaf-abae-8bc8d814dcf1 service swift] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:13.386794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0b2e0-bef6-4aaf-abae-8bc8d814dcf1 service swift] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:13.387071 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0b2e0-bef6-4aaf-abae-8bc8d814dcf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:13.395532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0b2e0-bef6-4aaf-abae-8bc8d814dcf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:39:13.397114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0b2e0-bef6-4aaf-abae-8bc8d814dcf1 service swift] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:39:13.405112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1162/2376] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:39:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 10:39:16.096471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21541bc-ee8a-47cc-bab9-95c9b92d608c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:16.097382 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21541bc-ee8a-47cc-bab9-95c9b92d608c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:16.097666 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21541bc-ee8a-47cc-bab9-95c9b92d608c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:16.118513 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a21541bc-ee8a-47cc-bab9-95c9b92d608c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:39:16.119704 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a21541bc-ee8a-47cc-bab9-95c9b92d608c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:39:16.130631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1215/2377] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Jun 15 10:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:39:16.158409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0b2e0-bef6-4aaf-abae-8bc8d814dcf1 service swift] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:39:16.170904 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0b2e0-bef6-4aaf-abae-8bc8d814dcf1 service swift] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:39:16.177071 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb32ad8-b8c0-424e-a1c5-d28b01bbb295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:39:16.178767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb32ad8-b8c0-424e-a1c5-d28b01bbb295 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:16.179057 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb32ad8-b8c0-424e-a1c5-d28b01bbb295 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:16.179335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb32ad8-b8c0-424e-a1c5-d28b01bbb295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:16.189079 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb32ad8-b8c0-424e-a1c5-d28b01bbb295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:39:16.191210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb32ad8-b8c0-424e-a1c5-d28b01bbb295 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:39:16.201460 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1163/2378] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:39:23.358610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6f2c6-a9f6-44d6-90f9-5b398a45e654 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:23.359122 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6f2c6-a9f6-44d6-90f9-5b398a45e654 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:23.359223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6f2c6-a9f6-44d6-90f9-5b398a45e654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:23.377759 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-0fd6f2c6-a9f6-44d6-90f9-5b398a45e654 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:39:23.378980 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0fd6f2c6-a9f6-44d6-90f9-5b398a45e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:39:23.386872 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1216/2379] 10.222.0.75 () {58 vars in 1016 bytes} [Wed Jun 15 10:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:39:23.410727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb32ad8-b8c0-424e-a1c5-d28b01bbb295 service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:39:23.421780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb32ad8-b8c0-424e-a1c5-d28b01bbb295 service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:39:23.427497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a5944-8409-439f-a3bf-badf4703ce33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:39:23.428153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a5944-8409-439f-a3bf-badf4703ce33 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:23.428432 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a5944-8409-439f-a3bf-badf4703ce33 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:23.428709 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a5944-8409-439f-a3bf-badf4703ce33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:23.436852 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a5944-8409-439f-a3bf-badf4703ce33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:39:23.438930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a5944-8409-439f-a3bf-badf4703ce33 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:39:23.448706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1164/2380] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:39:33.371859 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=15 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:33.444263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=30 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:38.401418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6f2c6-a9f6-44d6-90f9-5b398a45e654 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:39:38.402901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0fd6f2c6-a9f6-44d6-90f9-5b398a45e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:39:38.415244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6f2c6-a9f6-44d6-90f9-5b398a45e654 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:39:38.418811 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384f292-9455-4e7a-81db-e49cff2c2375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:39:38.419437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384f292-9455-4e7a-81db-e49cff2c2375 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:38.419746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384f292-9455-4e7a-81db-e49cff2c2375 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:38.420019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384f292-9455-4e7a-81db-e49cff2c2375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:38.422591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-4384f292-9455-4e7a-81db-e49cff2c2375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:39:38.435798 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384f292-9455-4e7a-81db-e49cff2c2375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:39:38.437228 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384f292-9455-4e7a-81db-e49cff2c2375 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:39:38.448138 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1217/2381] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:39:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:39:40.785223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a5944-8409-439f-a3bf-badf4703ce33 service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:39:40.794970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a5944-8409-439f-a3bf-badf4703ce33 service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:39:40.799641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e13783-9225-47c4-93da-b8de3a28fbe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:39:40.800296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e13783-9225-47c4-93da-b8de3a28fbe0 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:40.800581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e13783-9225-47c4-93da-b8de3a28fbe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:40.800853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e13783-9225-47c4-93da-b8de3a28fbe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:40.803008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-36e13783-9225-47c4-93da-b8de3a28fbe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:39:40.818548 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e13783-9225-47c4-93da-b8de3a28fbe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:39:40.820193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e13783-9225-47c4-93da-b8de3a28fbe0 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:39:40.833335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1165/2382] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:39:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:39:48.443165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=6 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:49.405045 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384f292-9455-4e7a-81db-e49cff2c2375 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:39:49.417726 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384f292-9455-4e7a-81db-e49cff2c2375 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:39:49.424791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b307a1e-0aab-406b-bfe5-33a85318e4de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:39:49.425918 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b307a1e-0aab-406b-bfe5-33a85318e4de service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:49.425918 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b307a1e-0aab-406b-bfe5-33a85318e4de service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:49.426135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b307a1e-0aab-406b-bfe5-33a85318e4de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:49.428008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1b307a1e-0aab-406b-bfe5-33a85318e4de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:39:49.511531 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b307a1e-0aab-406b-bfe5-33a85318e4de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:39:49.513129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b307a1e-0aab-406b-bfe5-33a85318e4de service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:39:49.523685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1218/2383] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:39:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:39:50.827504 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=6 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:39:54.429357 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e13783-9225-47c4-93da-b8de3a28fbe0 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:39:54.437802 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e13783-9225-47c4-93da-b8de3a28fbe0 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:39:54.442067 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e03120-7565-4911-978b-de095f2938e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:39:54.442705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e03120-7565-4911-978b-de095f2938e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:54.442999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e03120-7565-4911-978b-de095f2938e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:54.443255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e03120-7565-4911-978b-de095f2938e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:54.445066 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d5e03120-7565-4911-978b-de095f2938e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:39:54.455976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e03120-7565-4911-978b-de095f2938e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:39:54.457389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e03120-7565-4911-978b-de095f2938e8 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:39:54.471379 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1166/2384] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:39:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:39:57.059528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c097c4-9c3b-47bc-b860-75cce190706f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:39:57.060101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c097c4-9c3b-47bc-b860-75cce190706f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:39:57.060101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c097c4-9c3b-47bc-b860-75cce190706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:39:57.078390 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d3c097c4-9c3b-47bc-b860-75cce190706f None None] MFA Rules not processed for user `76ccc16f729b4042916db8c1183d2379`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:39:57.079621 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d3c097c4-9c3b-47bc-b860-75cce190706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:39:57.091983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1219/2385] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:39:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:40:00.069410 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e03120-7565-4911-978b-de095f2938e8 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:40:00.070878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d5e03120-7565-4911-978b-de095f2938e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:40:00.091507 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e03120-7565-4911-978b-de095f2938e8 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:40:00.095205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529c4cd-1e41-423a-b8ee-9e75888f260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:40:00.096133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529c4cd-1e41-423a-b8ee-9e75888f260f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:40:00.096420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529c4cd-1e41-423a-b8ee-9e75888f260f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:40:00.096695 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529c4cd-1e41-423a-b8ee-9e75888f260f admin admin] PATH_INFO: `/v3/users/2f665d4a8eec4096925fca3ea6dafcec` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:40:00.097904 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529c4cd-1e41-423a-b8ee-9e75888f260f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f665d4a8eec4096925fca3ea6dafcec)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:40:00.099906 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529c4cd-1e41-423a-b8ee-9e75888f260f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:40:00.153761 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5529c4cd-1e41-423a-b8ee-9e75888f260f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f665d4a8eec4096925fca3ea6dafcec'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:40:00.166900 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5529c4cd-1e41-423a-b8ee-9e75888f260f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f665d4a8eec4096925fca3ea6dafcec'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:40:00.167581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5529c4cd-1e41-423a-b8ee-9e75888f260f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f665d4a8eec4096925fca3ea6dafcec'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:40:00.174984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5529c4cd-1e41-423a-b8ee-9e75888f260f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f665d4a8eec4096925fca3ea6dafcec'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:40:00.175654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5529c4cd-1e41-423a-b8ee-9e75888f260f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f665d4a8eec4096925fca3ea6dafcec'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:40:00.187947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1167/2386] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:40:00 2022] DELETE /identity/v3/users/2f665d4a8eec4096925fca3ea6dafcec => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:40:00.372010 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c097c4-9c3b-47bc-b860-75cce190706f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:40:00.384183 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c097c4-9c3b-47bc-b860-75cce190706f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:40:00.445182 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:40:00.446046 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:40:00.446328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:40:00.446606 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] PATH_INFO: `/v3/projects/e1e2697511564228ad8cc157c8143d09` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:40:00.447875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e2697511564228ad8cc157c8143d09)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:40:00.449799 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:40:00.498727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e2697511564228ad8cc157c8143d09', 'request_id': 'req-12137195-9eba-4d7a-8ec2-8c5518ff688e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:40:00.505155 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e2697511564228ad8cc157c8143d09', 'request_id': 'req-12137195-9eba-4d7a-8ec2-8c5518ff688e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:40:00.512255 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e2697511564228ad8cc157c8143d09', 'request_id': 'req-12137195-9eba-4d7a-8ec2-8c5518ff688e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:40:00.525692 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] The token cache is being invalidate because project e1e2697511564228ad8cc157c8143d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:40:00.525976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:40:00.526604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:40:00.528172 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1220/2387] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:40:00 2022] DELETE /identity/v3/projects/e1e2697511564228ad8cc157c8143d09 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:40:10.184444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:10.522793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:28.768589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529c4cd-1e41-423a-b8ee-9e75888f260f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:40:28.770045 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-5529c4cd-1e41-423a-b8ee-9e75888f260f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:40:28.842100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529c4cd-1e41-423a-b8ee-9e75888f260f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:40:28.904075 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5ee9f-9420-48cb-a5f0-798d634a9e51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:40:28.904721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5ee9f-9420-48cb-a5f0-798d634a9e51 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:40:28.905001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5ee9f-9420-48cb-a5f0-798d634a9e51 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:40:28.905283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5ee9f-9420-48cb-a5f0-798d634a9e51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:40:28.907034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-97f5ee9f-9420-48cb-a5f0-798d634a9e51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:40:28.963292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5ee9f-9420-48cb-a5f0-798d634a9e51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:40:28.964806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5ee9f-9420-48cb-a5f0-798d634a9e51 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:40:28.973622 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1168/2388] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:40:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:40:35.262704 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:40:35.265366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:40:35.282265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12137195-9eba-4d7a-8ec2-8c5518ff688e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:40:35.288188 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733755d-9096-44de-ad5b-1b31f4be4b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:40:35.288624 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733755d-9096-44de-ad5b-1b31f4be4b85 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:40:35.288905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733755d-9096-44de-ad5b-1b31f4be4b85 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:40:35.289185 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733755d-9096-44de-ad5b-1b31f4be4b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:40:35.290995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0733755d-9096-44de-ad5b-1b31f4be4b85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:40:35.305281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733755d-9096-44de-ad5b-1b31f4be4b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:40:35.307154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733755d-9096-44de-ad5b-1b31f4be4b85 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:40:35.319076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1221/2389] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:40:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:40:38.354902 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e9b32-41f1-4230-b1a0-6359c8e2e535 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:40:38.355430 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e9b32-41f1-4230-b1a0-6359c8e2e535 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:40:38.355430 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e9b32-41f1-4230-b1a0-6359c8e2e535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:40:38.372976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-049e9b32-41f1-4230-b1a0-6359c8e2e535 None None] MFA Rules not processed for user `24d4ac4faaed44cbb9c20a5ae20a356a`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:40:38.374177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-049e9b32-41f1-4230-b1a0-6359c8e2e535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:40:38.381641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1169/2390] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:40:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:40:38.681913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733755d-9096-44de-ad5b-1b31f4be4b85 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:40:38.683330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0733755d-9096-44de-ad5b-1b31f4be4b85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:40:38.739717 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733755d-9096-44de-ad5b-1b31f4be4b85 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:40:38.743291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975be240-4fe0-4929-acd5-4f999361b3b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:40:38.743950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975be240-4fe0-4929-acd5-4f999361b3b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:40:38.744231 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975be240-4fe0-4929-acd5-4f999361b3b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:40:38.744503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975be240-4fe0-4929-acd5-4f999361b3b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:40:38.746637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-975be240-4fe0-4929-acd5-4f999361b3b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:40:38.757263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975be240-4fe0-4929-acd5-4f999361b3b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:40:38.758387 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975be240-4fe0-4929-acd5-4f999361b3b5 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:40:38.766934 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1222/2391] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:40:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:40:39.072530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e9b32-41f1-4230-b1a0-6359c8e2e535 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:40:39.073978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-049e9b32-41f1-4230-b1a0-6359c8e2e535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:40:39.107585 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:39.147326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e9b32-41f1-4230-b1a0-6359c8e2e535 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:40:39.152247 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02ca88-f276-4792-a1ea-09715fe629cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2729cb0b9adb44f7ba5c968b6158a93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:40:39.152893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02ca88-f276-4792-a1ea-09715fe629cf service placement] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:40:39.153174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02ca88-f276-4792-a1ea-09715fe629cf service placement] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:40:39.153448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02ca88-f276-4792-a1ea-09715fe629cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:40:39.155205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-5d02ca88-f276-4792-a1ea-09715fe629cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:40:39.167482 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02ca88-f276-4792-a1ea-09715fe629cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:40:39.169072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02ca88-f276-4792-a1ea-09715fe629cf service placement] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:40:39.179350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1170/2392] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:40:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:40:48.763356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=32 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:49.174710 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=19 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:40:49.658093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975be240-4fe0-4929-acd5-4f999361b3b5 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:40:49.659735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-975be240-4fe0-4929-acd5-4f999361b3b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:40:49.682984 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975be240-4fe0-4929-acd5-4f999361b3b5 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:40:49.690298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af8117-002f-487b-b8c7-65f0bc6f144e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:40:49.691206 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af8117-002f-487b-b8c7-65f0bc6f144e service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:40:49.691684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af8117-002f-487b-b8c7-65f0bc6f144e service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:40:49.692258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af8117-002f-487b-b8c7-65f0bc6f144e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:40:49.694796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b0af8117-002f-487b-b8c7-65f0bc6f144e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:40:49.728114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af8117-002f-487b-b8c7-65f0bc6f144e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:40:49.731971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af8117-002f-487b-b8c7-65f0bc6f144e service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:40:49.752517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1223/2393] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:40:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:40:49.907589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02ca88-f276-4792-a1ea-09715fe629cf service placement] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:40:49.921681 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02ca88-f276-4792-a1ea-09715fe629cf service placement] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:40:49.936912 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d25d9-faf9-40ae-b5bf-e758cb407e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:40:49.938193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d25d9-faf9-40ae-b5bf-e758cb407e8b service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:40:49.939542 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d25d9-faf9-40ae-b5bf-e758cb407e8b service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:40:49.939825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d25d9-faf9-40ae-b5bf-e758cb407e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:40:49.947502 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-9b3d25d9-faf9-40ae-b5bf-e758cb407e8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:40:49.975372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d25d9-faf9-40ae-b5bf-e758cb407e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:40:49.978320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d25d9-faf9-40ae-b5bf-e758cb407e8b service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:40:49.994877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1171/2394] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:40:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:40:53.662202 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af8117-002f-487b-b8c7-65f0bc6f144e service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:40:53.673366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af8117-002f-487b-b8c7-65f0bc6f144e service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:40:53.679590 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412ddab-5d00-468a-8bbe-9a409cc1738b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:40:53.680243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412ddab-5d00-468a-8bbe-9a409cc1738b service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:40:53.680522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412ddab-5d00-468a-8bbe-9a409cc1738b service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:40:53.680793 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412ddab-5d00-468a-8bbe-9a409cc1738b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:40:53.683109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2412ddab-5d00-468a-8bbe-9a409cc1738b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:40:53.769263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412ddab-5d00-468a-8bbe-9a409cc1738b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:40:53.771456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412ddab-5d00-468a-8bbe-9a409cc1738b service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:40:53.780957 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1224/2395] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:40:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:40:59.987886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=6 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:02.402747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b313d-1dc6-439f-97aa-772fb24da7f0 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:02.403393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b313d-1dc6-439f-97aa-772fb24da7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:02.403559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b313d-1dc6-439f-97aa-772fb24da7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:02.426634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-6f3b313d-1dc6-439f-97aa-772fb24da7f0 None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:02.428869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6f3b313d-1dc6-439f-97aa-772fb24da7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:02.501920 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1172/2396] 10.222.0.50 () {58 vars in 967 bytes} [Wed Jun 15 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:02.557127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31780e62-ce22-48be-b598-ca7b991c7af0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:02.557588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31780e62-ce22-48be-b598-ca7b991c7af0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:02.557712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31780e62-ce22-48be-b598-ca7b991c7af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:02.564559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b313d-1dc6-439f-97aa-772fb24da7f0 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:02.566083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6f3b313d-1dc6-439f-97aa-772fb24da7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:02.576138 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-31780e62-ce22-48be-b598-ca7b991c7af0 None None] MFA Rules not processed for user `0d6ad1725257401888617fdcf7e57386`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:02.577355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-31780e62-ce22-48be-b598-ca7b991c7af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:02.585044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1225/2397] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:02.660337 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b313d-1dc6-439f-97aa-772fb24da7f0 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:02.667518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98632197-e10d-463e-aabb-f01540dc38b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:02.668972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98632197-e10d-463e-aabb-f01540dc38b7 service swift] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:02.668972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98632197-e10d-463e-aabb-f01540dc38b7 service swift] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:02.668972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98632197-e10d-463e-aabb-f01540dc38b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:02.678736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98632197-e10d-463e-aabb-f01540dc38b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:02.679973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98632197-e10d-463e-aabb-f01540dc38b7 service swift] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:02.691242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1173/2398] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:41:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 10:41:02.952772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31780e62-ce22-48be-b598-ca7b991c7af0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:02.967736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31780e62-ce22-48be-b598-ca7b991c7af0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:02.971367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1156b-306a-48b3-8058-a053ee86b4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:02.972068 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1156b-306a-48b3-8058-a053ee86b4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:02.972350 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1156b-306a-48b3-8058-a053ee86b4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:02.972627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1156b-306a-48b3-8058-a053ee86b4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:02.974461 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d7f1156b-306a-48b3-8058-a053ee86b4a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:02.988945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1156b-306a-48b3-8058-a053ee86b4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:02.991403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1156b-306a-48b3-8058-a053ee86b4a9 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:03.004780 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1226/2399] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:41:03.877371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98632197-e10d-463e-aabb-f01540dc38b7 service swift] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:03.879072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-98632197-e10d-463e-aabb-f01540dc38b7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:03.936048 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98632197-e10d-463e-aabb-f01540dc38b7 service swift] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:03.939634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655fc59-b51e-44cb-9fbc-f0e41894d099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:03.940276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655fc59-b51e-44cb-9fbc-f0e41894d099 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:03.940555 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655fc59-b51e-44cb-9fbc-f0e41894d099 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:03.940825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655fc59-b51e-44cb-9fbc-f0e41894d099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:03.943103 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4655fc59-b51e-44cb-9fbc-f0e41894d099 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:03.991869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=100 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:04.005786 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655fc59-b51e-44cb-9fbc-f0e41894d099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:04.007263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655fc59-b51e-44cb-9fbc-f0e41894d099 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:04.017106 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1174/2400] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:41:06.346929 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1156b-306a-48b3-8058-a053ee86b4a9 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:06.367188 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1156b-306a-48b3-8058-a053ee86b4a9 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:06.375157 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab67974-a9e6-4678-b774-8937d48bc293 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2729cb0b9adb44f7ba5c968b6158a93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:06.376756 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab67974-a9e6-4678-b774-8937d48bc293 service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:06.377563 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab67974-a9e6-4678-b774-8937d48bc293 service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:06.378425 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab67974-a9e6-4678-b774-8937d48bc293 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:06.381574 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0ab67974-a9e6-4678-b774-8937d48bc293 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:06.401639 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab67974-a9e6-4678-b774-8937d48bc293 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:06.406239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab67974-a9e6-4678-b774-8937d48bc293 service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:06.428835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1227/2401] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:41:09.301809 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655fc59-b51e-44cb-9fbc-f0e41894d099 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:09.314812 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655fc59-b51e-44cb-9fbc-f0e41894d099 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:09.321199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88534ee5-e1f2-4ab3-8606-edae6aff8f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:09.323542 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88534ee5-e1f2-4ab3-8606-edae6aff8f8d service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:09.323890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88534ee5-e1f2-4ab3-8606-edae6aff8f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:09.324113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88534ee5-e1f2-4ab3-8606-edae6aff8f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:09.326132 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-88534ee5-e1f2-4ab3-8606-edae6aff8f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:09.398286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88534ee5-e1f2-4ab3-8606-edae6aff8f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:09.399793 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88534ee5-e1f2-4ab3-8606-edae6aff8f8d service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:09.412338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1175/2402] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:41:10.499505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab67974-a9e6-4678-b774-8937d48bc293 service placement] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:10.503944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-0ab67974-a9e6-4678-b774-8937d48bc293 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:10.525886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab67974-a9e6-4678-b774-8937d48bc293 service placement] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:10.530488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05246a-deab-45ed-94f9-4a2cb042b282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:10.531357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05246a-deab-45ed-94f9-4a2cb042b282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:10.531670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05246a-deab-45ed-94f9-4a2cb042b282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:10.531949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05246a-deab-45ed-94f9-4a2cb042b282 admin admin] PATH_INFO: `/v3/users/c8d021a31593434bb0e673d59bd79135` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:10.533149 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05246a-deab-45ed-94f9-4a2cb042b282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d021a31593434bb0e673d59bd79135)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:10.535061 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05246a-deab-45ed-94f9-4a2cb042b282 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:10.589735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bb05246a-deab-45ed-94f9-4a2cb042b282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d021a31593434bb0e673d59bd79135'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:10.602822 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bb05246a-deab-45ed-94f9-4a2cb042b282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d021a31593434bb0e673d59bd79135'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:10.603580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bb05246a-deab-45ed-94f9-4a2cb042b282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d021a31593434bb0e673d59bd79135'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:10.610433 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bb05246a-deab-45ed-94f9-4a2cb042b282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d021a31593434bb0e673d59bd79135'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:10.618181 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-bb05246a-deab-45ed-94f9-4a2cb042b282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d021a31593434bb0e673d59bd79135'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:10.625548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1228/2403] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:41:10 2022] DELETE /identity/v3/users/c8d021a31593434bb0e673d59bd79135 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:10.824270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88534ee5-e1f2-4ab3-8606-edae6aff8f8d service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:10.849945 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88534ee5-e1f2-4ab3-8606-edae6aff8f8d service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:10.870416 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20493a10-38ac-4179-ae1a-3f6faf517614 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:10.870729 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20493a10-38ac-4179-ae1a-3f6faf517614 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:10.871022 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20493a10-38ac-4179-ae1a-3f6faf517614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:10.890932 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-20493a10-38ac-4179-ae1a-3f6faf517614 None None] MFA Rules not processed for user `abbeca853267434eb1d2fff664f32f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:10.892203 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-20493a10-38ac-4179-ae1a-3f6faf517614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:10.916949 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:10.932751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:10.933778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:10.934067 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:10.934352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] PATH_INFO: `/v3/projects/61e0b30a7fcb4ba7a03fa8789609c806` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:10.935688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e0b30a7fcb4ba7a03fa8789609c806)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:10.938506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:10.976048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1229/2404] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:41:11.003347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e0b30a7fcb4ba7a03fa8789609c806', 'request_id': 'req-79ff7549-ae35-485f-be73-1147ecf1cb59'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:11.012471 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e0b30a7fcb4ba7a03fa8789609c806', 'request_id': 'req-79ff7549-ae35-485f-be73-1147ecf1cb59'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:11.019636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e0b30a7fcb4ba7a03fa8789609c806', 'request_id': 'req-79ff7549-ae35-485f-be73-1147ecf1cb59'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:11.037116 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] The token cache is being invalidate because project 61e0b30a7fcb4ba7a03fa8789609c806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:41:11.038286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:11.038959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:11.041769 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1176/2405] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:41:10 2022] DELETE /identity/v3/projects/61e0b30a7fcb4ba7a03fa8789609c806 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:11.045591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20493a10-38ac-4179-ae1a-3f6faf517614 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:11.047145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-20493a10-38ac-4179-ae1a-3f6faf517614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:11.064796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20493a10-38ac-4179-ae1a-3f6faf517614 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:11.162050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f8cfb-fa99-4732-b25d-5faa78423011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:11.163016 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f8cfb-fa99-4732-b25d-5faa78423011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:11.163372 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f8cfb-fa99-4732-b25d-5faa78423011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:11.163942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f8cfb-fa99-4732-b25d-5faa78423011 admin admin] PATH_INFO: `/v3/users/0bdc03d6e33249d79709248a4ce20371` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:11.165320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f8cfb-fa99-4732-b25d-5faa78423011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bdc03d6e33249d79709248a4ce20371)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:11.167930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f8cfb-fa99-4732-b25d-5faa78423011 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:11.243781 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-499f8cfb-fa99-4732-b25d-5faa78423011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bdc03d6e33249d79709248a4ce20371'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:11.263459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-499f8cfb-fa99-4732-b25d-5faa78423011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bdc03d6e33249d79709248a4ce20371'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:11.265447 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-499f8cfb-fa99-4732-b25d-5faa78423011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bdc03d6e33249d79709248a4ce20371'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:11.286780 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-499f8cfb-fa99-4732-b25d-5faa78423011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bdc03d6e33249d79709248a4ce20371'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:11.303005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-499f8cfb-fa99-4732-b25d-5faa78423011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bdc03d6e33249d79709248a4ce20371'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:11.310209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1230/2406] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:41:11 2022] DELETE /identity/v3/users/0bdc03d6e33249d79709248a4ce20371 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:11.757769 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:11.760303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:11.782463 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff7549-ae35-485f-be73-1147ecf1cb59 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:11.811238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:11.904951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:11.905979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:11.906266 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:11.906543 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] PATH_INFO: `/v3/projects/d104dd84f3304c27b11bd2d9391b6506` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:11.907840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d104dd84f3304c27b11bd2d9391b6506)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:11.909825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:12.018770 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd104dd84f3304c27b11bd2d9391b6506', 'request_id': 'req-ae901b9b-45c4-423e-b908-6ff44b776d16'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:12.032338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd104dd84f3304c27b11bd2d9391b6506', 'request_id': 'req-ae901b9b-45c4-423e-b908-6ff44b776d16'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:12.039880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd104dd84f3304c27b11bd2d9391b6506', 'request_id': 'req-ae901b9b-45c4-423e-b908-6ff44b776d16'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:12.066119 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] The token cache is being invalidate because project d104dd84f3304c27b11bd2d9391b6506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:41:12.066413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:12.067856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:12.070612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1177/2407] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:41:11 2022] DELETE /identity/v3/projects/d104dd84f3304c27b11bd2d9391b6506 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:21.306008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=67,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:22.060309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:32.826079 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f8cfb-fa99-4732-b25d-5faa78423011 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:32.827635 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-499f8cfb-fa99-4732-b25d-5faa78423011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:32.887187 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f8cfb-fa99-4732-b25d-5faa78423011 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:32.941048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51085641-5511-4d29-9bc0-0d09fb766da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:32.942013 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085641-5511-4d29-9bc0-0d09fb766da8 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:32.942013 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085641-5511-4d29-9bc0-0d09fb766da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:32.942256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085641-5511-4d29-9bc0-0d09fb766da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:32.944198 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-51085641-5511-4d29-9bc0-0d09fb766da8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:33.008370 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51085641-5511-4d29-9bc0-0d09fb766da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:33.010361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51085641-5511-4d29-9bc0-0d09fb766da8 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:33.020235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1231/2408] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:41:36.205514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:36.207034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:36.265594 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51085641-5511-4d29-9bc0-0d09fb766da8 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:36.267758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-51085641-5511-4d29-9bc0-0d09fb766da8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:36.301799 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51085641-5511-4d29-9bc0-0d09fb766da8 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:36.302081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae901b9b-45c4-423e-b908-6ff44b776d16 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:36.302193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb34e56-24ea-4be4-b480-f3c48fb13a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:36.302317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fd8c4-d321-4b77-ab63-c919580600cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2729cb0b9adb44f7ba5c968b6158a93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:36.302422 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb34e56-24ea-4be4-b480-f3c48fb13a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:36.302422 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb34e56-24ea-4be4-b480-f3c48fb13a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:36.302422 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb34e56-24ea-4be4-b480-f3c48fb13a45 admin admin] PATH_INFO: `/v3/users/76ccc16f729b4042916db8c1183d2379` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:36.302705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fd8c4-d321-4b77-ab63-c919580600cc service placement] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:36.302917 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fd8c4-d321-4b77-ab63-c919580600cc service placement] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:36.303139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb34e56-24ea-4be4-b480-f3c48fb13a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ccc16f729b4042916db8c1183d2379)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:36.303327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fd8c4-d321-4b77-ab63-c919580600cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:36.305144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb34e56-24ea-4be4-b480-f3c48fb13a45 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:36.305339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-9d8fd8c4-d321-4b77-ab63-c919580600cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:36.317289 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fd8c4-d321-4b77-ab63-c919580600cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:36.318878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fd8c4-d321-4b77-ab63-c919580600cc service placement] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:36.330197 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1178/2409] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:41:36.358416 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6cb34e56-24ea-4be4-b480-f3c48fb13a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ccc16f729b4042916db8c1183d2379'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:36.370408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:36.373229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6cb34e56-24ea-4be4-b480-f3c48fb13a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ccc16f729b4042916db8c1183d2379'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:36.374169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6cb34e56-24ea-4be4-b480-f3c48fb13a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ccc16f729b4042916db8c1183d2379'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:36.382064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6cb34e56-24ea-4be4-b480-f3c48fb13a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ccc16f729b4042916db8c1183d2379'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:36.390912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6cb34e56-24ea-4be4-b480-f3c48fb13a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ccc16f729b4042916db8c1183d2379'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:36.414985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1232/2410] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:41:36 2022] DELETE /identity/v3/users/76ccc16f729b4042916db8c1183d2379 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:41:36.582054 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fd8c4-d321-4b77-ab63-c919580600cc service placement] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:36.592860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fd8c4-d321-4b77-ab63-c919580600cc service placement] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:36.649961 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdef96f-d09f-400d-8478-870861d24d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:36.650871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdef96f-d09f-400d-8478-870861d24d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:36.651153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdef96f-d09f-400d-8478-870861d24d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:36.651433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdef96f-d09f-400d-8478-870861d24d4f admin admin] PATH_INFO: `/v3/projects/5143578952424a79b07f6a7468b528a3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:36.652725 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdef96f-d09f-400d-8478-870861d24d4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5143578952424a79b07f6a7468b528a3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:36.654631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdef96f-d09f-400d-8478-870861d24d4f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:36.701542 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-8cdef96f-d09f-400d-8478-870861d24d4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5143578952424a79b07f6a7468b528a3', 'request_id': 'req-8cdef96f-d09f-400d-8478-870861d24d4f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:36.707378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-8cdef96f-d09f-400d-8478-870861d24d4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5143578952424a79b07f6a7468b528a3', 'request_id': 'req-8cdef96f-d09f-400d-8478-870861d24d4f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:36.712763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-8cdef96f-d09f-400d-8478-870861d24d4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5143578952424a79b07f6a7468b528a3', 'request_id': 'req-8cdef96f-d09f-400d-8478-870861d24d4f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:36.725625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-8cdef96f-d09f-400d-8478-870861d24d4f admin admin] The token cache is being invalidate because project 5143578952424a79b07f6a7468b528a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:41:36.725911 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-8cdef96f-d09f-400d-8478-870861d24d4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:36.726530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-8cdef96f-d09f-400d-8478-870861d24d4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:36.730193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1179/2411] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:41:36 2022] DELETE /identity/v3/projects/5143578952424a79b07f6a7468b528a3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:36.736905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fedcaf-be0b-465e-a189-a17653d616ea None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:36.736905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fedcaf-be0b-465e-a189-a17653d616ea None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:36.736905 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fedcaf-be0b-465e-a189-a17653d616ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:36.756854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d8fedcaf-be0b-465e-a189-a17653d616ea None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:36.758060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d8fedcaf-be0b-465e-a189-a17653d616ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:36.822202 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1233/2412] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:36.830000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85fdd0-aea9-4fbd-a778-98ac0694f37d None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:36.830339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85fdd0-aea9-4fbd-a778-98ac0694f37d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:36.830645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85fdd0-aea9-4fbd-a778-98ac0694f37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:36.849375 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ed85fdd0-aea9-4fbd-a778-98ac0694f37d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:36.850690 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ed85fdd0-aea9-4fbd-a778-98ac0694f37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:36.859011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1180/2413] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:36.863591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fedcaf-be0b-465e-a189-a17653d616ea None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:36.874070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fedcaf-be0b-465e-a189-a17653d616ea None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:36.878829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b95eb2-205e-4b3e-9f4e-0145cf199aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:36.879499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b95eb2-205e-4b3e-9f4e-0145cf199aac admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:36.879787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b95eb2-205e-4b3e-9f4e-0145cf199aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:36.880064 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b95eb2-205e-4b3e-9f4e-0145cf199aac admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:36.880821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b95eb2-205e-4b3e-9f4e-0145cf199aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:41:36.881125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b95eb2-205e-4b3e-9f4e-0145cf199aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:36.882721 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b95eb2-205e-4b3e-9f4e-0145cf199aac admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:36.894195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1234/2414] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:41:36.898609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85fdd0-aea9-4fbd-a778-98ac0694f37d None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:36.907760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85fdd0-aea9-4fbd-a778-98ac0694f37d None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:36.912415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f9b5a-8524-44aa-93a4-03e05cdda7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:36.913062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f9b5a-8524-44aa-93a4-03e05cdda7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:36.913345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f9b5a-8524-44aa-93a4-03e05cdda7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:36.913625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f9b5a-8524-44aa-93a4-03e05cdda7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:36.914307 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f9b5a-8524-44aa-93a4-03e05cdda7a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:36.916773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f9b5a-8524-44aa-93a4-03e05cdda7a5 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:36.926205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:36.956510 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1181/2415] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:41:36 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:41:36.957677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b95eb2-205e-4b3e-9f4e-0145cf199aac admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:36.967696 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b95eb2-205e-4b3e-9f4e-0145cf199aac admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:37.023603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b819d7-0709-4aeb-b7f8-898ad09060ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:37.024262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b819d7-0709-4aeb-b7f8-898ad09060ac admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:37.024542 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b819d7-0709-4aeb-b7f8-898ad09060ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:37.024812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b819d7-0709-4aeb-b7f8-898ad09060ac admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:37.025484 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b819d7-0709-4aeb-b7f8-898ad09060ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:37.027377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b819d7-0709-4aeb-b7f8-898ad09060ac admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:37.047018 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1235/2416] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:41:36 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:41:37.051261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f9b5a-8524-44aa-93a4-03e05cdda7a5 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:37.062273 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f9b5a-8524-44aa-93a4-03e05cdda7a5 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:37.066908 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419df694-9352-4ea7-9e37-1844a482c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:37.067605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419df694-9352-4ea7-9e37-1844a482c9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:37.067890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419df694-9352-4ea7-9e37-1844a482c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:37.068167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419df694-9352-4ea7-9e37-1844a482c9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:37.068897 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419df694-9352-4ea7-9e37-1844a482c9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:37.070495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419df694-9352-4ea7-9e37-1844a482c9a6 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:37.080304 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1182/2417] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:41:37.084350 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b819d7-0709-4aeb-b7f8-898ad09060ac admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:37.094136 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b819d7-0709-4aeb-b7f8-898ad09060ac admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:37.098758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee863bc-515f-4985-9280-531d334b8af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:37.099403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee863bc-515f-4985-9280-531d334b8af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:37.099713 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee863bc-515f-4985-9280-531d334b8af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:37.099989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee863bc-515f-4985-9280-531d334b8af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:37.100709 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee863bc-515f-4985-9280-531d334b8af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:37.102282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee863bc-515f-4985-9280-531d334b8af5 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:37.113381 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1236/2418] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:41:37.117752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419df694-9352-4ea7-9e37-1844a482c9a6 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:37.128550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419df694-9352-4ea7-9e37-1844a482c9a6 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:37.134924 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35d66c-70c2-4be4-93db-c860da4468f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:37.135877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35d66c-70c2-4be4-93db-c860da4468f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:37.136161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35d66c-70c2-4be4-93db-c860da4468f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:37.136437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35d66c-70c2-4be4-93db-c860da4468f3 admin admin] PATH_INFO: `/v3/projects/944ad666efa94e3dabea2e6d2ca64343/users/eae03642409e49aea25387cee97a9e24/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:37.152158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35d66c-70c2-4be4-93db-c860da4468f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944ad666efa94e3dabea2e6d2ca64343, user_id=eae03642409e49aea25387cee97a9e24, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:37.154825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35d66c-70c2-4be4-93db-c860da4468f3 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:37.168337 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1183/2419] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:41:37 2022] PUT /identity/v3/projects/944ad666efa94e3dabea2e6d2ca64343/users/eae03642409e49aea25387cee97a9e24/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:37.178357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f466d-2610-4d22-b182-af9759c842a0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:37.178698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f466d-2610-4d22-b182-af9759c842a0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:37.179029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f466d-2610-4d22-b182-af9759c842a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:37.204680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-590f466d-2610-4d22-b182-af9759c842a0 None None] MFA Rules not processed for user `eae03642409e49aea25387cee97a9e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:37.205862 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-590f466d-2610-4d22-b182-af9759c842a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:37.238492 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:37.271775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1237/2420] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:37.276681 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35d66c-70c2-4be4-93db-c860da4468f3 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:37.336931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35d66c-70c2-4be4-93db-c860da4468f3 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:37.342080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26048da5-578f-4c46-8bc0-5513d98b0c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:37.342734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048da5-578f-4c46-8bc0-5513d98b0c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:37.343016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048da5-578f-4c46-8bc0-5513d98b0c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:37.343293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26048da5-578f-4c46-8bc0-5513d98b0c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:37.344023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26048da5-578f-4c46-8bc0-5513d98b0c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:37.345922 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26048da5-578f-4c46-8bc0-5513d98b0c6f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:37.373359 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1184/2421] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:41:37 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:41:37.377275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f466d-2610-4d22-b182-af9759c842a0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:37.388211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f466d-2610-4d22-b182-af9759c842a0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:37.443913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c07c6-21b6-4083-b60d-a661110573a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:37.444571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c07c6-21b6-4083-b60d-a661110573a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:37.444855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c07c6-21b6-4083-b60d-a661110573a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:37.445131 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c07c6-21b6-4083-b60d-a661110573a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:37.445810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c07c6-21b6-4083-b60d-a661110573a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:37.447778 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c07c6-21b6-4083-b60d-a661110573a2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:37.467998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1238/2422] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:41:37 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:41:37.471932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26048da5-578f-4c46-8bc0-5513d98b0c6f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:37.482297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26048da5-578f-4c46-8bc0-5513d98b0c6f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:37.486875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82748c0-af12-42c9-a711-51b279c1a18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:37.487582 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82748c0-af12-42c9-a711-51b279c1a18e admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:37.487869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82748c0-af12-42c9-a711-51b279c1a18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:37.488151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82748c0-af12-42c9-a711-51b279c1a18e admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:37.488922 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82748c0-af12-42c9-a711-51b279c1a18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:37.490484 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82748c0-af12-42c9-a711-51b279c1a18e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:37.502847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1185/2423] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:41:37.507317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c07c6-21b6-4083-b60d-a661110573a2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:37.518134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c07c6-21b6-4083-b60d-a661110573a2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:37.522728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf55da3-c37c-4e39-958b-4bfb50c07082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:37.523659 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf55da3-c37c-4e39-958b-4bfb50c07082 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:37.523943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf55da3-c37c-4e39-958b-4bfb50c07082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:37.524217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf55da3-c37c-4e39-958b-4bfb50c07082 admin admin] PATH_INFO: `/v3/projects/ff15b8b0aa6542559d6807eca0b653ea/users/cdfccd9bf9f6472c8a5dce6ba476e069/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:37.541055 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf55da3-c37c-4e39-958b-4bfb50c07082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff15b8b0aa6542559d6807eca0b653ea, user_id=cdfccd9bf9f6472c8a5dce6ba476e069, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:37.543631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf55da3-c37c-4e39-958b-4bfb50c07082 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:37.557640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1239/2424] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:41:37 2022] PUT /identity/v3/projects/ff15b8b0aa6542559d6807eca0b653ea/users/cdfccd9bf9f6472c8a5dce6ba476e069/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:37.561533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82748c0-af12-42c9-a711-51b279c1a18e admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:37.571439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82748c0-af12-42c9-a711-51b279c1a18e admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:37.625785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5b65a-9edc-4129-82d4-f1441bd0ce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:37.626568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5b65a-9edc-4129-82d4-f1441bd0ce2d admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:37.626881 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5b65a-9edc-4129-82d4-f1441bd0ce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:37.627158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5b65a-9edc-4129-82d4-f1441bd0ce2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:37.627921 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5b65a-9edc-4129-82d4-f1441bd0ce2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:37.629843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5b65a-9edc-4129-82d4-f1441bd0ce2d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:37.639863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1186/2425] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:41:37.644124 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf55da3-c37c-4e39-958b-4bfb50c07082 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:37.654414 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf55da3-c37c-4e39-958b-4bfb50c07082 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:37.659367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d94952-fad7-4a91-97d7-53851c6ba5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:37.660404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d94952-fad7-4a91-97d7-53851c6ba5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:37.660709 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d94952-fad7-4a91-97d7-53851c6ba5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:37.660983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d94952-fad7-4a91-97d7-53851c6ba5ef admin admin] PATH_INFO: `/v3/projects/ff15b8b0aa6542559d6807eca0b653ea/users/cdfccd9bf9f6472c8a5dce6ba476e069/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:37.662998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d94952-fad7-4a91-97d7-53851c6ba5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff15b8b0aa6542559d6807eca0b653ea, user_id=cdfccd9bf9f6472c8a5dce6ba476e069, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:37.666269 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d94952-fad7-4a91-97d7-53851c6ba5ef admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:37.678192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1240/2426] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:41:37 2022] PUT /identity/v3/projects/ff15b8b0aa6542559d6807eca0b653ea/users/cdfccd9bf9f6472c8a5dce6ba476e069/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:37.689915 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21793-12b1-4428-8171-be5e75d8f909 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:37.690213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21793-12b1-4428-8171-be5e75d8f909 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:37.690496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21793-12b1-4428-8171-be5e75d8f909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:37.717649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-d4e21793-12b1-4428-8171-be5e75d8f909 None None] MFA Rules not processed for user `cdfccd9bf9f6472c8a5dce6ba476e069`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:37.718854 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d4e21793-12b1-4428-8171-be5e75d8f909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:37.724032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:37.795130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1187/2427] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:37.806982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d94952-fad7-4a91-97d7-53851c6ba5ef admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:37.808865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-03d94952-fad7-4a91-97d7-53851c6ba5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:37.868097 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d94952-fad7-4a91-97d7-53851c6ba5ef admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:37.872881 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce4162-3a0b-4cee-b374-8531b93e7560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:37.873654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4162-3a0b-4cee-b374-8531b93e7560 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:37.873943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4162-3a0b-4cee-b374-8531b93e7560 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:37.874248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4162-3a0b-4cee-b374-8531b93e7560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:37.884203 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce4162-3a0b-4cee-b374-8531b93e7560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:37.885622 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce4162-3a0b-4cee-b374-8531b93e7560 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:37.895404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1241/2428] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:37 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:41:38.266463 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e21793-12b1-4428-8171-be5e75d8f909 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:38.328390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e21793-12b1-4428-8171-be5e75d8f909 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:38.332811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706de00-0203-4dd3-8ee3-26a41c15535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:38.333791 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706de00-0203-4dd3-8ee3-26a41c15535b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:38.334093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706de00-0203-4dd3-8ee3-26a41c15535b admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:38.334351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706de00-0203-4dd3-8ee3-26a41c15535b admin admin] PATH_INFO: `/v3/users/eae03642409e49aea25387cee97a9e24` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:38.335559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706de00-0203-4dd3-8ee3-26a41c15535b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae03642409e49aea25387cee97a9e24)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:38.337458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706de00-0203-4dd3-8ee3-26a41c15535b admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:38.383958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5706de00-0203-4dd3-8ee3-26a41c15535b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae03642409e49aea25387cee97a9e24'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:38.395296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5706de00-0203-4dd3-8ee3-26a41c15535b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae03642409e49aea25387cee97a9e24'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:38.395974 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5706de00-0203-4dd3-8ee3-26a41c15535b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae03642409e49aea25387cee97a9e24'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:38.403219 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5706de00-0203-4dd3-8ee3-26a41c15535b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae03642409e49aea25387cee97a9e24'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:38.403901 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5706de00-0203-4dd3-8ee3-26a41c15535b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae03642409e49aea25387cee97a9e24'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:38.416921 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1188/2429] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:41:38 2022] DELETE /identity/v3/users/eae03642409e49aea25387cee97a9e24 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:38.421569 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2a2ef-e63f-4527-b4f4-6aec3a48ba19 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:38.422053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2a2ef-e63f-4527-b4f4-6aec3a48ba19 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:38.422153 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2a2ef-e63f-4527-b4f4-6aec3a48ba19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:38.440245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a3f2a2ef-e63f-4527-b4f4-6aec3a48ba19 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:38.441438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a3f2a2ef-e63f-4527-b4f4-6aec3a48ba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:38.464620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:38.500512 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1242/2430] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:38.510460 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706de00-0203-4dd3-8ee3-26a41c15535b admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:38.511910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-5706de00-0203-4dd3-8ee3-26a41c15535b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:38.537424 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:38.570397 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706de00-0203-4dd3-8ee3-26a41c15535b admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:38.574045 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff463194-b7c4-4a08-8fd0-343a3b918f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:38.574688 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff463194-b7c4-4a08-8fd0-343a3b918f78 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:38.574975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff463194-b7c4-4a08-8fd0-343a3b918f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:38.575255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff463194-b7c4-4a08-8fd0-343a3b918f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:38.584320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff463194-b7c4-4a08-8fd0-343a3b918f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:38.585698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff463194-b7c4-4a08-8fd0-343a3b918f78 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:38.595303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1189/2431] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:41:38.859817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2a2ef-e63f-4527-b4f4-6aec3a48ba19 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:38.861678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a3f2a2ef-e63f-4527-b4f4-6aec3a48ba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:38.875695 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2a2ef-e63f-4527-b4f4-6aec3a48ba19 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:38.882165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:38.883037 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:38.883355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:38.883528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] PATH_INFO: `/v3/projects/944ad666efa94e3dabea2e6d2ca64343` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:38.884708 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=944ad666efa94e3dabea2e6d2ca64343)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:38.886625 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:38.934146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944ad666efa94e3dabea2e6d2ca64343', 'request_id': 'req-cce41c2e-d7c0-4941-adc1-2990a4a3f062'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:38.940470 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944ad666efa94e3dabea2e6d2ca64343', 'request_id': 'req-cce41c2e-d7c0-4941-adc1-2990a4a3f062'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:38.947840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944ad666efa94e3dabea2e6d2ca64343', 'request_id': 'req-cce41c2e-d7c0-4941-adc1-2990a4a3f062'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:38.960106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] The token cache is being invalidate because project 944ad666efa94e3dabea2e6d2ca64343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:41:38.960398 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:38.961031 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:38.962569 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1243/2432] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:41:38 2022] DELETE /identity/v3/projects/944ad666efa94e3dabea2e6d2ca64343 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:38.967147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff463194-b7c4-4a08-8fd0-343a3b918f78 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:38.976997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff463194-b7c4-4a08-8fd0-343a3b918f78 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:39.033104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d0c3e-a63c-4b0e-b019-dfbe94dc10e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:39.033959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d0c3e-a63c-4b0e-b019-dfbe94dc10e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:39.034240 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d0c3e-a63c-4b0e-b019-dfbe94dc10e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:39.034537 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d0c3e-a63c-4b0e-b019-dfbe94dc10e9 admin admin] PATH_INFO: `/v3/users/cdfccd9bf9f6472c8a5dce6ba476e069` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:39.035732 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d0c3e-a63c-4b0e-b019-dfbe94dc10e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdfccd9bf9f6472c8a5dce6ba476e069)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:39.037636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d0c3e-a63c-4b0e-b019-dfbe94dc10e9 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:39.081675 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-847d0c3e-a63c-4b0e-b019-dfbe94dc10e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdfccd9bf9f6472c8a5dce6ba476e069'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:39.093660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-847d0c3e-a63c-4b0e-b019-dfbe94dc10e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdfccd9bf9f6472c8a5dce6ba476e069'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:39.094316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-847d0c3e-a63c-4b0e-b019-dfbe94dc10e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdfccd9bf9f6472c8a5dce6ba476e069'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:39.101701 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-847d0c3e-a63c-4b0e-b019-dfbe94dc10e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdfccd9bf9f6472c8a5dce6ba476e069'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:39.102262 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-847d0c3e-a63c-4b0e-b019-dfbe94dc10e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdfccd9bf9f6472c8a5dce6ba476e069'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:39.114314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1190/2433] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:41:38 2022] DELETE /identity/v3/users/cdfccd9bf9f6472c8a5dce6ba476e069 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:39.385649 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:39.387116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:39.401992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce41c2e-d7c0-4941-adc1-2990a4a3f062 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:39.462790 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd58c2-4ab2-4675-a425-d092162cccaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:39.464008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd58c2-4ab2-4675-a425-d092162cccaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:39.464418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd58c2-4ab2-4675-a425-d092162cccaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:39.464822 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd58c2-4ab2-4675-a425-d092162cccaf admin admin] PATH_INFO: `/v3/projects/ff15b8b0aa6542559d6807eca0b653ea` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:39.466458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd58c2-4ab2-4675-a425-d092162cccaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff15b8b0aa6542559d6807eca0b653ea)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:39.468907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd58c2-4ab2-4675-a425-d092162cccaf admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:39.520738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-58fd58c2-4ab2-4675-a425-d092162cccaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff15b8b0aa6542559d6807eca0b653ea', 'request_id': 'req-58fd58c2-4ab2-4675-a425-d092162cccaf'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:39.524495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:39.527217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-58fd58c2-4ab2-4675-a425-d092162cccaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff15b8b0aa6542559d6807eca0b653ea', 'request_id': 'req-58fd58c2-4ab2-4675-a425-d092162cccaf'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:39.535123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-58fd58c2-4ab2-4675-a425-d092162cccaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff15b8b0aa6542559d6807eca0b653ea', 'request_id': 'req-58fd58c2-4ab2-4675-a425-d092162cccaf'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:39.546766 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-58fd58c2-4ab2-4675-a425-d092162cccaf admin admin] The token cache is being invalidate because project ff15b8b0aa6542559d6807eca0b653ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:41:39.547038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-58fd58c2-4ab2-4675-a425-d092162cccaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:39.547698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-58fd58c2-4ab2-4675-a425-d092162cccaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:39.549225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1244/2434] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:41:39 2022] DELETE /identity/v3/projects/ff15b8b0aa6542559d6807eca0b653ea => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:39.554135 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e85a-12e2-40ca-a728-672d36ff5827 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:39.554738 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e85a-12e2-40ca-a728-672d36ff5827 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:39.554738 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409e85a-12e2-40ca-a728-672d36ff5827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:39.573297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-a409e85a-12e2-40ca-a728-672d36ff5827 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:39.574505 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a409e85a-12e2-40ca-a728-672d36ff5827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:39.613056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:39.635222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1191/2435] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:39.642931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670f6bf-88e2-469f-9b38-7696a3970fc4 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:39.643220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670f6bf-88e2-469f-9b38-7696a3970fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:39.643530 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670f6bf-88e2-469f-9b38-7696a3970fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:39.662102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9670f6bf-88e2-469f-9b38-7696a3970fc4 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:39.663338 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9670f6bf-88e2-469f-9b38-7696a3970fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:39.671695 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1245/2436] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:39.675916 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409e85a-12e2-40ca-a728-672d36ff5827 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:39.686385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409e85a-12e2-40ca-a728-672d36ff5827 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:39.690966 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908a840-9a68-4145-9233-8c9631ca5062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:39.691668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908a840-9a68-4145-9233-8c9631ca5062 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:39.691948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908a840-9a68-4145-9233-8c9631ca5062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:39.692217 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908a840-9a68-4145-9233-8c9631ca5062 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:39.692935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908a840-9a68-4145-9233-8c9631ca5062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:41:39.693238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908a840-9a68-4145-9233-8c9631ca5062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:39.694819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908a840-9a68-4145-9233-8c9631ca5062 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:39.706995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1192/2437] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:41:39.711312 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670f6bf-88e2-469f-9b38-7696a3970fc4 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:39.720684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670f6bf-88e2-469f-9b38-7696a3970fc4 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:39.725246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b59fd0-0177-4dcf-8be3-4ad9e1d2f001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:39.725882 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b59fd0-0177-4dcf-8be3-4ad9e1d2f001 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:39.726162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b59fd0-0177-4dcf-8be3-4ad9e1d2f001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:39.726438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b59fd0-0177-4dcf-8be3-4ad9e1d2f001 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:39.727112 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b59fd0-0177-4dcf-8be3-4ad9e1d2f001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:39.729024 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b59fd0-0177-4dcf-8be3-4ad9e1d2f001 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:39.755287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1246/2438] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:41:39 2022] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:41:39.758693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908a840-9a68-4145-9233-8c9631ca5062 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:39.769439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908a840-9a68-4145-9233-8c9631ca5062 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:39.825523 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad29ed-6c2d-4cbe-b5bc-f0eace72f562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:39.826192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad29ed-6c2d-4cbe-b5bc-f0eace72f562 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:39.826474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad29ed-6c2d-4cbe-b5bc-f0eace72f562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:39.826750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad29ed-6c2d-4cbe-b5bc-f0eace72f562 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:39.827444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad29ed-6c2d-4cbe-b5bc-f0eace72f562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:39.829382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad29ed-6c2d-4cbe-b5bc-f0eace72f562 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:39.849107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1193/2439] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:41:39 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:41:39.853908 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b59fd0-0177-4dcf-8be3-4ad9e1d2f001 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:39.864477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b59fd0-0177-4dcf-8be3-4ad9e1d2f001 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:39.869963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1810e-ca5a-4159-9619-3b6f7697a990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:39.870615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1810e-ca5a-4159-9619-3b6f7697a990 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:39.870892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1810e-ca5a-4159-9619-3b6f7697a990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:39.871167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1810e-ca5a-4159-9619-3b6f7697a990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:39.871919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1810e-ca5a-4159-9619-3b6f7697a990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:39.873504 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1810e-ca5a-4159-9619-3b6f7697a990 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:39.884687 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1247/2440] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:41:39.888770 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad29ed-6c2d-4cbe-b5bc-f0eace72f562 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:39.898571 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad29ed-6c2d-4cbe-b5bc-f0eace72f562 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:39.903209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86e1b8-b9aa-4570-bfd2-62a0df519a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:39.903892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86e1b8-b9aa-4570-bfd2-62a0df519a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:39.904178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86e1b8-b9aa-4570-bfd2-62a0df519a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:39.904455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86e1b8-b9aa-4570-bfd2-62a0df519a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:39.905209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86e1b8-b9aa-4570-bfd2-62a0df519a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:39.906803 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86e1b8-b9aa-4570-bfd2-62a0df519a7e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:39.917097 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1194/2441] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:41:39.921059 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1810e-ca5a-4159-9619-3b6f7697a990 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:39.931252 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1810e-ca5a-4159-9619-3b6f7697a990 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:39.936603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ea9b2-724d-43a7-880b-4c870b13c081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:39.937474 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea9b2-724d-43a7-880b-4c870b13c081 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:39.937752 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea9b2-724d-43a7-880b-4c870b13c081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:39.938023 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea9b2-724d-43a7-880b-4c870b13c081 admin admin] PATH_INFO: `/v3/projects/140dc067747a40b195b5cc891fa34547/users/4bae48f01cd84aa685f3a11d3cc567b7/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:39.952430 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ea9b2-724d-43a7-880b-4c870b13c081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=140dc067747a40b195b5cc891fa34547, user_id=4bae48f01cd84aa685f3a11d3cc567b7, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:39.955058 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ea9b2-724d-43a7-880b-4c870b13c081 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:39.968175 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1248/2442] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:41:39 2022] PUT /identity/v3/projects/140dc067747a40b195b5cc891fa34547/users/4bae48f01cd84aa685f3a11d3cc567b7/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:39.978829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cf3e1-b43b-4d23-a3ef-1d02a2f33165 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:39.979117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cf3e1-b43b-4d23-a3ef-1d02a2f33165 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:39.979395 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cf3e1-b43b-4d23-a3ef-1d02a2f33165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:40.005999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-bc7cf3e1-b43b-4d23-a3ef-1d02a2f33165 None None] MFA Rules not processed for user `4bae48f01cd84aa685f3a11d3cc567b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:40.007228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-bc7cf3e1-b43b-4d23-a3ef-1d02a2f33165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:40.069767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1195/2443] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:40.074273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ea9b2-724d-43a7-880b-4c870b13c081 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:40.137712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ea9b2-724d-43a7-880b-4c870b13c081 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:40.142459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eb7a7-d23b-46bd-ace5-2d59d9d20bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:40.143045 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eb7a7-d23b-46bd-ace5-2d59d9d20bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:40.143330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eb7a7-d23b-46bd-ace5-2d59d9d20bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:40.143643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eb7a7-d23b-46bd-ace5-2d59d9d20bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:40.144337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657eb7a7-d23b-46bd-ace5-2d59d9d20bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:40.146256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657eb7a7-d23b-46bd-ace5-2d59d9d20bc0 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:40.172588 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1249/2444] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:41:40 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:41:40.176656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cf3e1-b43b-4d23-a3ef-1d02a2f33165 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:40.187166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cf3e1-b43b-4d23-a3ef-1d02a2f33165 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:40.224050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:40.244021 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabebe0-32b8-4520-84ad-106e6971fac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:40.244683 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabebe0-32b8-4520-84ad-106e6971fac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:40.244960 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabebe0-32b8-4520-84ad-106e6971fac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:40.245234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabebe0-32b8-4520-84ad-106e6971fac0 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:40.245923 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabebe0-32b8-4520-84ad-106e6971fac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:40.247858 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabebe0-32b8-4520-84ad-106e6971fac0 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:40.273009 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1196/2445] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:41:40 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:41:40.277637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eb7a7-d23b-46bd-ace5-2d59d9d20bc0 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:40.287884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eb7a7-d23b-46bd-ace5-2d59d9d20bc0 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:40.293121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3b52f-dce9-4ccf-b5d2-f047fecb8932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:40.293763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3b52f-dce9-4ccf-b5d2-f047fecb8932 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:40.294042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3b52f-dce9-4ccf-b5d2-f047fecb8932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:40.294315 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3b52f-dce9-4ccf-b5d2-f047fecb8932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:40.295032 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3b52f-dce9-4ccf-b5d2-f047fecb8932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:40.296639 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa3b52f-dce9-4ccf-b5d2-f047fecb8932 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:40.307041 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1250/2446] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:41:40.311148 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabebe0-32b8-4520-84ad-106e6971fac0 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:40.321171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabebe0-32b8-4520-84ad-106e6971fac0 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:40.325867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01755bdb-fbe8-4d4c-a0a3-879f46646c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:40.326746 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01755bdb-fbe8-4d4c-a0a3-879f46646c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:40.327029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01755bdb-fbe8-4d4c-a0a3-879f46646c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:40.327306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01755bdb-fbe8-4d4c-a0a3-879f46646c5f admin admin] PATH_INFO: `/v3/projects/02fb79b010fe4eb5abb2db2e1b8ba1f9/users/fbb0e23639d9400db1771979cdddebe0/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:40.343656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01755bdb-fbe8-4d4c-a0a3-879f46646c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=02fb79b010fe4eb5abb2db2e1b8ba1f9, user_id=fbb0e23639d9400db1771979cdddebe0, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:40.346312 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01755bdb-fbe8-4d4c-a0a3-879f46646c5f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:40.359896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1197/2447] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:41:40 2022] PUT /identity/v3/projects/02fb79b010fe4eb5abb2db2e1b8ba1f9/users/fbb0e23639d9400db1771979cdddebe0/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:40.363858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3b52f-dce9-4ccf-b5d2-f047fecb8932 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:40.373757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3b52f-dce9-4ccf-b5d2-f047fecb8932 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:40.422620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:40.433214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fef7d-c5ec-43ac-b23b-9aae61f73953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:40.433899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fef7d-c5ec-43ac-b23b-9aae61f73953 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:40.434183 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fef7d-c5ec-43ac-b23b-9aae61f73953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:40.434457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fef7d-c5ec-43ac-b23b-9aae61f73953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:40.435202 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fef7d-c5ec-43ac-b23b-9aae61f73953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:40.436912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fef7d-c5ec-43ac-b23b-9aae61f73953 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:40.446795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1251/2448] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:41:40.450924 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01755bdb-fbe8-4d4c-a0a3-879f46646c5f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:40.461316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01755bdb-fbe8-4d4c-a0a3-879f46646c5f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:40.466793 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb99bf3-11c4-4439-ae7d-7b0ea5ae7801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:40.467739 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb99bf3-11c4-4439-ae7d-7b0ea5ae7801 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:40.468017 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb99bf3-11c4-4439-ae7d-7b0ea5ae7801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:40.468285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb99bf3-11c4-4439-ae7d-7b0ea5ae7801 admin admin] PATH_INFO: `/v3/projects/02fb79b010fe4eb5abb2db2e1b8ba1f9/users/fbb0e23639d9400db1771979cdddebe0/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:40.470225 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb99bf3-11c4-4439-ae7d-7b0ea5ae7801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02fb79b010fe4eb5abb2db2e1b8ba1f9, user_id=fbb0e23639d9400db1771979cdddebe0, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:40.472961 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb99bf3-11c4-4439-ae7d-7b0ea5ae7801 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:40.483525 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1198/2449] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:41:40 2022] PUT /identity/v3/projects/02fb79b010fe4eb5abb2db2e1b8ba1f9/users/fbb0e23639d9400db1771979cdddebe0/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:40.495116 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc0106-7a3d-4473-b76f-49c95ae38999 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:40.495892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc0106-7a3d-4473-b76f-49c95ae38999 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:40.495892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc0106-7a3d-4473-b76f-49c95ae38999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:40.522731 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-31dc0106-7a3d-4473-b76f-49c95ae38999 None None] MFA Rules not processed for user `fbb0e23639d9400db1771979cdddebe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:40.523952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-31dc0106-7a3d-4473-b76f-49c95ae38999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:40.590928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1252/2450] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:40.601620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb99bf3-11c4-4439-ae7d-7b0ea5ae7801 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:40.603381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-edb99bf3-11c4-4439-ae7d-7b0ea5ae7801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:40.660093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb99bf3-11c4-4439-ae7d-7b0ea5ae7801 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:40.663698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567986b-adea-4ff7-a21c-eb3902479fa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:40.664335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567986b-adea-4ff7-a21c-eb3902479fa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:40.664617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567986b-adea-4ff7-a21c-eb3902479fa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:40.664890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567986b-adea-4ff7-a21c-eb3902479fa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:40.674079 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567986b-adea-4ff7-a21c-eb3902479fa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:40.675440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567986b-adea-4ff7-a21c-eb3902479fa3 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:40.684823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1199/2451] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:41:40.730722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc0106-7a3d-4473-b76f-49c95ae38999 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:40.732110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-31dc0106-7a3d-4473-b76f-49c95ae38999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:40.743943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc0106-7a3d-4473-b76f-49c95ae38999 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:40.747441 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf1be5-4035-4a05-99c1-3e9358c8daf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:40.748090 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf1be5-4035-4a05-99c1-3e9358c8daf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:40.748373 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf1be5-4035-4a05-99c1-3e9358c8daf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:40.748644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf1be5-4035-4a05-99c1-3e9358c8daf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:40.809369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf1be5-4035-4a05-99c1-3e9358c8daf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:40.810799 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf1be5-4035-4a05-99c1-3e9358c8daf1 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:40.819730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1253/2452] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:41:44.066759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567986b-adea-4ff7-a21c-eb3902479fa3 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:44.127476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567986b-adea-4ff7-a21c-eb3902479fa3 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:44.132705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7f43b-2660-4732-aa51-dc07fd087a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:44.133580 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7f43b-2660-4732-aa51-dc07fd087a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:44.133861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7f43b-2660-4732-aa51-dc07fd087a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:44.134138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7f43b-2660-4732-aa51-dc07fd087a1e admin admin] PATH_INFO: `/v3/users/4bae48f01cd84aa685f3a11d3cc567b7` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:44.135351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7f43b-2660-4732-aa51-dc07fd087a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bae48f01cd84aa685f3a11d3cc567b7)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:44.137341 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7f43b-2660-4732-aa51-dc07fd087a1e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:44.175140 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:44.185958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f2f7f43b-2660-4732-aa51-dc07fd087a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bae48f01cd84aa685f3a11d3cc567b7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.197760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f2f7f43b-2660-4732-aa51-dc07fd087a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bae48f01cd84aa685f3a11d3cc567b7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.198416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f2f7f43b-2660-4732-aa51-dc07fd087a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bae48f01cd84aa685f3a11d3cc567b7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.205822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f2f7f43b-2660-4732-aa51-dc07fd087a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bae48f01cd84aa685f3a11d3cc567b7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.206437 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f2f7f43b-2660-4732-aa51-dc07fd087a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bae48f01cd84aa685f3a11d3cc567b7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.218322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1200/2453] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:41:44 2022] DELETE /identity/v3/users/4bae48f01cd84aa685f3a11d3cc567b7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:44.222907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610089b1-58eb-4a2a-aa71-1e976f35e6f4 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:44.223374 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610089b1-58eb-4a2a-aa71-1e976f35e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:44.223491 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610089b1-58eb-4a2a-aa71-1e976f35e6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:44.241584 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-610089b1-58eb-4a2a-aa71-1e976f35e6f4 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:44.242771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-610089b1-58eb-4a2a-aa71-1e976f35e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:44.301818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1254/2454] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:44.311877 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7f43b-2660-4732-aa51-dc07fd087a1e admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:44.313263 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f2f7f43b-2660-4732-aa51-dc07fd087a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:44.368113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7f43b-2660-4732-aa51-dc07fd087a1e admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:44.372334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a0302-7f20-4e1f-a916-56f91a2562d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:44.372963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0302-7f20-4e1f-a916-56f91a2562d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:44.373241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0302-7f20-4e1f-a916-56f91a2562d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:44.373514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0302-7f20-4e1f-a916-56f91a2562d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:44.382970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a0302-7f20-4e1f-a916-56f91a2562d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:44.384435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a0302-7f20-4e1f-a916-56f91a2562d1 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:44.393723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1201/2455] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:41:44.662889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610089b1-58eb-4a2a-aa71-1e976f35e6f4 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:44.664564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-610089b1-58eb-4a2a-aa71-1e976f35e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:44.678704 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610089b1-58eb-4a2a-aa71-1e976f35e6f4 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:44.683351 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:44.684245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:44.684529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:44.684802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] PATH_INFO: `/v3/projects/140dc067747a40b195b5cc891fa34547` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:44.685988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=140dc067747a40b195b5cc891fa34547)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:44.687922 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:44.696380 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:44.738263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140dc067747a40b195b5cc891fa34547', 'request_id': 'req-943ea996-a79f-4efb-a9d6-6dae4e43daaf'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.743804 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140dc067747a40b195b5cc891fa34547', 'request_id': 'req-943ea996-a79f-4efb-a9d6-6dae4e43daaf'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.751272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140dc067747a40b195b5cc891fa34547', 'request_id': 'req-943ea996-a79f-4efb-a9d6-6dae4e43daaf'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.763625 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] The token cache is being invalidate because project 140dc067747a40b195b5cc891fa34547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:41:44.763914 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.764566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.766168 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1255/2456] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:41:44 2022] DELETE /identity/v3/projects/140dc067747a40b195b5cc891fa34547 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:44.770241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a0302-7f20-4e1f-a916-56f91a2562d1 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:44.782843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a0302-7f20-4e1f-a916-56f91a2562d1 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:44.840028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3bbcd-e85f-4075-81d1-7bcd8d6da2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:44.840898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3bbcd-e85f-4075-81d1-7bcd8d6da2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:44.841187 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3bbcd-e85f-4075-81d1-7bcd8d6da2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:44.841458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3bbcd-e85f-4075-81d1-7bcd8d6da2ad admin admin] PATH_INFO: `/v3/users/fbb0e23639d9400db1771979cdddebe0` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:44.842654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3bbcd-e85f-4075-81d1-7bcd8d6da2ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb0e23639d9400db1771979cdddebe0)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:44.844625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3bbcd-e85f-4075-81d1-7bcd8d6da2ad admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:44.891604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-b5f3bbcd-e85f-4075-81d1-7bcd8d6da2ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb0e23639d9400db1771979cdddebe0'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.899139 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:44.905061 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-b5f3bbcd-e85f-4075-81d1-7bcd8d6da2ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb0e23639d9400db1771979cdddebe0'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.905903 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-b5f3bbcd-e85f-4075-81d1-7bcd8d6da2ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb0e23639d9400db1771979cdddebe0'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.913958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-b5f3bbcd-e85f-4075-81d1-7bcd8d6da2ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb0e23639d9400db1771979cdddebe0'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.914575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-b5f3bbcd-e85f-4075-81d1-7bcd8d6da2ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb0e23639d9400db1771979cdddebe0'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:44.926693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1202/2457] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:41:44 2022] DELETE /identity/v3/users/fbb0e23639d9400db1771979cdddebe0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:41:45.215550 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:45.217072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:45.230456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ea996-a79f-4efb-a9d6-6dae4e43daaf admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:45.287550 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f4020-54b3-4225-aaa8-3ceb9c84e724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:45.288330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f4020-54b3-4225-aaa8-3ceb9c84e724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:45.288610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f4020-54b3-4225-aaa8-3ceb9c84e724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:45.288883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f4020-54b3-4225-aaa8-3ceb9c84e724 admin admin] PATH_INFO: `/v3/projects/02fb79b010fe4eb5abb2db2e1b8ba1f9` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:45.290058 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f4020-54b3-4225-aaa8-3ceb9c84e724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02fb79b010fe4eb5abb2db2e1b8ba1f9)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:45.292011 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f4020-54b3-4225-aaa8-3ceb9c84e724 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:45.340654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a71f4020-54b3-4225-aaa8-3ceb9c84e724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02fb79b010fe4eb5abb2db2e1b8ba1f9', 'request_id': 'req-a71f4020-54b3-4225-aaa8-3ceb9c84e724'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:45.346154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a71f4020-54b3-4225-aaa8-3ceb9c84e724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02fb79b010fe4eb5abb2db2e1b8ba1f9', 'request_id': 'req-a71f4020-54b3-4225-aaa8-3ceb9c84e724'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:45.353415 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a71f4020-54b3-4225-aaa8-3ceb9c84e724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02fb79b010fe4eb5abb2db2e1b8ba1f9', 'request_id': 'req-a71f4020-54b3-4225-aaa8-3ceb9c84e724'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:45.365395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a71f4020-54b3-4225-aaa8-3ceb9c84e724 admin admin] The token cache is being invalidate because project 02fb79b010fe4eb5abb2db2e1b8ba1f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:41:45.365711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a71f4020-54b3-4225-aaa8-3ceb9c84e724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:45.366336 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a71f4020-54b3-4225-aaa8-3ceb9c84e724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:45.367980 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1256/2458] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:41:45 2022] DELETE /identity/v3/projects/02fb79b010fe4eb5abb2db2e1b8ba1f9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:45.373064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e6ca3-480e-4c1d-a544-be476da75d82 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:45.373535 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e6ca3-480e-4c1d-a544-be476da75d82 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:45.373642 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e6ca3-480e-4c1d-a544-be476da75d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:45.391365 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ee2e6ca3-480e-4c1d-a544-be476da75d82 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:45.392599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ee2e6ca3-480e-4c1d-a544-be476da75d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:45.454363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1203/2459] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:45.462631 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f26dd-d3da-4f18-bffd-ed4d2aca6167 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:45.463436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f26dd-d3da-4f18-bffd-ed4d2aca6167 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:45.463747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f26dd-d3da-4f18-bffd-ed4d2aca6167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:45.482995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-039f26dd-d3da-4f18-bffd-ed4d2aca6167 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:45.484238 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-039f26dd-d3da-4f18-bffd-ed4d2aca6167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:45.492458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1257/2460] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:45.501448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e6ca3-480e-4c1d-a544-be476da75d82 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:45.514350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e6ca3-480e-4c1d-a544-be476da75d82 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:45.519196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991714fa-6eb5-4d9f-ad24-78137e6cca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:45.519912 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991714fa-6eb5-4d9f-ad24-78137e6cca15 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:45.520198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991714fa-6eb5-4d9f-ad24-78137e6cca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:45.520503 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991714fa-6eb5-4d9f-ad24-78137e6cca15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:45.521248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991714fa-6eb5-4d9f-ad24-78137e6cca15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:41:45.521556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991714fa-6eb5-4d9f-ad24-78137e6cca15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:45.523213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991714fa-6eb5-4d9f-ad24-78137e6cca15 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:45.540872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1204/2461] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:41:45.548085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f26dd-d3da-4f18-bffd-ed4d2aca6167 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:45.557944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f26dd-d3da-4f18-bffd-ed4d2aca6167 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:45.562707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850756b-06c7-4104-9bc4-75550e4e017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:45.563365 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850756b-06c7-4104-9bc4-75550e4e017d admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:45.563684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850756b-06c7-4104-9bc4-75550e4e017d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:45.563958 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850756b-06c7-4104-9bc4-75550e4e017d admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:45.564657 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850756b-06c7-4104-9bc4-75550e4e017d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:45.566574 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850756b-06c7-4104-9bc4-75550e4e017d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:45.586380 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:45.599485 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991714fa-6eb5-4d9f-ad24-78137e6cca15 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:45.603575 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1258/2462] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:41:45 2022] POST /identity/v3/projects => generated 409 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:41:45.610234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991714fa-6eb5-4d9f-ad24-78137e6cca15 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:45.675589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd8ed4-7c2c-45bd-be3d-fb9458660dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:45.676345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd8ed4-7c2c-45bd-be3d-fb9458660dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:45.676636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd8ed4-7c2c-45bd-be3d-fb9458660dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:45.676905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd8ed4-7c2c-45bd-be3d-fb9458660dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:45.677602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd8ed4-7c2c-45bd-be3d-fb9458660dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:45.679588 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd8ed4-7c2c-45bd-be3d-fb9458660dd4 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:45.704946 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1205/2463] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:41:45 2022] POST /identity/v3/users => generated 305 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:41:45.706145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850756b-06c7-4104-9bc4-75550e4e017d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:45.717314 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850756b-06c7-4104-9bc4-75550e4e017d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:45.721897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6226a3a-5656-44f9-ad55-ab491570184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:45.722551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226a3a-5656-44f9-ad55-ab491570184a admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:45.722831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226a3a-5656-44f9-ad55-ab491570184a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:45.723103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6226a3a-5656-44f9-ad55-ab491570184a admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:45.723841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6226a3a-5656-44f9-ad55-ab491570184a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:45.725425 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6226a3a-5656-44f9-ad55-ab491570184a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:45.735809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1259/2464] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:41:45.739910 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd8ed4-7c2c-45bd-be3d-fb9458660dd4 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:45.750020 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd8ed4-7c2c-45bd-be3d-fb9458660dd4 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:45.755559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047553a9-ad19-4003-9b05-18ed6cc064f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:45.756228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047553a9-ad19-4003-9b05-18ed6cc064f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:45.756512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047553a9-ad19-4003-9b05-18ed6cc064f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:45.756790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047553a9-ad19-4003-9b05-18ed6cc064f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:45.757522 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047553a9-ad19-4003-9b05-18ed6cc064f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:45.759130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047553a9-ad19-4003-9b05-18ed6cc064f1 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:45.770144 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1206/2465] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:41:45.774591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6226a3a-5656-44f9-ad55-ab491570184a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:45.785301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6226a3a-5656-44f9-ad55-ab491570184a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:45.790134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8360cf-0df0-4ba6-987e-a4706ae74115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:45.793092 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8360cf-0df0-4ba6-987e-a4706ae74115 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:45.793092 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8360cf-0df0-4ba6-987e-a4706ae74115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:45.793092 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8360cf-0df0-4ba6-987e-a4706ae74115 admin admin] PATH_INFO: `/v3/projects/94bcbad42a394f56b7c862908fd19023/users/aa8dfcbbff8f47d08063f186a5abf020/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:45.806590 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8360cf-0df0-4ba6-987e-a4706ae74115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94bcbad42a394f56b7c862908fd19023, user_id=aa8dfcbbff8f47d08063f186a5abf020, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:45.809310 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8360cf-0df0-4ba6-987e-a4706ae74115 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:45.822235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1260/2466] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:41:45 2022] PUT /identity/v3/projects/94bcbad42a394f56b7c862908fd19023/users/aa8dfcbbff8f47d08063f186a5abf020/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:41:45.834659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194254bc-29f8-4020-b1f5-f71d2cfd50ff None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:45.835116 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194254bc-29f8-4020-b1f5-f71d2cfd50ff None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:45.835407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194254bc-29f8-4020-b1f5-f71d2cfd50ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:45.866123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-194254bc-29f8-4020-b1f5-f71d2cfd50ff None None] MFA Rules not processed for user `aa8dfcbbff8f47d08063f186a5abf020`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:45.867341 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-194254bc-29f8-4020-b1f5-f71d2cfd50ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:45.899248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:45.935404 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1207/2467] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:45.939944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8360cf-0df0-4ba6-987e-a4706ae74115 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:46.002707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8360cf-0df0-4ba6-987e-a4706ae74115 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:46.007666 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f374a-20fc-4229-b4d1-f6386cc24f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:46.008325 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f374a-20fc-4229-b4d1-f6386cc24f07 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:46.008606 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f374a-20fc-4229-b4d1-f6386cc24f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:46.008880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f374a-20fc-4229-b4d1-f6386cc24f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:46.009574 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f374a-20fc-4229-b4d1-f6386cc24f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:46.012174 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f374a-20fc-4229-b4d1-f6386cc24f07 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:46.042831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1261/2468] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:41:45 2022] POST /identity/v3/projects => generated 407 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:41:46.046860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194254bc-29f8-4020-b1f5-f71d2cfd50ff None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:46.057881 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194254bc-29f8-4020-b1f5-f71d2cfd50ff None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:46.113905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38103a55-a0db-493d-a57c-d1410503e7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:46.114599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38103a55-a0db-493d-a57c-d1410503e7cb admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:46.114886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38103a55-a0db-493d-a57c-d1410503e7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:46.115159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38103a55-a0db-493d-a57c-d1410503e7cb admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:46.115898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38103a55-a0db-493d-a57c-d1410503e7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:46.117811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38103a55-a0db-493d-a57c-d1410503e7cb admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:46.138859 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1208/2469] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:41:46 2022] POST /identity/v3/users => generated 310 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:41:46.142958 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f374a-20fc-4229-b4d1-f6386cc24f07 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:46.153533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f374a-20fc-4229-b4d1-f6386cc24f07 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:46.158142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea107f2-9fc8-4584-b43d-4b7c2cf3bc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:46.158803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea107f2-9fc8-4584-b43d-4b7c2cf3bc2a admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:46.159090 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea107f2-9fc8-4584-b43d-4b7c2cf3bc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:46.159371 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea107f2-9fc8-4584-b43d-4b7c2cf3bc2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:46.160215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea107f2-9fc8-4584-b43d-4b7c2cf3bc2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:46.161876 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea107f2-9fc8-4584-b43d-4b7c2cf3bc2a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:46.175696 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1262/2470] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:41:46.182923 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38103a55-a0db-493d-a57c-d1410503e7cb admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:46.194051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38103a55-a0db-493d-a57c-d1410503e7cb admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:46.199257 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebecef8-eff2-4fb5-997a-75237af16b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:46.200197 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebecef8-eff2-4fb5-997a-75237af16b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:46.200474 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebecef8-eff2-4fb5-997a-75237af16b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:46.200771 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebecef8-eff2-4fb5-997a-75237af16b46 admin admin] PATH_INFO: `/v3/projects/696e313a8d6042a9814542edae75e481/users/218cab9654b44de59d913e5d07c4a273/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:46.216209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebecef8-eff2-4fb5-997a-75237af16b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=696e313a8d6042a9814542edae75e481, user_id=218cab9654b44de59d913e5d07c4a273, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:46.218829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebecef8-eff2-4fb5-997a-75237af16b46 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:46.231492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1209/2471] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:41:46 2022] PUT /identity/v3/projects/696e313a8d6042a9814542edae75e481/users/218cab9654b44de59d913e5d07c4a273/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:41:46.235559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea107f2-9fc8-4584-b43d-4b7c2cf3bc2a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:46.246014 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea107f2-9fc8-4584-b43d-4b7c2cf3bc2a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:46.302072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba77320-92dc-4fe7-a998-f7d9a8d9841a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:46.302651 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba77320-92dc-4fe7-a998-f7d9a8d9841a admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:46.302933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba77320-92dc-4fe7-a998-f7d9a8d9841a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:46.303205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba77320-92dc-4fe7-a998-f7d9a8d9841a admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:46.303958 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba77320-92dc-4fe7-a998-f7d9a8d9841a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:46.305544 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba77320-92dc-4fe7-a998-f7d9a8d9841a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:46.315725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1263/2472] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:41:46.320079 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebecef8-eff2-4fb5-997a-75237af16b46 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:46.330147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebecef8-eff2-4fb5-997a-75237af16b46 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:46.334782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26259dd-c783-4e58-bd77-6a0d4e1cb1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:46.335686 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26259dd-c783-4e58-bd77-6a0d4e1cb1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:46.335965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26259dd-c783-4e58-bd77-6a0d4e1cb1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:46.336234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26259dd-c783-4e58-bd77-6a0d4e1cb1f2 admin admin] PATH_INFO: `/v3/projects/696e313a8d6042a9814542edae75e481/users/218cab9654b44de59d913e5d07c4a273/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:46.338179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26259dd-c783-4e58-bd77-6a0d4e1cb1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=696e313a8d6042a9814542edae75e481, user_id=218cab9654b44de59d913e5d07c4a273, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:46.340848 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26259dd-c783-4e58-bd77-6a0d4e1cb1f2 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:46.351439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1210/2473] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:41:46 2022] PUT /identity/v3/projects/696e313a8d6042a9814542edae75e481/users/218cab9654b44de59d913e5d07c4a273/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:46.362271 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869b69b-af6f-4ae0-b890-62d4fce8eb44 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:46.362613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869b69b-af6f-4ae0-b890-62d4fce8eb44 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:46.362916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869b69b-af6f-4ae0-b890-62d4fce8eb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:46.390318 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f869b69b-af6f-4ae0-b890-62d4fce8eb44 None None] MFA Rules not processed for user `218cab9654b44de59d913e5d07c4a273`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:46.391611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f869b69b-af6f-4ae0-b890-62d4fce8eb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:46.411586 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:46.464282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1264/2474] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:46.475372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26259dd-c783-4e58-bd77-6a0d4e1cb1f2 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:46.477220 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f26259dd-c783-4e58-bd77-6a0d4e1cb1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:46.539459 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26259dd-c783-4e58-bd77-6a0d4e1cb1f2 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:46.544344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc998b-a647-42ca-9e65-5c12c78ca7f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:46.545178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc998b-a647-42ca-9e65-5c12c78ca7f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:46.545290 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc998b-a647-42ca-9e65-5c12c78ca7f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:46.545529 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc998b-a647-42ca-9e65-5c12c78ca7f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:46.555384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc998b-a647-42ca-9e65-5c12c78ca7f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:46.557558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc998b-a647-42ca-9e65-5c12c78ca7f6 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:46.567896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1211/2475] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:46 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:41:46.716646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869b69b-af6f-4ae0-b890-62d4fce8eb44 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:46.726248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869b69b-af6f-4ae0-b890-62d4fce8eb44 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:46.729813 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9d646-e8fe-415a-a6f4-2efb9c137b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:46.730448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9d646-e8fe-415a-a6f4-2efb9c137b1a service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:46.730727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9d646-e8fe-415a-a6f4-2efb9c137b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:46.730999 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9d646-e8fe-415a-a6f4-2efb9c137b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:46.790277 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9d646-e8fe-415a-a6f4-2efb9c137b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:46.791934 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9d646-e8fe-415a-a6f4-2efb9c137b1a service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:46.804074 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1265/2476] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:46 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:41:52.072185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc998b-a647-42ca-9e65-5c12c78ca7f6 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:52.106721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:52.142057 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc998b-a647-42ca-9e65-5c12c78ca7f6 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:52.147581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271bc71-5d40-4db0-a5fd-28bac2465ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:52.148465 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271bc71-5d40-4db0-a5fd-28bac2465ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:52.148746 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271bc71-5d40-4db0-a5fd-28bac2465ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:52.149020 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271bc71-5d40-4db0-a5fd-28bac2465ef4 admin admin] PATH_INFO: `/v3/users/aa8dfcbbff8f47d08063f186a5abf020` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:52.150236 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271bc71-5d40-4db0-a5fd-28bac2465ef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa8dfcbbff8f47d08063f186a5abf020)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:52.152782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271bc71-5d40-4db0-a5fd-28bac2465ef4 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:52.202758 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6271bc71-5d40-4db0-a5fd-28bac2465ef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa8dfcbbff8f47d08063f186a5abf020'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:52.216775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6271bc71-5d40-4db0-a5fd-28bac2465ef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa8dfcbbff8f47d08063f186a5abf020'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:52.217634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6271bc71-5d40-4db0-a5fd-28bac2465ef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa8dfcbbff8f47d08063f186a5abf020'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:52.225176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6271bc71-5d40-4db0-a5fd-28bac2465ef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa8dfcbbff8f47d08063f186a5abf020'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:52.225862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6271bc71-5d40-4db0-a5fd-28bac2465ef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa8dfcbbff8f47d08063f186a5abf020'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:52.240850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1212/2477] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:41:52 2022] DELETE /identity/v3/users/aa8dfcbbff8f47d08063f186a5abf020 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:41:52.245536 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d9802-8e6f-4e00-9c3f-4158e1751e99 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:52.246028 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d9802-8e6f-4e00-9c3f-4158e1751e99 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:52.246143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d9802-8e6f-4e00-9c3f-4158e1751e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:52.264751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-894d9802-8e6f-4e00-9c3f-4158e1751e99 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:52.265950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-894d9802-8e6f-4e00-9c3f-4158e1751e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:52.329968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1266/2478] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:41:52.340051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271bc71-5d40-4db0-a5fd-28bac2465ef4 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:52.341455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6271bc71-5d40-4db0-a5fd-28bac2465ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:52.405274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271bc71-5d40-4db0-a5fd-28bac2465ef4 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:52.408945 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2769aa0-0b5b-4d1b-9210-d17bf9c8d1b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:52.409621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2769aa0-0b5b-4d1b-9210-d17bf9c8d1b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:52.409901 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2769aa0-0b5b-4d1b-9210-d17bf9c8d1b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:52.410181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2769aa0-0b5b-4d1b-9210-d17bf9c8d1b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:52.420134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2769aa0-0b5b-4d1b-9210-d17bf9c8d1b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:52.422880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2769aa0-0b5b-4d1b-9210-d17bf9c8d1b2 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:52.432936 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1213/2479] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:41:52.738834 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d9802-8e6f-4e00-9c3f-4158e1751e99 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:52.740405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-894d9802-8e6f-4e00-9c3f-4158e1751e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:52.757011 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d9802-8e6f-4e00-9c3f-4158e1751e99 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:52.762576 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:52.763446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:52.763690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:52.763957 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] PATH_INFO: `/v3/projects/94bcbad42a394f56b7c862908fd19023` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:52.765204 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=94bcbad42a394f56b7c862908fd19023)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:52.767107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:52.818854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94bcbad42a394f56b7c862908fd19023', 'request_id': 'req-334facc4-de57-4845-9e16-8b27ec2dbe0b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:52.821750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:52.828214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94bcbad42a394f56b7c862908fd19023', 'request_id': 'req-334facc4-de57-4845-9e16-8b27ec2dbe0b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:52.836646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94bcbad42a394f56b7c862908fd19023', 'request_id': 'req-334facc4-de57-4845-9e16-8b27ec2dbe0b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:52.848395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] The token cache is being invalidate because project 94bcbad42a394f56b7c862908fd19023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:41:52.848684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:52.849335 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:52.850897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1267/2480] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:41:52 2022] DELETE /identity/v3/projects/94bcbad42a394f56b7c862908fd19023 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:52.860409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2769aa0-0b5b-4d1b-9210-d17bf9c8d1b2 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:52.871279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2769aa0-0b5b-4d1b-9210-d17bf9c8d1b2 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:52.916679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:52.930162 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810df298-e3bb-4235-8f41-6a63c232175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:52.931033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810df298-e3bb-4235-8f41-6a63c232175d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:52.931322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810df298-e3bb-4235-8f41-6a63c232175d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:52.931631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810df298-e3bb-4235-8f41-6a63c232175d admin admin] PATH_INFO: `/v3/users/218cab9654b44de59d913e5d07c4a273` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:52.933373 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810df298-e3bb-4235-8f41-6a63c232175d admin admin] RBAC: Authorizing `identity:delete_user(user_id=218cab9654b44de59d913e5d07c4a273)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:52.935428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810df298-e3bb-4235-8f41-6a63c232175d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:52.984121 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-810df298-e3bb-4235-8f41-6a63c232175d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218cab9654b44de59d913e5d07c4a273'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:52.996268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-810df298-e3bb-4235-8f41-6a63c232175d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218cab9654b44de59d913e5d07c4a273'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:52.996947 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-810df298-e3bb-4235-8f41-6a63c232175d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218cab9654b44de59d913e5d07c4a273'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:53.005613 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-810df298-e3bb-4235-8f41-6a63c232175d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218cab9654b44de59d913e5d07c4a273'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:53.006248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-810df298-e3bb-4235-8f41-6a63c232175d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218cab9654b44de59d913e5d07c4a273'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:53.018961 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1214/2481] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:41:52 2022] DELETE /identity/v3/users/218cab9654b44de59d913e5d07c4a273 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:53.319924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:53.321412 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:53.335972 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334facc4-de57-4845-9e16-8b27ec2dbe0b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:53.407303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5824a6-7c8b-4d96-b217-0f18150932ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:53.408100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5824a6-7c8b-4d96-b217-0f18150932ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:53.408503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5824a6-7c8b-4d96-b217-0f18150932ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:53.408672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5824a6-7c8b-4d96-b217-0f18150932ce admin admin] PATH_INFO: `/v3/projects/696e313a8d6042a9814542edae75e481` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:53.409868 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5824a6-7c8b-4d96-b217-0f18150932ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=696e313a8d6042a9814542edae75e481)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:53.411855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5824a6-7c8b-4d96-b217-0f18150932ce admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:53.460378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ee5824a6-7c8b-4d96-b217-0f18150932ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '696e313a8d6042a9814542edae75e481', 'request_id': 'req-ee5824a6-7c8b-4d96-b217-0f18150932ce'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:53.467440 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ee5824a6-7c8b-4d96-b217-0f18150932ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '696e313a8d6042a9814542edae75e481', 'request_id': 'req-ee5824a6-7c8b-4d96-b217-0f18150932ce'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:53.476553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ee5824a6-7c8b-4d96-b217-0f18150932ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '696e313a8d6042a9814542edae75e481', 'request_id': 'req-ee5824a6-7c8b-4d96-b217-0f18150932ce'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:53.489904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ee5824a6-7c8b-4d96-b217-0f18150932ce admin admin] The token cache is being invalidate because project 696e313a8d6042a9814542edae75e481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:41:53.490209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ee5824a6-7c8b-4d96-b217-0f18150932ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:53.490854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ee5824a6-7c8b-4d96-b217-0f18150932ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:41:53.492439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1268/2482] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:41:53 2022] DELETE /identity/v3/projects/696e313a8d6042a9814542edae75e481 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:53.497334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81192d45-5261-4024-a73b-46c58f009f33 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:53.498160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81192d45-5261-4024-a73b-46c58f009f33 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:53.498160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81192d45-5261-4024-a73b-46c58f009f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:53.516018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-81192d45-5261-4024-a73b-46c58f009f33 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:53.517226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-81192d45-5261-4024-a73b-46c58f009f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:53.576002 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1215/2483] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:53.583983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d4293-f099-42f8-9a64-1cdde9a243f5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:53.584267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d4293-f099-42f8-9a64-1cdde9a243f5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:53.584542 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d4293-f099-42f8-9a64-1cdde9a243f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:53.604313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-151d4293-f099-42f8-9a64-1cdde9a243f5 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:53.606036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-151d4293-f099-42f8-9a64-1cdde9a243f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:53.613896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1269/2484] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:53.618025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81192d45-5261-4024-a73b-46c58f009f33 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:53.627813 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81192d45-5261-4024-a73b-46c58f009f33 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:53.632797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca116f-ba2b-436c-a402-3b04df3d6842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:53.633451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca116f-ba2b-436c-a402-3b04df3d6842 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:53.633735 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca116f-ba2b-436c-a402-3b04df3d6842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:53.634012 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca116f-ba2b-436c-a402-3b04df3d6842 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:53.634742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca116f-ba2b-436c-a402-3b04df3d6842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:41:53.635050 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca116f-ba2b-436c-a402-3b04df3d6842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:53.636751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca116f-ba2b-436c-a402-3b04df3d6842 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:53.648225 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1216/2485] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:41:53.652938 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d4293-f099-42f8-9a64-1cdde9a243f5 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:53.664533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d4293-f099-42f8-9a64-1cdde9a243f5 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:53.669891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12f02f-309b-4f4b-a9dc-f2502597fb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:53.670544 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f02f-309b-4f4b-a9dc-f2502597fb66 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:53.670824 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f02f-309b-4f4b-a9dc-f2502597fb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:53.671127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f02f-309b-4f4b-a9dc-f2502597fb66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:53.671851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12f02f-309b-4f4b-a9dc-f2502597fb66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:53.673769 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12f02f-309b-4f4b-a9dc-f2502597fb66 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:53.702829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1270/2486] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:41:53 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:41:53.704113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca116f-ba2b-436c-a402-3b04df3d6842 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:53.714656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca116f-ba2b-436c-a402-3b04df3d6842 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:53.764872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:53.773284 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba96833-2145-44c8-ac81-99aaf12a2658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:53.774568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba96833-2145-44c8-ac81-99aaf12a2658 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:53.775001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba96833-2145-44c8-ac81-99aaf12a2658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:53.775352 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba96833-2145-44c8-ac81-99aaf12a2658 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:53.777222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba96833-2145-44c8-ac81-99aaf12a2658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:53.779664 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba96833-2145-44c8-ac81-99aaf12a2658 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:53.799779 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1217/2487] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:41:53 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:41:53.803925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12f02f-309b-4f4b-a9dc-f2502597fb66 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:53.814132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12f02f-309b-4f4b-a9dc-f2502597fb66 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:53.819318 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d8eb3-3edb-45eb-aa3e-6d9d8d642fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:53.820012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d8eb3-3edb-45eb-aa3e-6d9d8d642fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:53.820306 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d8eb3-3edb-45eb-aa3e-6d9d8d642fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:53.820565 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d8eb3-3edb-45eb-aa3e-6d9d8d642fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:53.821287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d8eb3-3edb-45eb-aa3e-6d9d8d642fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:53.823406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d8eb3-3edb-45eb-aa3e-6d9d8d642fc2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:53.834703 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1271/2488] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:41:53.838497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba96833-2145-44c8-ac81-99aaf12a2658 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:53.849187 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba96833-2145-44c8-ac81-99aaf12a2658 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:53.853741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beac01b-59bf-4a46-82a1-7b546728157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:53.854498 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beac01b-59bf-4a46-82a1-7b546728157c admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:53.854782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beac01b-59bf-4a46-82a1-7b546728157c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:53.855136 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beac01b-59bf-4a46-82a1-7b546728157c admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:53.855897 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beac01b-59bf-4a46-82a1-7b546728157c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:53.857490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beac01b-59bf-4a46-82a1-7b546728157c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:53.867366 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1218/2489] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:41:53.871405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d8eb3-3edb-45eb-aa3e-6d9d8d642fc2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:53.881664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d8eb3-3edb-45eb-aa3e-6d9d8d642fc2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:53.886930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d08449-8040-4c3c-a968-0763558413bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:53.887913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d08449-8040-4c3c-a968-0763558413bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:53.888208 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d08449-8040-4c3c-a968-0763558413bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:53.888480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d08449-8040-4c3c-a968-0763558413bd admin admin] PATH_INFO: `/v3/projects/a26bea35c9944818818a26284516ee52/users/9e53539fa3a04775a231969d1a6fe848/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:53.903515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d08449-8040-4c3c-a968-0763558413bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26bea35c9944818818a26284516ee52, user_id=9e53539fa3a04775a231969d1a6fe848, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:53.906159 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d08449-8040-4c3c-a968-0763558413bd admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:53.918882 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1272/2490] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:41:53 2022] PUT /identity/v3/projects/a26bea35c9944818818a26284516ee52/users/9e53539fa3a04775a231969d1a6fe848/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:41:53.924064 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d82988-2797-4a71-8e5e-e157c8b577ed None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:53.924364 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d82988-2797-4a71-8e5e-e157c8b577ed None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:53.924654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d82988-2797-4a71-8e5e-e157c8b577ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:53.942167 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-42d82988-2797-4a71-8e5e-e157c8b577ed None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:53.943373 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-42d82988-2797-4a71-8e5e-e157c8b577ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:54.001288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1219/2491] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:54.011775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d08449-8040-4c3c-a968-0763558413bd admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:54.013484 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c3d08449-8040-4c3c-a968-0763558413bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:54.023278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:41:54.071101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d08449-8040-4c3c-a968-0763558413bd admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:54.075301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811a9d5-cbe4-4a53-af80-58b3c76182d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:54.075975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811a9d5-cbe4-4a53-af80-58b3c76182d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:54.076256 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811a9d5-cbe4-4a53-af80-58b3c76182d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:54.076532 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811a9d5-cbe4-4a53-af80-58b3c76182d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:54.085618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811a9d5-cbe4-4a53-af80-58b3c76182d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:54.087035 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811a9d5-cbe4-4a53-af80-58b3c76182d2 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:54.096966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1273/2492] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:41:54.733790 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19c38a-dda6-4199-a4ca-96720426afc4 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:54.734309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19c38a-dda6-4199-a4ca-96720426afc4 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:54.734309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19c38a-dda6-4199-a4ca-96720426afc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:54.761735 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-7f19c38a-dda6-4199-a4ca-96720426afc4 None None] MFA Rules not processed for user `9e53539fa3a04775a231969d1a6fe848`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:54.762944 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7f19c38a-dda6-4199-a4ca-96720426afc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:54.832294 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1220/2493] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:41:54.844919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811a9d5-cbe4-4a53-af80-58b3c76182d2 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:41:54.846551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e811a9d5-cbe4-4a53-af80-58b3c76182d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:54.912396 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811a9d5-cbe4-4a53-af80-58b3c76182d2 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:41:54.916245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f989c-5e12-4bec-a880-aa0575389629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:41:54.917486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f989c-5e12-4bec-a880-aa0575389629 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:54.917792 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f989c-5e12-4bec-a880-aa0575389629 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:54.918044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f989c-5e12-4bec-a880-aa0575389629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:54.927713 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f989c-5e12-4bec-a880-aa0575389629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:41:54.929161 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f989c-5e12-4bec-a880-aa0575389629 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:41:54.938768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1274/2494] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:41:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:41:56.292408 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423e32c-7891-4ffa-9457-37b7b01145db None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:41:56.292934 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423e32c-7891-4ffa-9457-37b7b01145db None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:41:56.293034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423e32c-7891-4ffa-9457-37b7b01145db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:41:56.310412 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-4423e32c-7891-4ffa-9457-37b7b01145db None None] MFA Rules not processed for user `9e53539fa3a04775a231969d1a6fe848`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:41:56.311666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4423e32c-7891-4ffa-9457-37b7b01145db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:41:56.318526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1221/2495] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:41:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:42:04.934374 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=49 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:06.305143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:12.998946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a490add-b688-441c-bfa6-e1294840ae10 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:12.999434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a490add-b688-441c-bfa6-e1294840ae10 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:12.999561 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a490add-b688-441c-bfa6-e1294840ae10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:13.017939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1a490add-b688-441c-bfa6-e1294840ae10 None None] MFA Rules not processed for user `9e53539fa3a04775a231969d1a6fe848`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:42:13.019144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1a490add-b688-441c-bfa6-e1294840ae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:42:13.026638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1275/2496] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:42:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:42:23.012808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:32.811024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcbabc-6d1b-4f9e-bc78-0566d33e0d98 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:32.811491 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcbabc-6d1b-4f9e-bc78-0566d33e0d98 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:32.811491 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcbabc-6d1b-4f9e-bc78-0566d33e0d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:32.830188 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-1bdcbabc-6d1b-4f9e-bc78-0566d33e0d98 None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:42:32.831429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1bdcbabc-6d1b-4f9e-bc78-0566d33e0d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:42:32.896045 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1222/2497] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:42:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:42:32.921242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56135e5-1425-4ccb-9c27-335dd1ab82f1 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:32.921770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56135e5-1425-4ccb-9c27-335dd1ab82f1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:32.921884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56135e5-1425-4ccb-9c27-335dd1ab82f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:32.941834 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-f56135e5-1425-4ccb-9c27-335dd1ab82f1 None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:42:32.943183 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f56135e5-1425-4ccb-9c27-335dd1ab82f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:42:32.951328 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcbabc-6d1b-4f9e-bc78-0566d33e0d98 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:42:32.952912 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1bdcbabc-6d1b-4f9e-bc78-0566d33e0d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:42:32.954660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1276/2498] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:42:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:42:32.967502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56135e5-1425-4ccb-9c27-335dd1ab82f1 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:42:32.968897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-f56135e5-1425-4ccb-9c27-335dd1ab82f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:42:33.033549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcbabc-6d1b-4f9e-bc78-0566d33e0d98 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:42:33.038785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a378b3-1569-478b-bc97-72a0c676ffc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:42:33.039490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a378b3-1569-478b-bc97-72a0c676ffc6 service swift] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:33.039796 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a378b3-1569-478b-bc97-72a0c676ffc6 service swift] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:33.040072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a378b3-1569-478b-bc97-72a0c676ffc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:33.046644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56135e5-1425-4ccb-9c27-335dd1ab82f1 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:42:33.050250 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a378b3-1569-478b-bc97-72a0c676ffc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:42:33.052645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a378b3-1569-478b-bc97-72a0c676ffc6 service swift] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:42:33.056569 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e6cdd-3082-43de-ae50-153fce1800e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:42:33.057947 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6cdd-3082-43de-ae50-153fce1800e7 service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:33.058282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6cdd-3082-43de-ae50-153fce1800e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:33.058797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e6cdd-3082-43de-ae50-153fce1800e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:33.064127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1223/2499] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:42:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 10:42:33.071181 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e6cdd-3082-43de-ae50-153fce1800e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:42:33.072827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e6cdd-3082-43de-ae50-153fce1800e7 service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:42:33.082244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1277/2500] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:42:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 10:42:43.064223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=57 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:43.078519 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=35 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:49.922497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df6a15-18af-4358-952d-b1145d7721fa None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:49.923266 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df6a15-18af-4358-952d-b1145d7721fa None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:49.923630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df6a15-18af-4358-952d-b1145d7721fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:49.942596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-89df6a15-18af-4358-952d-b1145d7721fa None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:42:49.943843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-89df6a15-18af-4358-952d-b1145d7721fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:42:49.952752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1224/2501] 10.222.0.50 () {58 vars in 967 bytes} [Wed Jun 15 10:42:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:42:49.966397 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e6cdd-3082-43de-ae50-153fce1800e7 service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:42:49.978297 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e6cdd-3082-43de-ae50-153fce1800e7 service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:42:49.984916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f44d58-bdc5-48a6-887c-e7a5128bb911 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:42:49.985569 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f44d58-bdc5-48a6-887c-e7a5128bb911 service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:49.985852 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f44d58-bdc5-48a6-887c-e7a5128bb911 service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:49.986128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f44d58-bdc5-48a6-887c-e7a5128bb911 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:49.995458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f44d58-bdc5-48a6-887c-e7a5128bb911 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:42:49.997352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f44d58-bdc5-48a6-887c-e7a5128bb911 service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:42:50.008301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1278/2502] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:42:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 10:42:52.079226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df6a15-18af-4358-952d-b1145d7721fa None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:42:52.093865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df6a15-18af-4358-952d-b1145d7721fa None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:42:52.096525 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398298f8-6323-41af-93c0-869bc00f8d9e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:52.097037 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398298f8-6323-41af-93c0-869bc00f8d9e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:52.097162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398298f8-6323-41af-93c0-869bc00f8d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:52.100757 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c9ca9-4a40-459f-81c1-bd905089d1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:42:52.102073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c9ca9-4a40-459f-81c1-bd905089d1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:52.102674 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c9ca9-4a40-459f-81c1-bd905089d1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:52.103149 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c9ca9-4a40-459f-81c1-bd905089d1ec admin admin] PATH_INFO: `/v3/users/9e53539fa3a04775a231969d1a6fe848` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:52.104761 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c9ca9-4a40-459f-81c1-bd905089d1ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e53539fa3a04775a231969d1a6fe848)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:42:52.107046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c9ca9-4a40-459f-81c1-bd905089d1ec admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:42:52.118809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-398298f8-6323-41af-93c0-869bc00f8d9e None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:42:52.120234 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-398298f8-6323-41af-93c0-869bc00f8d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:42:52.128328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1279/2503] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Jun 15 10:42:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:42:52.141762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398298f8-6323-41af-93c0-869bc00f8d9e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:42:52.155338 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398298f8-6323-41af-93c0-869bc00f8d9e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:42:52.160484 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e548-13d1-4b7e-a814-e5e14fba10a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:42:52.161135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e548-13d1-4b7e-a814-e5e14fba10a5 service swift] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:52.161422 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e548-13d1-4b7e-a814-e5e14fba10a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:52.161700 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4e548-13d1-4b7e-a814-e5e14fba10a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:52.167131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-b87c9ca9-4a40-459f-81c1-bd905089d1ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e53539fa3a04775a231969d1a6fe848'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:42:52.170713 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4e548-13d1-4b7e-a814-e5e14fba10a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:42:52.172430 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4e548-13d1-4b7e-a814-e5e14fba10a5 service swift] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:42:52.179750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-b87c9ca9-4a40-459f-81c1-bd905089d1ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e53539fa3a04775a231969d1a6fe848'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:42:52.180489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-b87c9ca9-4a40-459f-81c1-bd905089d1ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e53539fa3a04775a231969d1a6fe848'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:42:52.181214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1280/2504] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:42:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 10:42:52.191440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-b87c9ca9-4a40-459f-81c1-bd905089d1ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e53539fa3a04775a231969d1a6fe848'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:42:52.192887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-b87c9ca9-4a40-459f-81c1-bd905089d1ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e53539fa3a04775a231969d1a6fe848'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:42:52.208800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1225/2505] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:42:52 2022] DELETE /identity/v3/users/9e53539fa3a04775a231969d1a6fe848 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:42:52.581049 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e548-13d1-4b7e-a814-e5e14fba10a5 service swift] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:42:52.593889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4e548-13d1-4b7e-a814-e5e14fba10a5 service swift] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:42:52.712779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:42:52.713967 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:52.714415 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:52.715677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042 admin admin] PATH_INFO: `/v3/projects/a26bea35c9944818818a26284516ee52` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:52.717422 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26bea35c9944818818a26284516ee52)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:42:52.720174 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:42:52.772871 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26bea35c9944818818a26284516ee52', 'request_id': 'req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:42:52.779278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26bea35c9944818818a26284516ee52', 'request_id': 'req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:42:52.788990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26bea35c9944818818a26284516ee52', 'request_id': 'req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:42:52.801040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042 admin admin] The token cache is being invalidate because project a26bea35c9944818818a26284516ee52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:42:52.801332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:42:52.801966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2bf36ccc-f777-4aa3-ab42-9bb0c6a60042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:42:52.803538 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1281/2506] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:42:52 2022] DELETE /identity/v3/projects/a26bea35c9944818818a26284516ee52 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:42:52.808963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64345b-e0fd-4afa-a7f6-7ebbcdf8e331 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:52.809256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64345b-e0fd-4afa-a7f6-7ebbcdf8e331 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:52.809534 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64345b-e0fd-4afa-a7f6-7ebbcdf8e331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:52.829486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-7a64345b-e0fd-4afa-a7f6-7ebbcdf8e331 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:42:52.830723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7a64345b-e0fd-4afa-a7f6-7ebbcdf8e331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:42:52.896251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1226/2507] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:42:52.904114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f8f68-152c-431f-9d5c-4583f41b292e None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:52.904458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f8f68-152c-431f-9d5c-4583f41b292e None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:52.904791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f8f68-152c-431f-9d5c-4583f41b292e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:52.925211 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2e1f8f68-152c-431f-9d5c-4583f41b292e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:42:52.926428 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2e1f8f68-152c-431f-9d5c-4583f41b292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:42:52.934891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1282/2508] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:42:52.939227 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64345b-e0fd-4afa-a7f6-7ebbcdf8e331 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:42:52.949773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64345b-e0fd-4afa-a7f6-7ebbcdf8e331 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:42:52.954797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53e0f8-fe72-4d81-b014-80cb3f94c476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:42:52.955520 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53e0f8-fe72-4d81-b014-80cb3f94c476 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:52.955826 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53e0f8-fe72-4d81-b014-80cb3f94c476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:52.956163 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53e0f8-fe72-4d81-b014-80cb3f94c476 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:52.956867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53e0f8-fe72-4d81-b014-80cb3f94c476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:42:52.957434 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53e0f8-fe72-4d81-b014-80cb3f94c476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:42:52.958836 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53e0f8-fe72-4d81-b014-80cb3f94c476 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:42:52.977639 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1227/2509] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:42:52.982621 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f8f68-152c-431f-9d5c-4583f41b292e None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:42:52.992472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f8f68-152c-431f-9d5c-4583f41b292e None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:42:52.997913 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dd902-adec-4134-ab43-45c440c9f685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:42:52.998709 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dd902-adec-4134-ab43-45c440c9f685 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:52.999190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dd902-adec-4134-ab43-45c440c9f685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:52.999620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dd902-adec-4134-ab43-45c440c9f685 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:53.000680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6dd902-adec-4134-ab43-45c440c9f685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:42:53.002683 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6dd902-adec-4134-ab43-45c440c9f685 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:42:53.034154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1283/2510] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:42:52 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:42:53.035281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53e0f8-fe72-4d81-b014-80cb3f94c476 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:42:53.046428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53e0f8-fe72-4d81-b014-80cb3f94c476 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:42:53.094603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:53.104653 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e5aca-2a3e-4f42-8fd6-a6c72cd457af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:42:53.106271 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e5aca-2a3e-4f42-8fd6-a6c72cd457af admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:53.106591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e5aca-2a3e-4f42-8fd6-a6c72cd457af admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:53.106868 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e5aca-2a3e-4f42-8fd6-a6c72cd457af admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:53.107652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e5aca-2a3e-4f42-8fd6-a6c72cd457af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:42:53.109650 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e5aca-2a3e-4f42-8fd6-a6c72cd457af admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:42:53.131995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1228/2511] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:42:53 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:42:53.137235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dd902-adec-4134-ab43-45c440c9f685 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:42:53.150331 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dd902-adec-4134-ab43-45c440c9f685 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:42:53.155111 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284ca49-8d8e-445a-976c-37c8efd21816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:42:53.155819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284ca49-8d8e-445a-976c-37c8efd21816 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:53.156107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284ca49-8d8e-445a-976c-37c8efd21816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:53.156548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284ca49-8d8e-445a-976c-37c8efd21816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:53.157287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284ca49-8d8e-445a-976c-37c8efd21816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:42:53.158910 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284ca49-8d8e-445a-976c-37c8efd21816 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:42:53.172883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1284/2512] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:42:53.177453 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e5aca-2a3e-4f42-8fd6-a6c72cd457af admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:42:53.193334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e5aca-2a3e-4f42-8fd6-a6c72cd457af admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:42:53.198076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c1cab-dd6f-4043-9f62-827537f14ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:42:53.198758 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c1cab-dd6f-4043-9f62-827537f14ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:53.199076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c1cab-dd6f-4043-9f62-827537f14ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:53.199353 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c1cab-dd6f-4043-9f62-827537f14ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:53.200131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c1cab-dd6f-4043-9f62-827537f14ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:42:53.201870 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c1cab-dd6f-4043-9f62-827537f14ea9 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:42:53.224303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1229/2513] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:42:53.225656 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284ca49-8d8e-445a-976c-37c8efd21816 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:42:53.237291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284ca49-8d8e-445a-976c-37c8efd21816 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:42:53.242661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58d27c-23b2-4841-9da5-fde61f5ba7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:42:53.243644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58d27c-23b2-4841-9da5-fde61f5ba7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:53.243889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58d27c-23b2-4841-9da5-fde61f5ba7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:53.244192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58d27c-23b2-4841-9da5-fde61f5ba7a1 admin admin] PATH_INFO: `/v3/projects/9eb9793422a8485fb12fa7b0b91d5d1a/users/12028b3cb70f4c99b3a5484acc76c1e7/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:53.264601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58d27c-23b2-4841-9da5-fde61f5ba7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb9793422a8485fb12fa7b0b91d5d1a, user_id=12028b3cb70f4c99b3a5484acc76c1e7, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:42:53.267578 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58d27c-23b2-4841-9da5-fde61f5ba7a1 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:42:53.270352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:42:53.285021 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1285/2514] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:42:53 2022] PUT /identity/v3/projects/9eb9793422a8485fb12fa7b0b91d5d1a/users/12028b3cb70f4c99b3a5484acc76c1e7/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:42:53.296212 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357cd93-d88f-4097-b607-5f1fe5370394 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:53.296542 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357cd93-d88f-4097-b607-5f1fe5370394 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:53.296775 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357cd93-d88f-4097-b607-5f1fe5370394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:53.323142 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-f357cd93-d88f-4097-b607-5f1fe5370394 None None] MFA Rules not processed for user `12028b3cb70f4c99b3a5484acc76c1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:42:53.324406 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f357cd93-d88f-4097-b607-5f1fe5370394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:42:53.393777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1230/2515] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:42:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:42:53.405315 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58d27c-23b2-4841-9da5-fde61f5ba7a1 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:42:53.406966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cf58d27c-23b2-4841-9da5-fde61f5ba7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:42:53.464158 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58d27c-23b2-4841-9da5-fde61f5ba7a1 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:42:53.468599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fc20e-9634-422b-bef7-3e4ac3369ec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:42:53.469251 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fc20e-9634-422b-bef7-3e4ac3369ec6 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:42:53.469530 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fc20e-9634-422b-bef7-3e4ac3369ec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:42:53.469799 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fc20e-9634-422b-bef7-3e4ac3369ec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:42:53.479202 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fc20e-9634-422b-bef7-3e4ac3369ec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:42:53.481376 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fc20e-9634-422b-bef7-3e4ac3369ec6 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:42:53.492747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1286/2516] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:42:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:03.390076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:03.488095 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:03.929353 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357cd93-d88f-4097-b607-5f1fe5370394 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:03.992147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357cd93-d88f-4097-b607-5f1fe5370394 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:03.996689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc279140-312f-41eb-be66-a6df69b33dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:03.997568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc279140-312f-41eb-be66-a6df69b33dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:03.997857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc279140-312f-41eb-be66-a6df69b33dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:03.998132 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc279140-312f-41eb-be66-a6df69b33dda admin admin] PATH_INFO: `/v3/users/12028b3cb70f4c99b3a5484acc76c1e7` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:03.999338 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc279140-312f-41eb-be66-a6df69b33dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=12028b3cb70f4c99b3a5484acc76c1e7)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:04.001327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc279140-312f-41eb-be66-a6df69b33dda admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:04.047121 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-cc279140-312f-41eb-be66-a6df69b33dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12028b3cb70f4c99b3a5484acc76c1e7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:04.059308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-cc279140-312f-41eb-be66-a6df69b33dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12028b3cb70f4c99b3a5484acc76c1e7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:04.060019 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-cc279140-312f-41eb-be66-a6df69b33dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12028b3cb70f4c99b3a5484acc76c1e7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:04.067433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-cc279140-312f-41eb-be66-a6df69b33dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12028b3cb70f4c99b3a5484acc76c1e7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:04.068199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-cc279140-312f-41eb-be66-a6df69b33dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12028b3cb70f4c99b3a5484acc76c1e7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:04.080452 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1231/2517] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:43:03 2022] DELETE /identity/v3/users/12028b3cb70f4c99b3a5484acc76c1e7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:04.084912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cecea-75b8-4a41-99c8-6daabe759a9d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:04.085201 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cecea-75b8-4a41-99c8-6daabe759a9d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:04.085479 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cecea-75b8-4a41-99c8-6daabe759a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:04.102909 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-863cecea-75b8-4a41-99c8-6daabe759a9d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:04.104125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-863cecea-75b8-4a41-99c8-6daabe759a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:04.162103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1287/2518] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:04.172346 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc279140-312f-41eb-be66-a6df69b33dda admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:04.173748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-cc279140-312f-41eb-be66-a6df69b33dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:04.229770 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc279140-312f-41eb-be66-a6df69b33dda admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:04.233345 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfff00-0106-4a62-b845-d166071031c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:04.233976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfff00-0106-4a62-b845-d166071031c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:04.234261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfff00-0106-4a62-b845-d166071031c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:04.234550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfff00-0106-4a62-b845-d166071031c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:04.244434 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfff00-0106-4a62-b845-d166071031c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:04.245975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfff00-0106-4a62-b845-d166071031c3 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:04.256086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1232/2519] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:04.527119 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cecea-75b8-4a41-99c8-6daabe759a9d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:04.528593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-863cecea-75b8-4a41-99c8-6daabe759a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:04.540820 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cecea-75b8-4a41-99c8-6daabe759a9d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:04.546301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c06531-0505-4ef7-b774-6ffbf78af3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:04.547253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c06531-0505-4ef7-b774-6ffbf78af3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:04.547440 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c06531-0505-4ef7-b774-6ffbf78af3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:04.547751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c06531-0505-4ef7-b774-6ffbf78af3b9 admin admin] PATH_INFO: `/v3/projects/9eb9793422a8485fb12fa7b0b91d5d1a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:04.549545 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c06531-0505-4ef7-b774-6ffbf78af3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb9793422a8485fb12fa7b0b91d5d1a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:04.551056 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c06531-0505-4ef7-b774-6ffbf78af3b9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:04.598372 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-82c06531-0505-4ef7-b774-6ffbf78af3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb9793422a8485fb12fa7b0b91d5d1a', 'request_id': 'req-82c06531-0505-4ef7-b774-6ffbf78af3b9'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:04.603817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-82c06531-0505-4ef7-b774-6ffbf78af3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb9793422a8485fb12fa7b0b91d5d1a', 'request_id': 'req-82c06531-0505-4ef7-b774-6ffbf78af3b9'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:04.611661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-82c06531-0505-4ef7-b774-6ffbf78af3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb9793422a8485fb12fa7b0b91d5d1a', 'request_id': 'req-82c06531-0505-4ef7-b774-6ffbf78af3b9'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:04.622947 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-82c06531-0505-4ef7-b774-6ffbf78af3b9 admin admin] The token cache is being invalidate because project 9eb9793422a8485fb12fa7b0b91d5d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:43:04.623237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-82c06531-0505-4ef7-b774-6ffbf78af3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:04.623898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-82c06531-0505-4ef7-b774-6ffbf78af3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:04.625436 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1288/2520] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:43:04 2022] DELETE /identity/v3/projects/9eb9793422a8485fb12fa7b0b91d5d1a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:04.631817 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359de44-528e-448a-8bdd-b4ae7afbfc6b None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:04.632310 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359de44-528e-448a-8bdd-b4ae7afbfc6b None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:04.632443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359de44-528e-448a-8bdd-b4ae7afbfc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:04.649748 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-0359de44-528e-448a-8bdd-b4ae7afbfc6b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:04.650932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-0359de44-528e-448a-8bdd-b4ae7afbfc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:04.669199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:04.712119 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1233/2521] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:04.721321 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786acc7-6174-4ebf-8e04-ed9054b4270d None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:04.721612 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786acc7-6174-4ebf-8e04-ed9054b4270d None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:04.721891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786acc7-6174-4ebf-8e04-ed9054b4270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:04.740541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-5786acc7-6174-4ebf-8e04-ed9054b4270d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:04.741750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5786acc7-6174-4ebf-8e04-ed9054b4270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:04.749886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1289/2522] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:04.754125 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359de44-528e-448a-8bdd-b4ae7afbfc6b None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:04.764286 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359de44-528e-448a-8bdd-b4ae7afbfc6b None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:04.768889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5422fa6-6c55-4de4-96c4-285d1060c80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:04.769546 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5422fa6-6c55-4de4-96c4-285d1060c80b admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:04.769835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5422fa6-6c55-4de4-96c4-285d1060c80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:04.770112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5422fa6-6c55-4de4-96c4-285d1060c80b admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:04.770874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5422fa6-6c55-4de4-96c4-285d1060c80b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:43:04.771185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5422fa6-6c55-4de4-96c4-285d1060c80b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:04.772834 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5422fa6-6c55-4de4-96c4-285d1060c80b admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:04.784887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1234/2523] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:43:04.789004 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786acc7-6174-4ebf-8e04-ed9054b4270d None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:04.798969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786acc7-6174-4ebf-8e04-ed9054b4270d None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:04.803677 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e7c02-4104-492a-95f1-79a646142ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:04.804407 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e7c02-4104-492a-95f1-79a646142ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:04.804694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e7c02-4104-492a-95f1-79a646142ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:04.804967 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e7c02-4104-492a-95f1-79a646142ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:04.805667 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e7c02-4104-492a-95f1-79a646142ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:04.807597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e7c02-4104-492a-95f1-79a646142ec3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:04.832145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1290/2524] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:43:04 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:43:04.836193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5422fa6-6c55-4de4-96c4-285d1060c80b admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:04.846739 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5422fa6-6c55-4de4-96c4-285d1060c80b admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:04.901383 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a867b0-e478-4dc0-a480-a9d2804ee1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:04.902043 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a867b0-e478-4dc0-a480-a9d2804ee1bf admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:04.902839 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a867b0-e478-4dc0-a480-a9d2804ee1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:04.903109 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a867b0-e478-4dc0-a480-a9d2804ee1bf admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:04.903823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a867b0-e478-4dc0-a480-a9d2804ee1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:04.905747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a867b0-e478-4dc0-a480-a9d2804ee1bf admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:04.925407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1235/2525] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:43:04 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:04.929637 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e7c02-4104-492a-95f1-79a646142ec3 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:04.940066 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e7c02-4104-492a-95f1-79a646142ec3 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:04.944646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d343b04-92a9-4fbb-8e4c-ae22c1ba2d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:04.945295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d343b04-92a9-4fbb-8e4c-ae22c1ba2d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:04.945578 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d343b04-92a9-4fbb-8e4c-ae22c1ba2d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:04.945852 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d343b04-92a9-4fbb-8e4c-ae22c1ba2d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:04.946572 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d343b04-92a9-4fbb-8e4c-ae22c1ba2d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:04.948244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d343b04-92a9-4fbb-8e4c-ae22c1ba2d40 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:04.959059 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1291/2526] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:04.962931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a867b0-e478-4dc0-a480-a9d2804ee1bf admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:04.973350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a867b0-e478-4dc0-a480-a9d2804ee1bf admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:04.977985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d8f52-d114-4c09-b999-b48a7d070c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:04.978639 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d8f52-d114-4c09-b999-b48a7d070c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:04.978925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d8f52-d114-4c09-b999-b48a7d070c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:04.979201 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d8f52-d114-4c09-b999-b48a7d070c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:04.979958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d8f52-d114-4c09-b999-b48a7d070c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:04.981553 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d8f52-d114-4c09-b999-b48a7d070c2c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:04.991577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1236/2527] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:04.995762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d343b04-92a9-4fbb-8e4c-ae22c1ba2d40 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:05.006832 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d343b04-92a9-4fbb-8e4c-ae22c1ba2d40 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:05.011995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ef52a-358e-4326-9b87-1d0a3287907c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:05.012964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ef52a-358e-4326-9b87-1d0a3287907c admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:05.013247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ef52a-358e-4326-9b87-1d0a3287907c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:05.013517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ef52a-358e-4326-9b87-1d0a3287907c admin admin] PATH_INFO: `/v3/projects/88745bc830b44d409544a8d167954f89/users/9ec84740135e4bd8989378635cdd9133/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:05.029499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ef52a-358e-4326-9b87-1d0a3287907c admin admin] RBAC: Authorizing `identity:create_grant(project_id=88745bc830b44d409544a8d167954f89, user_id=9ec84740135e4bd8989378635cdd9133, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:05.032223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ef52a-358e-4326-9b87-1d0a3287907c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:05.049225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1292/2528] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:04 2022] PUT /identity/v3/projects/88745bc830b44d409544a8d167954f89/users/9ec84740135e4bd8989378635cdd9133/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:05.055172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab01e2-0f24-4d03-9b70-53fdb8f0829e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:05.055504 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab01e2-0f24-4d03-9b70-53fdb8f0829e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:05.055796 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab01e2-0f24-4d03-9b70-53fdb8f0829e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:05.073324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-5bab01e2-0f24-4d03-9b70-53fdb8f0829e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:05.075035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-5bab01e2-0f24-4d03-9b70-53fdb8f0829e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:05.135509 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1237/2529] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:05.145562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ef52a-358e-4326-9b87-1d0a3287907c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:05.147239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-893ef52a-358e-4326-9b87-1d0a3287907c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:05.169860 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:05.207158 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ef52a-358e-4326-9b87-1d0a3287907c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:05.210768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeb955-28dd-4465-963f-765eff094e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:05.211429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeb955-28dd-4465-963f-765eff094e26 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:05.211736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeb955-28dd-4465-963f-765eff094e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:05.212017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeb955-28dd-4465-963f-765eff094e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:05.221787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeb955-28dd-4465-963f-765eff094e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:05.223218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeb955-28dd-4465-963f-765eff094e26 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:05.232727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1293/2530] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:09.337584 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244b504-d218-4775-ab94-df0587045122 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:09.338134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244b504-d218-4775-ab94-df0587045122 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:09.338226 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244b504-d218-4775-ab94-df0587045122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:09.403089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-0244b504-d218-4775-ab94-df0587045122 None None] MFA Rules not processed for user `9ec84740135e4bd8989378635cdd9133`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:09.405751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-0244b504-d218-4775-ab94-df0587045122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:09.433875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:09.552757 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1238/2531] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:09.556904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeb955-28dd-4465-963f-765eff094e26 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:09.573065 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeb955-28dd-4465-963f-765eff094e26 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:09.578726 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ec4e4-f14a-4e26-8e53-d0196d0f7694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:09.579440 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ec4e4-f14a-4e26-8e53-d0196d0f7694 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:09.580024 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ec4e4-f14a-4e26-8e53-d0196d0f7694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:09.580024 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ec4e4-f14a-4e26-8e53-d0196d0f7694 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:09.581151 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ec4e4-f14a-4e26-8e53-d0196d0f7694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:09.584100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ec4e4-f14a-4e26-8e53-d0196d0f7694 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:09.627139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1294/2532] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:43:09 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:43:09.641194 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244b504-d218-4775-ab94-df0587045122 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:09.650194 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244b504-d218-4775-ab94-df0587045122 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:09.729772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a200f5f-e5b6-424f-b196-6edabc9449f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:09.731110 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a200f5f-e5b6-424f-b196-6edabc9449f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:09.731390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a200f5f-e5b6-424f-b196-6edabc9449f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:09.731697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a200f5f-e5b6-424f-b196-6edabc9449f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:09.732389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a200f5f-e5b6-424f-b196-6edabc9449f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:09.734326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a200f5f-e5b6-424f-b196-6edabc9449f2 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:09.757270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1239/2533] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:43:09 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:09.761241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ec4e4-f14a-4e26-8e53-d0196d0f7694 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:09.773565 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ec4e4-f14a-4e26-8e53-d0196d0f7694 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:09.778797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd893d-97cc-4b2b-a871-f7fe87499414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:09.779518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd893d-97cc-4b2b-a871-f7fe87499414 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:09.779810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd893d-97cc-4b2b-a871-f7fe87499414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:09.780090 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd893d-97cc-4b2b-a871-f7fe87499414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:09.780828 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd893d-97cc-4b2b-a871-f7fe87499414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:09.782472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd893d-97cc-4b2b-a871-f7fe87499414 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:09.794759 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1295/2534] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:09.799119 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a200f5f-e5b6-424f-b196-6edabc9449f2 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:09.810356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a200f5f-e5b6-424f-b196-6edabc9449f2 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:09.816285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39308f3c-4c85-4bfe-9a6c-7f751970c124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:09.817264 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39308f3c-4c85-4bfe-9a6c-7f751970c124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:09.817540 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39308f3c-4c85-4bfe-9a6c-7f751970c124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:09.817819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39308f3c-4c85-4bfe-9a6c-7f751970c124 admin admin] PATH_INFO: `/v3/projects/829a06c114c64c1bbfece8a0d7718159/users/18fa316e7e784ccb860f5006ae3960e7/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:09.840397 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39308f3c-4c85-4bfe-9a6c-7f751970c124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829a06c114c64c1bbfece8a0d7718159, user_id=18fa316e7e784ccb860f5006ae3960e7, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:09.843137 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39308f3c-4c85-4bfe-9a6c-7f751970c124 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:09.862737 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1240/2535] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:09 2022] PUT /identity/v3/projects/829a06c114c64c1bbfece8a0d7718159/users/18fa316e7e784ccb860f5006ae3960e7/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:43:09.866702 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd893d-97cc-4b2b-a871-f7fe87499414 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:09.877827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd893d-97cc-4b2b-a871-f7fe87499414 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:09.944945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249fca0-3021-42cc-bdae-4ca784e23839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:09.945617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249fca0-3021-42cc-bdae-4ca784e23839 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:09.945926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249fca0-3021-42cc-bdae-4ca784e23839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:09.946209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249fca0-3021-42cc-bdae-4ca784e23839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:09.946933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249fca0-3021-42cc-bdae-4ca784e23839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:09.948580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249fca0-3021-42cc-bdae-4ca784e23839 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:09.959350 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1296/2536] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:09.963547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39308f3c-4c85-4bfe-9a6c-7f751970c124 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:09.975122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39308f3c-4c85-4bfe-9a6c-7f751970c124 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:09.980209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f506f-9cd9-4cc1-b7f0-1813e514187e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:09.981650 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f506f-9cd9-4cc1-b7f0-1813e514187e admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:09.981933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f506f-9cd9-4cc1-b7f0-1813e514187e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:09.982210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f506f-9cd9-4cc1-b7f0-1813e514187e admin admin] PATH_INFO: `/v3/projects/829a06c114c64c1bbfece8a0d7718159/users/18fa316e7e784ccb860f5006ae3960e7/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:09.984262 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f506f-9cd9-4cc1-b7f0-1813e514187e admin admin] RBAC: Authorizing `identity:create_grant(project_id=829a06c114c64c1bbfece8a0d7718159, user_id=18fa316e7e784ccb860f5006ae3960e7, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:09.986929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f506f-9cd9-4cc1-b7f0-1813e514187e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:09.997361 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1241/2537] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:09 2022] PUT /identity/v3/projects/829a06c114c64c1bbfece8a0d7718159/users/18fa316e7e784ccb860f5006ae3960e7/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:16.035170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68cb07-da1d-4693-8218-8551c1942a65 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:16.035764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68cb07-da1d-4693-8218-8551c1942a65 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:16.035764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68cb07-da1d-4693-8218-8551c1942a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:16.066105 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2d68cb07-da1d-4693-8218-8551c1942a65 None None] MFA Rules not processed for user `18fa316e7e784ccb860f5006ae3960e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:16.067357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2d68cb07-da1d-4693-8218-8551c1942a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:16.147898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1297/2538] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:16 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:16.163043 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f506f-9cd9-4cc1-b7f0-1813e514187e admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:16.167062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ed6f506f-9cd9-4cc1-b7f0-1813e514187e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:16.251108 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f506f-9cd9-4cc1-b7f0-1813e514187e admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:16.258146 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89c96d-8dd3-4a86-8e6a-5a7de67a1965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:16.258825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89c96d-8dd3-4a86-8e6a-5a7de67a1965 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:16.259109 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89c96d-8dd3-4a86-8e6a-5a7de67a1965 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:16.259385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89c96d-8dd3-4a86-8e6a-5a7de67a1965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:16.265587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:16.322181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89c96d-8dd3-4a86-8e6a-5a7de67a1965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:16.323860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89c96d-8dd3-4a86-8e6a-5a7de67a1965 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:16.333727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1242/2539] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:17.463332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2af04-4bdf-4684-94df-21baddd6d27b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:17.463928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2af04-4bdf-4684-94df-21baddd6d27b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:17.464094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2af04-4bdf-4684-94df-21baddd6d27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:17.486522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-40b2af04-4bdf-4684-94df-21baddd6d27b None None] MFA Rules not processed for user `d44268b4ab154bea8c958be5f3e30714`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:17.488303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-40b2af04-4bdf-4684-94df-21baddd6d27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:17.496970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:17.590794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89c96d-8dd3-4a86-8e6a-5a7de67a1965 service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:17.591887 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1298/2540] 10.222.0.50 () {58 vars in 967 bytes} [Wed Jun 15 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:17.593377 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-0c89c96d-8dd3-4a86-8e6a-5a7de67a1965 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:17.593955 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bb499-b09b-497a-ac21-893b96fa28b7 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:17.594266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bb499-b09b-497a-ac21-893b96fa28b7 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:17.594600 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bb499-b09b-497a-ac21-893b96fa28b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:17.621104 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7a6bb499-b09b-497a-ac21-893b96fa28b7 None None] MFA Rules not processed for user `9ec84740135e4bd8989378635cdd9133`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:17.625218 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7a6bb499-b09b-497a-ac21-893b96fa28b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:17.640488 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1299/2541] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:17.716212 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89c96d-8dd3-4a86-8e6a-5a7de67a1965 service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:17.724582 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26548ad-8d48-4f15-8a69-1d746f1040d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7673b1c4f6184570b0039f9285bf1286', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:17.725242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26548ad-8d48-4f15-8a69-1d746f1040d0 service swift] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:17.725532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26548ad-8d48-4f15-8a69-1d746f1040d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:17.725797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26548ad-8d48-4f15-8a69-1d746f1040d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:17.742821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26548ad-8d48-4f15-8a69-1d746f1040d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:17.744860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26548ad-8d48-4f15-8a69-1d746f1040d0 service swift] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:17.758940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1243/2542] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Jun 15 10:43:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 10:43:20.431265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bb499-b09b-497a-ac21-893b96fa28b7 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:20.435532 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7a6bb499-b09b-497a-ac21-893b96fa28b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:20.581281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bb499-b09b-497a-ac21-893b96fa28b7 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:20.594907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cc449-1491-4e31-8f14-b49823ab8339 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2729cb0b9adb44f7ba5c968b6158a93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:20.595893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cc449-1491-4e31-8f14-b49823ab8339 service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:20.596185 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cc449-1491-4e31-8f14-b49823ab8339 service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:20.596469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cc449-1491-4e31-8f14-b49823ab8339 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:20.598732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3c9cc449-1491-4e31-8f14-b49823ab8339 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:20.612895 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cc449-1491-4e31-8f14-b49823ab8339 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:20.615015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cc449-1491-4e31-8f14-b49823ab8339 service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:20.627438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1300/2543] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:24.770142 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b5a64-0b7f-439b-a273-945a57c20f95 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:24.770690 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b5a64-0b7f-439b-a273-945a57c20f95 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:24.770690 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b5a64-0b7f-439b-a273-945a57c20f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:24.789657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-c79b5a64-0b7f-439b-a273-945a57c20f95 None None] MFA Rules not processed for user `0d6ad1725257401888617fdcf7e57386`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:24.791195 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c79b5a64-0b7f-439b-a273-945a57c20f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:24.852743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1244/2544] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:30.622241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=55 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:34.845580 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=81 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:36.064307 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cc449-1491-4e31-8f14-b49823ab8339 service placement] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:36.066086 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3c9cc449-1491-4e31-8f14-b49823ab8339 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:36.135236 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cc449-1491-4e31-8f14-b49823ab8339 service placement] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:36.139047 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2775b9-f2dd-42a0-8101-b3dda8b3d8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:36.139653 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2775b9-f2dd-42a0-8101-b3dda8b3d8bb service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:36.139932 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2775b9-f2dd-42a0-8101-b3dda8b3d8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:36.140202 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2775b9-f2dd-42a0-8101-b3dda8b3d8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:36.142131 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6a2775b9-f2dd-42a0-8101-b3dda8b3d8bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:36.211396 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2775b9-f2dd-42a0-8101-b3dda8b3d8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:36.212916 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2775b9-f2dd-42a0-8101-b3dda8b3d8bb service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:36.223634 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1301/2545] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:40.827831 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b5a64-0b7f-439b-a273-945a57c20f95 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:40.830249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c79b5a64-0b7f-439b-a273-945a57c20f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:40.847085 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b5a64-0b7f-439b-a273-945a57c20f95 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:40.853046 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedc99d-1e71-4cd7-ae79-a4d2d60cc52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:40.854726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedc99d-1e71-4cd7-ae79-a4d2d60cc52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:40.854726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedc99d-1e71-4cd7-ae79-a4d2d60cc52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:40.854726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedc99d-1e71-4cd7-ae79-a4d2d60cc52e admin admin] PATH_INFO: `/v3/users/abbeca853267434eb1d2fff664f32f41` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:40.856399 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedc99d-1e71-4cd7-ae79-a4d2d60cc52e admin admin] RBAC: Authorizing `identity:delete_user(user_id=abbeca853267434eb1d2fff664f32f41)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:40.859509 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedc99d-1e71-4cd7-ae79-a4d2d60cc52e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:40.917431 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-7aedc99d-1e71-4cd7-ae79-a4d2d60cc52e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abbeca853267434eb1d2fff664f32f41'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:40.931143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-7aedc99d-1e71-4cd7-ae79-a4d2d60cc52e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abbeca853267434eb1d2fff664f32f41'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:40.931933 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-7aedc99d-1e71-4cd7-ae79-a4d2d60cc52e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abbeca853267434eb1d2fff664f32f41'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:40.940458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-7aedc99d-1e71-4cd7-ae79-a4d2d60cc52e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abbeca853267434eb1d2fff664f32f41'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:40.941204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-7aedc99d-1e71-4cd7-ae79-a4d2d60cc52e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abbeca853267434eb1d2fff664f32f41'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:40.956069 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1245/2546] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:43:40 2022] DELETE /identity/v3/users/abbeca853267434eb1d2fff664f32f41 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:41.149578 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2775b9-f2dd-42a0-8101-b3dda8b3d8bb service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:41.161685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2775b9-f2dd-42a0-8101-b3dda8b3d8bb service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:41.249178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:41.250087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:41.250334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:41.250605 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0 admin admin] PATH_INFO: `/v3/projects/99b6dce74c1c4c7ea8af0682b9210350` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:41.252190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99b6dce74c1c4c7ea8af0682b9210350)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:41.254157 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:41.305034 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99b6dce74c1c4c7ea8af0682b9210350', 'request_id': 'req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:41.307109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:41.313430 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99b6dce74c1c4c7ea8af0682b9210350', 'request_id': 'req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:41.321304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99b6dce74c1c4c7ea8af0682b9210350', 'request_id': 'req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:41.333484 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0 admin admin] The token cache is being invalidate because project 99b6dce74c1c4c7ea8af0682b9210350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:43:41.333779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:41.334797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e6e1edf8-2fbd-456f-b709-7c9a1d8952d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:41.336343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1302/2547] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:43:41 2022] DELETE /identity/v3/projects/99b6dce74c1c4c7ea8af0682b9210350 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:41.342018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5316a74-4b47-4030-bbec-36a2c1e76f74 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:41.342335 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5316a74-4b47-4030-bbec-36a2c1e76f74 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:41.342653 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5316a74-4b47-4030-bbec-36a2c1e76f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:41.376155 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-c5316a74-4b47-4030-bbec-36a2c1e76f74 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:41.377475 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c5316a74-4b47-4030-bbec-36a2c1e76f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:41.461413 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1246/2548] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:41.470458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b39b5-193e-4d37-9caf-198f5d2bc493 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:41.470768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b39b5-193e-4d37-9caf-198f5d2bc493 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:41.471036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b39b5-193e-4d37-9caf-198f5d2bc493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:41.499072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-953b39b5-193e-4d37-9caf-198f5d2bc493 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:41.500454 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-953b39b5-193e-4d37-9caf-198f5d2bc493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:41.517847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1303/2549] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:41.518587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5316a74-4b47-4030-bbec-36a2c1e76f74 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:41.532207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5316a74-4b47-4030-bbec-36a2c1e76f74 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:41.543915 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac0132-8646-4900-93d5-f1878dfc843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:41.544625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac0132-8646-4900-93d5-f1878dfc843c admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:41.544909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac0132-8646-4900-93d5-f1878dfc843c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:41.545187 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac0132-8646-4900-93d5-f1878dfc843c admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:41.546074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac0132-8646-4900-93d5-f1878dfc843c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:43:41.546571 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac0132-8646-4900-93d5-f1878dfc843c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:41.548705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac0132-8646-4900-93d5-f1878dfc843c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:41.565075 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1247/2550] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:43:41.571132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b39b5-193e-4d37-9caf-198f5d2bc493 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:41.585006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b39b5-193e-4d37-9caf-198f5d2bc493 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:41.590889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304afc3-bf75-45b0-aee3-651713625b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:41.592020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304afc3-bf75-45b0-aee3-651713625b38 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:41.592511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304afc3-bf75-45b0-aee3-651713625b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:41.593019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304afc3-bf75-45b0-aee3-651713625b38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:41.593976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304afc3-bf75-45b0-aee3-651713625b38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:41.597217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304afc3-bf75-45b0-aee3-651713625b38 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:41.661932 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1304/2551] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:43:41 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:41.665901 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac0132-8646-4900-93d5-f1878dfc843c admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:41.687062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac0132-8646-4900-93d5-f1878dfc843c admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:41.778001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c039a-c289-4316-9685-97394830015a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:41.778695 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c039a-c289-4316-9685-97394830015a admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:41.778969 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c039a-c289-4316-9685-97394830015a admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:41.779257 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c039a-c289-4316-9685-97394830015a admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:41.780023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c039a-c289-4316-9685-97394830015a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:41.781983 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c039a-c289-4316-9685-97394830015a admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:41.791415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:41.824433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1248/2552] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:43:41 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:41.826146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304afc3-bf75-45b0-aee3-651713625b38 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:41.836537 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304afc3-bf75-45b0-aee3-651713625b38 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:41.842067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd2e47-10b2-47fe-95a6-ff5ea6d65383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:41.842795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd2e47-10b2-47fe-95a6-ff5ea6d65383 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:41.843797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd2e47-10b2-47fe-95a6-ff5ea6d65383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:41.843797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd2e47-10b2-47fe-95a6-ff5ea6d65383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:41.844290 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd2e47-10b2-47fe-95a6-ff5ea6d65383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:41.845920 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd2e47-10b2-47fe-95a6-ff5ea6d65383 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:41.860305 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1305/2553] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:41.862563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c039a-c289-4316-9685-97394830015a admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:41.880669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c039a-c289-4316-9685-97394830015a admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:41.887424 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd287f-985d-4651-9ee3-9d09212e11d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:41.887424 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd287f-985d-4651-9ee3-9d09212e11d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:41.887424 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd287f-985d-4651-9ee3-9d09212e11d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:41.888577 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd287f-985d-4651-9ee3-9d09212e11d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:41.893504 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd287f-985d-4651-9ee3-9d09212e11d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:41.896644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd287f-985d-4651-9ee3-9d09212e11d0 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:41.918533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1249/2554] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:41.926831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd2e47-10b2-47fe-95a6-ff5ea6d65383 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:41.938906 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd2e47-10b2-47fe-95a6-ff5ea6d65383 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:41.943925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83866e13-4852-470f-9b34-a826cbd0cb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:41.945418 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83866e13-4852-470f-9b34-a826cbd0cb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:41.945715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83866e13-4852-470f-9b34-a826cbd0cb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:41.946156 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83866e13-4852-470f-9b34-a826cbd0cb1b admin admin] PATH_INFO: `/v3/projects/51484fce129440bc881e49ade64dea98/users/94c2fd9fab8d44c38eaf0b2b8311021a/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:41.962728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83866e13-4852-470f-9b34-a826cbd0cb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51484fce129440bc881e49ade64dea98, user_id=94c2fd9fab8d44c38eaf0b2b8311021a, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:41.966043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83866e13-4852-470f-9b34-a826cbd0cb1b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:41.983539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1306/2555] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:41 2022] PUT /identity/v3/projects/51484fce129440bc881e49ade64dea98/users/94c2fd9fab8d44c38eaf0b2b8311021a/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:41.995398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde641e-3f9b-44e5-b0f0-3caecd40d26d None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:41.995819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde641e-3f9b-44e5-b0f0-3caecd40d26d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:41.996331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde641e-3f9b-44e5-b0f0-3caecd40d26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:42.025206 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-9cde641e-3f9b-44e5-b0f0-3caecd40d26d None None] MFA Rules not processed for user `94c2fd9fab8d44c38eaf0b2b8311021a`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:42.026506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-9cde641e-3f9b-44e5-b0f0-3caecd40d26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:42.095382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1250/2556] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:42.099852 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83866e13-4852-470f-9b34-a826cbd0cb1b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:42.178702 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83866e13-4852-470f-9b34-a826cbd0cb1b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:42.185349 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf956205-6df2-4280-bf80-c484fe949a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:42.186126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956205-6df2-4280-bf80-c484fe949a6b admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:42.186484 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956205-6df2-4280-bf80-c484fe949a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:42.186829 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf956205-6df2-4280-bf80-c484fe949a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:42.187688 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf956205-6df2-4280-bf80-c484fe949a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:42.190681 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf956205-6df2-4280-bf80-c484fe949a6b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:42.227735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1307/2557] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:43:42 2022] POST /identity/v3/projects => generated 363 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:42.229365 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde641e-3f9b-44e5-b0f0-3caecd40d26d None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:42.243409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde641e-3f9b-44e5-b0f0-3caecd40d26d None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:42.306813 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9363b-b40e-401c-9104-c3aa16eb1132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:42.309423 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9363b-b40e-401c-9104-c3aa16eb1132 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:42.309707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9363b-b40e-401c-9104-c3aa16eb1132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:42.310029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9363b-b40e-401c-9104-c3aa16eb1132 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:42.310728 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9363b-b40e-401c-9104-c3aa16eb1132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:42.312687 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9363b-b40e-401c-9104-c3aa16eb1132 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:42.336181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1251/2558] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:43:42 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:42.342558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf956205-6df2-4280-bf80-c484fe949a6b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:42.353709 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf956205-6df2-4280-bf80-c484fe949a6b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:42.358458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270a86d-bcef-4fd8-be3c-b9c72e2181fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:42.359140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270a86d-bcef-4fd8-be3c-b9c72e2181fa admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:42.359424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270a86d-bcef-4fd8-be3c-b9c72e2181fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:42.359754 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270a86d-bcef-4fd8-be3c-b9c72e2181fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:42.360489 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270a86d-bcef-4fd8-be3c-b9c72e2181fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:42.362210 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270a86d-bcef-4fd8-be3c-b9c72e2181fa admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:42.378335 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1308/2559] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:42.379602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9363b-b40e-401c-9104-c3aa16eb1132 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:42.393990 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9363b-b40e-401c-9104-c3aa16eb1132 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:42.399494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c53dff-4d92-4d0f-8c33-0cd255ad3968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:42.400478 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c53dff-4d92-4d0f-8c33-0cd255ad3968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:42.400843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c53dff-4d92-4d0f-8c33-0cd255ad3968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:42.401184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c53dff-4d92-4d0f-8c33-0cd255ad3968 admin admin] PATH_INFO: `/v3/projects/15d6d9afa7fd4380807e51b042166d6f/users/394862c9b1664c919cc7550275b95bc3/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:42.421846 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c53dff-4d92-4d0f-8c33-0cd255ad3968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d6d9afa7fd4380807e51b042166d6f, user_id=394862c9b1664c919cc7550275b95bc3, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:42.424885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c53dff-4d92-4d0f-8c33-0cd255ad3968 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:42.441065 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1252/2560] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:42 2022] PUT /identity/v3/projects/15d6d9afa7fd4380807e51b042166d6f/users/394862c9b1664c919cc7550275b95bc3/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:42.445126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270a86d-bcef-4fd8-be3c-b9c72e2181fa admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:42.460299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270a86d-bcef-4fd8-be3c-b9c72e2181fa admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:42.516884 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:42.531343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508288dc-b001-41d3-a76c-d2d67c9873e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:42.532056 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508288dc-b001-41d3-a76c-d2d67c9873e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:42.532347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508288dc-b001-41d3-a76c-d2d67c9873e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:42.532627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508288dc-b001-41d3-a76c-d2d67c9873e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:42.533366 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508288dc-b001-41d3-a76c-d2d67c9873e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:42.534968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508288dc-b001-41d3-a76c-d2d67c9873e3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:42.546598 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1309/2561] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:42.551068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c53dff-4d92-4d0f-8c33-0cd255ad3968 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:42.562409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c53dff-4d92-4d0f-8c33-0cd255ad3968 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:42.567847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49723d-aa74-4ec8-80ad-bb7f88d29f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:42.569652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49723d-aa74-4ec8-80ad-bb7f88d29f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:42.571755 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49723d-aa74-4ec8-80ad-bb7f88d29f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:42.572063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49723d-aa74-4ec8-80ad-bb7f88d29f2c admin admin] PATH_INFO: `/v3/projects/15d6d9afa7fd4380807e51b042166d6f/users/394862c9b1664c919cc7550275b95bc3/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:42.574201 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49723d-aa74-4ec8-80ad-bb7f88d29f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d6d9afa7fd4380807e51b042166d6f, user_id=394862c9b1664c919cc7550275b95bc3, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:42.577215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49723d-aa74-4ec8-80ad-bb7f88d29f2c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:42.590099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1253/2562] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:42 2022] PUT /identity/v3/projects/15d6d9afa7fd4380807e51b042166d6f/users/394862c9b1664c919cc7550275b95bc3/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:42.601117 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa1d9-e839-43af-ae57-a6360a009125 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:42.601455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa1d9-e839-43af-ae57-a6360a009125 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:42.601689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa1d9-e839-43af-ae57-a6360a009125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:42.632273 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c6caa1d9-e839-43af-ae57-a6360a009125 None None] MFA Rules not processed for user `394862c9b1664c919cc7550275b95bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:42.633441 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c6caa1d9-e839-43af-ae57-a6360a009125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:42.712673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1310/2563] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:42 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:43:42.724456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49723d-aa74-4ec8-80ad-bb7f88d29f2c admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:42.726199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-df49723d-aa74-4ec8-80ad-bb7f88d29f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:42.751409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:42.793086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49723d-aa74-4ec8-80ad-bb7f88d29f2c admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:42.798850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cffaaf-dfe6-4c37-bcdd-fc81dc431206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:42.799560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cffaaf-dfe6-4c37-bcdd-fc81dc431206 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:42.799849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cffaaf-dfe6-4c37-bcdd-fc81dc431206 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:42.800128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cffaaf-dfe6-4c37-bcdd-fc81dc431206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:42.810876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cffaaf-dfe6-4c37-bcdd-fc81dc431206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:42.812379 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cffaaf-dfe6-4c37-bcdd-fc81dc431206 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:42.831984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1254/2564] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:42.910248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6caa1d9-e839-43af-ae57-a6360a009125 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:42.921764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6caa1d9-e839-43af-ae57-a6360a009125 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:42.925612 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902129a9-886a-44d2-8df4-b6055a499417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:42.926286 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902129a9-886a-44d2-8df4-b6055a499417 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:42.926556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902129a9-886a-44d2-8df4-b6055a499417 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:42.926835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902129a9-886a-44d2-8df4-b6055a499417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:43.001494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902129a9-886a-44d2-8df4-b6055a499417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:43.002943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902129a9-886a-44d2-8df4-b6055a499417 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:43.013471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1311/2565] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:45.761493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cffaaf-dfe6-4c37-bcdd-fc81dc431206 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:45.826127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cffaaf-dfe6-4c37-bcdd-fc81dc431206 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:45.831068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b637d18-7873-4dec-a899-606ba2ebce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:45.831604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b637d18-7873-4dec-a899-606ba2ebce0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:45.831884 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b637d18-7873-4dec-a899-606ba2ebce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:45.832155 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b637d18-7873-4dec-a899-606ba2ebce0b admin admin] PATH_INFO: `/v3/users/94c2fd9fab8d44c38eaf0b2b8311021a` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:45.833374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b637d18-7873-4dec-a899-606ba2ebce0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c2fd9fab8d44c38eaf0b2b8311021a)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:45.835306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b637d18-7873-4dec-a899-606ba2ebce0b admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:45.884019 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-2b637d18-7873-4dec-a899-606ba2ebce0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c2fd9fab8d44c38eaf0b2b8311021a'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:45.897641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-2b637d18-7873-4dec-a899-606ba2ebce0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c2fd9fab8d44c38eaf0b2b8311021a'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:45.898350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-2b637d18-7873-4dec-a899-606ba2ebce0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c2fd9fab8d44c38eaf0b2b8311021a'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:45.906138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-2b637d18-7873-4dec-a899-606ba2ebce0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c2fd9fab8d44c38eaf0b2b8311021a'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:45.906895 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-2b637d18-7873-4dec-a899-606ba2ebce0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c2fd9fab8d44c38eaf0b2b8311021a'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:45.923426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1255/2566] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:43:45 2022] DELETE /identity/v3/users/94c2fd9fab8d44c38eaf0b2b8311021a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:45.928209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed45e82-b35e-4851-bba8-ded2d74d31f8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:45.928846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed45e82-b35e-4851-bba8-ded2d74d31f8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:45.928846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed45e82-b35e-4851-bba8-ded2d74d31f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:45.950643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2ed45e82-b35e-4851-bba8-ded2d74d31f8 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:45.951930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2ed45e82-b35e-4851-bba8-ded2d74d31f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:46.017866 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1312/2567] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:46.028456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b637d18-7873-4dec-a899-606ba2ebce0b admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:46.029951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-2b637d18-7873-4dec-a899-606ba2ebce0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:46.078542 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:46.093596 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b637d18-7873-4dec-a899-606ba2ebce0b admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:46.096982 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27efa29-e4cb-4dae-b274-5da35415a585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:46.097850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27efa29-e4cb-4dae-b274-5da35415a585 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:46.097996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27efa29-e4cb-4dae-b274-5da35415a585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:46.098196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27efa29-e4cb-4dae-b274-5da35415a585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:46.107957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27efa29-e4cb-4dae-b274-5da35415a585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:46.109543 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27efa29-e4cb-4dae-b274-5da35415a585 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:46.121367 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1256/2568] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:46.443192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed45e82-b35e-4851-bba8-ded2d74d31f8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:46.443192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2ed45e82-b35e-4851-bba8-ded2d74d31f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:46.457107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed45e82-b35e-4851-bba8-ded2d74d31f8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:46.462111 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:46.463014 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:46.463296 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:46.463600 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] PATH_INFO: `/v3/projects/51484fce129440bc881e49ade64dea98` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:46.465013 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51484fce129440bc881e49ade64dea98)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:46.466937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:46.474046 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:46.522684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51484fce129440bc881e49ade64dea98', 'request_id': 'req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:46.533326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51484fce129440bc881e49ade64dea98', 'request_id': 'req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:46.541747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51484fce129440bc881e49ade64dea98', 'request_id': 'req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:46.559417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] The token cache is being invalidate because project 51484fce129440bc881e49ade64dea98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:43:46.559739 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:46.560423 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:46.562207 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1313/2569] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:43:46 2022] DELETE /identity/v3/projects/51484fce129440bc881e49ade64dea98 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:46.566175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27efa29-e4cb-4dae-b274-5da35415a585 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:46.575919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27efa29-e4cb-4dae-b274-5da35415a585 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:46.640530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67001af0-2c5f-40e1-8b0c-b6fe7d396805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:46.641547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67001af0-2c5f-40e1-8b0c-b6fe7d396805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:46.641978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67001af0-2c5f-40e1-8b0c-b6fe7d396805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:46.643133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67001af0-2c5f-40e1-8b0c-b6fe7d396805 admin admin] PATH_INFO: `/v3/users/394862c9b1664c919cc7550275b95bc3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:46.643999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67001af0-2c5f-40e1-8b0c-b6fe7d396805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=394862c9b1664c919cc7550275b95bc3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:46.646028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67001af0-2c5f-40e1-8b0c-b6fe7d396805 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:46.711325 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-67001af0-2c5f-40e1-8b0c-b6fe7d396805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '394862c9b1664c919cc7550275b95bc3'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:46.725587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-67001af0-2c5f-40e1-8b0c-b6fe7d396805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '394862c9b1664c919cc7550275b95bc3'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:46.726462 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-67001af0-2c5f-40e1-8b0c-b6fe7d396805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '394862c9b1664c919cc7550275b95bc3'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:46.735774 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-67001af0-2c5f-40e1-8b0c-b6fe7d396805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '394862c9b1664c919cc7550275b95bc3'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:46.736622 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-67001af0-2c5f-40e1-8b0c-b6fe7d396805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '394862c9b1664c919cc7550275b95bc3'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:46.750879 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1257/2570] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:43:46 2022] DELETE /identity/v3/users/394862c9b1664c919cc7550275b95bc3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:47.038163 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:47.039762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:47.054000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b77b4-90b8-4e62-9a2a-9a7b3b7818c4 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:47.116180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25ad40-445a-4702-af56-4656b33a6987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:47.117231 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25ad40-445a-4702-af56-4656b33a6987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:47.117724 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25ad40-445a-4702-af56-4656b33a6987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:47.118056 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25ad40-445a-4702-af56-4656b33a6987 admin admin] PATH_INFO: `/v3/projects/15d6d9afa7fd4380807e51b042166d6f` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:47.119349 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25ad40-445a-4702-af56-4656b33a6987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d6d9afa7fd4380807e51b042166d6f)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:47.121522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25ad40-445a-4702-af56-4656b33a6987 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:47.171252 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9a25ad40-445a-4702-af56-4656b33a6987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d6d9afa7fd4380807e51b042166d6f', 'request_id': 'req-9a25ad40-445a-4702-af56-4656b33a6987'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:47.176876 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9a25ad40-445a-4702-af56-4656b33a6987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d6d9afa7fd4380807e51b042166d6f', 'request_id': 'req-9a25ad40-445a-4702-af56-4656b33a6987'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:47.185899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9a25ad40-445a-4702-af56-4656b33a6987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d6d9afa7fd4380807e51b042166d6f', 'request_id': 'req-9a25ad40-445a-4702-af56-4656b33a6987'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:47.199542 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9a25ad40-445a-4702-af56-4656b33a6987 admin admin] The token cache is being invalidate because project 15d6d9afa7fd4380807e51b042166d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:43:47.199843 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9a25ad40-445a-4702-af56-4656b33a6987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:47.200542 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9a25ad40-445a-4702-af56-4656b33a6987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:47.202334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1314/2571] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:43:47 2022] DELETE /identity/v3/projects/15d6d9afa7fd4380807e51b042166d6f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:47.207527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1f958-f3a7-47bb-8ed3-c4bcfb70f99d None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:47.208045 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1f958-f3a7-47bb-8ed3-c4bcfb70f99d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:47.208142 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1f958-f3a7-47bb-8ed3-c4bcfb70f99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:47.227617 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-66f1f958-f3a7-47bb-8ed3-c4bcfb70f99d None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:47.228856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-66f1f958-f3a7-47bb-8ed3-c4bcfb70f99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:47.293071 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1258/2572] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:47.301006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0a0f0-5419-438f-9a63-97608adababe None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:47.301297 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0a0f0-5419-438f-9a63-97608adababe None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:47.301614 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0a0f0-5419-438f-9a63-97608adababe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:47.321313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-83d0a0f0-5419-438f-9a63-97608adababe None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:47.322540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-83d0a0f0-5419-438f-9a63-97608adababe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:47.332287 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1315/2573] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:47.336857 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1f958-f3a7-47bb-8ed3-c4bcfb70f99d None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:47.344488 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:47.348314 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1f958-f3a7-47bb-8ed3-c4bcfb70f99d None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:47.354393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626463d7-bbd8-4e45-ba22-6243bdca9cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:47.355096 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626463d7-bbd8-4e45-ba22-6243bdca9cce admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:47.355394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626463d7-bbd8-4e45-ba22-6243bdca9cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:47.355978 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626463d7-bbd8-4e45-ba22-6243bdca9cce admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:47.356972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626463d7-bbd8-4e45-ba22-6243bdca9cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:43:47.357343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626463d7-bbd8-4e45-ba22-6243bdca9cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:47.359321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626463d7-bbd8-4e45-ba22-6243bdca9cce admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:47.376133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1259/2574] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:43:47.377379 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0a0f0-5419-438f-9a63-97608adababe None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:47.387577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0a0f0-5419-438f-9a63-97608adababe None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:47.393166 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cb70f-3184-4b91-97a6-cac8274a8611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:47.393847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cb70f-3184-4b91-97a6-cac8274a8611 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:47.394132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cb70f-3184-4b91-97a6-cac8274a8611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:47.394604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cb70f-3184-4b91-97a6-cac8274a8611 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:47.395099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cb70f-3184-4b91-97a6-cac8274a8611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:47.397036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cb70f-3184-4b91-97a6-cac8274a8611 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:47.412552 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:47.430820 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1316/2575] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:43:47 2022] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:47.431921 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626463d7-bbd8-4e45-ba22-6243bdca9cce admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:47.444105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626463d7-bbd8-4e45-ba22-6243bdca9cce admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:47.518901 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2e6c6-c3d9-4180-a90e-1c2a768c9853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:47.519635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2e6c6-c3d9-4180-a90e-1c2a768c9853 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:47.519956 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2e6c6-c3d9-4180-a90e-1c2a768c9853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:47.520418 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2e6c6-c3d9-4180-a90e-1c2a768c9853 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:47.521745 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2e6c6-c3d9-4180-a90e-1c2a768c9853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:47.523633 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2e6c6-c3d9-4180-a90e-1c2a768c9853 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:47.547522 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1260/2576] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:43:47 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:47.551565 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cb70f-3184-4b91-97a6-cac8274a8611 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:47.563230 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cb70f-3184-4b91-97a6-cac8274a8611 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:47.569317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049793bb-fb35-4514-8f15-ba8b16d955e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:47.570092 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049793bb-fb35-4514-8f15-ba8b16d955e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:47.570424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049793bb-fb35-4514-8f15-ba8b16d955e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:47.570843 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049793bb-fb35-4514-8f15-ba8b16d955e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:47.571694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049793bb-fb35-4514-8f15-ba8b16d955e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:47.574329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049793bb-fb35-4514-8f15-ba8b16d955e8 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:47.588744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1317/2577] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:47.592980 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2e6c6-c3d9-4180-a90e-1c2a768c9853 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:47.604303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2e6c6-c3d9-4180-a90e-1c2a768c9853 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:47.609497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa45030-5a9d-4018-a42d-94f58a5d39a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:47.610275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa45030-5a9d-4018-a42d-94f58a5d39a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:47.610693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa45030-5a9d-4018-a42d-94f58a5d39a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:47.611033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa45030-5a9d-4018-a42d-94f58a5d39a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:47.611965 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa45030-5a9d-4018-a42d-94f58a5d39a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:47.613636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa45030-5a9d-4018-a42d-94f58a5d39a8 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:47.625104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1261/2578] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:47.629661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049793bb-fb35-4514-8f15-ba8b16d955e8 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:47.641770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049793bb-fb35-4514-8f15-ba8b16d955e8 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:47.648646 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7c491-79b6-42b5-9ed8-008ccaee34c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:47.649732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7c491-79b6-42b5-9ed8-008ccaee34c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:47.650112 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7c491-79b6-42b5-9ed8-008ccaee34c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:47.650685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7c491-79b6-42b5-9ed8-008ccaee34c3 admin admin] PATH_INFO: `/v3/projects/f6bdc59500184beb938a4809c198ff17/users/e2e684e6e5c54eaea365dcbcd863a6a1/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:47.672641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7c491-79b6-42b5-9ed8-008ccaee34c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6bdc59500184beb938a4809c198ff17, user_id=e2e684e6e5c54eaea365dcbcd863a6a1, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:47.675458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7c491-79b6-42b5-9ed8-008ccaee34c3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:47.690820 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1318/2579] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:47 2022] PUT /identity/v3/projects/f6bdc59500184beb938a4809c198ff17/users/e2e684e6e5c54eaea365dcbcd863a6a1/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:47.703419 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52c5b4-ce92-42f7-a837-be1f371e130a None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:47.704034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52c5b4-ce92-42f7-a837-be1f371e130a None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:47.704561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52c5b4-ce92-42f7-a837-be1f371e130a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:47.735567 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-6a52c5b4-ce92-42f7-a837-be1f371e130a None None] MFA Rules not processed for user `e2e684e6e5c54eaea365dcbcd863a6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:47.736833 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6a52c5b4-ce92-42f7-a837-be1f371e130a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:47.810871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1262/2580] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:47.815838 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7c491-79b6-42b5-9ed8-008ccaee34c3 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:47.883985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7c491-79b6-42b5-9ed8-008ccaee34c3 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:47.889818 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0033be9-32e4-4286-856f-8f5418e2bba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:47.890590 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0033be9-32e4-4286-856f-8f5418e2bba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:47.890935 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0033be9-32e4-4286-856f-8f5418e2bba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:47.891272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0033be9-32e4-4286-856f-8f5418e2bba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:47.892099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0033be9-32e4-4286-856f-8f5418e2bba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:47.894320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0033be9-32e4-4286-856f-8f5418e2bba2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:47.923517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1319/2581] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:43:47 2022] POST /identity/v3/projects => generated 401 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:47.927811 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52c5b4-ce92-42f7-a837-be1f371e130a None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:47.938707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52c5b4-ce92-42f7-a837-be1f371e130a None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:48.002246 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dec98-3221-4115-a725-1342cef3a0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:48.003151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dec98-3221-4115-a725-1342cef3a0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:48.003151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dec98-3221-4115-a725-1342cef3a0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:48.003343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dec98-3221-4115-a725-1342cef3a0b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:48.004093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dec98-3221-4115-a725-1342cef3a0b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:48.006541 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dec98-3221-4115-a725-1342cef3a0b8 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:48.013828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:48.033331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1263/2582] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:43:47 2022] POST /identity/v3/users => generated 307 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:43:48.034546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0033be9-32e4-4286-856f-8f5418e2bba2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:48.045440 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0033be9-32e4-4286-856f-8f5418e2bba2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:48.050332 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18768b82-795e-4cc7-abce-6662f1eb7149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:48.051006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18768b82-795e-4cc7-abce-6662f1eb7149 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:48.051294 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18768b82-795e-4cc7-abce-6662f1eb7149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:48.051611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18768b82-795e-4cc7-abce-6662f1eb7149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:48.052429 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18768b82-795e-4cc7-abce-6662f1eb7149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:48.054034 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18768b82-795e-4cc7-abce-6662f1eb7149 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:48.065272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1320/2583] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:43:48.069517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dec98-3221-4115-a725-1342cef3a0b8 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:48.080326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dec98-3221-4115-a725-1342cef3a0b8 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:48.085192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333c812-d175-4705-ab88-033fdbde68c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:48.086102 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333c812-d175-4705-ab88-033fdbde68c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:48.086389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333c812-d175-4705-ab88-033fdbde68c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:48.086663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333c812-d175-4705-ab88-033fdbde68c7 admin admin] PATH_INFO: `/v3/projects/3abab7c922bf4895a13ca93b3c5f6c14/users/c32f48349f2a4a7eaa37ebdb14c1366c/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:48.103742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333c812-d175-4705-ab88-033fdbde68c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abab7c922bf4895a13ca93b3c5f6c14, user_id=c32f48349f2a4a7eaa37ebdb14c1366c, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:48.106731 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333c812-d175-4705-ab88-033fdbde68c7 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:48.120832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1264/2584] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:48 2022] PUT /identity/v3/projects/3abab7c922bf4895a13ca93b3c5f6c14/users/c32f48349f2a4a7eaa37ebdb14c1366c/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:48.124831 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18768b82-795e-4cc7-abce-6662f1eb7149 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:48.135397 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18768b82-795e-4cc7-abce-6662f1eb7149 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:48.190885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23b874-52dd-4d8f-b63f-828bef4619cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:48.191618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b874-52dd-4d8f-b63f-828bef4619cc admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:48.191901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b874-52dd-4d8f-b63f-828bef4619cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:48.192176 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b874-52dd-4d8f-b63f-828bef4619cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:48.192902 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23b874-52dd-4d8f-b63f-828bef4619cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:48.194486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23b874-52dd-4d8f-b63f-828bef4619cc admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:48.205744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1321/2585] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:48.209797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333c812-d175-4705-ab88-033fdbde68c7 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:48.220103 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333c812-d175-4705-ab88-033fdbde68c7 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:48.225508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39301e19-329d-45f4-8b8e-339460b03b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:48.226399 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39301e19-329d-45f4-8b8e-339460b03b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:48.226681 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39301e19-329d-45f4-8b8e-339460b03b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:48.226952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39301e19-329d-45f4-8b8e-339460b03b8b admin admin] PATH_INFO: `/v3/projects/3abab7c922bf4895a13ca93b3c5f6c14/users/c32f48349f2a4a7eaa37ebdb14c1366c/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:48.229012 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39301e19-329d-45f4-8b8e-339460b03b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abab7c922bf4895a13ca93b3c5f6c14, user_id=c32f48349f2a4a7eaa37ebdb14c1366c, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:48.231882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39301e19-329d-45f4-8b8e-339460b03b8b admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:48.242208 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1265/2586] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:48 2022] PUT /identity/v3/projects/3abab7c922bf4895a13ca93b3c5f6c14/users/c32f48349f2a4a7eaa37ebdb14c1366c/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:43:48.252954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e97ec-3974-4759-8dfa-b8b9a0d59353 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:48.253247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e97ec-3974-4759-8dfa-b8b9a0d59353 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:48.253521 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e97ec-3974-4759-8dfa-b8b9a0d59353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:48.280262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-bf3e97ec-3974-4759-8dfa-b8b9a0d59353 None None] MFA Rules not processed for user `c32f48349f2a4a7eaa37ebdb14c1366c`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:48.281458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bf3e97ec-3974-4759-8dfa-b8b9a0d59353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:48.300051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:48.352077 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1322/2587] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:48.362962 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39301e19-329d-45f4-8b8e-339460b03b8b admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:48.364751 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-39301e19-329d-45f4-8b8e-339460b03b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:48.423524 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39301e19-329d-45f4-8b8e-339460b03b8b admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:48.427073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ae4b2-16dd-4fa0-a954-3e95327dfa50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:48.427737 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ae4b2-16dd-4fa0-a954-3e95327dfa50 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:48.428015 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ae4b2-16dd-4fa0-a954-3e95327dfa50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:48.428285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ae4b2-16dd-4fa0-a954-3e95327dfa50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:48.437864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ae4b2-16dd-4fa0-a954-3e95327dfa50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:48.439293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ae4b2-16dd-4fa0-a954-3e95327dfa50 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:48.450073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1266/2588] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:48 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:48.521994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e97ec-3974-4759-8dfa-b8b9a0d59353 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:48.534343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e97ec-3974-4759-8dfa-b8b9a0d59353 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:48.538953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39695-04e6-4e4f-8684-584e2284e99f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:48.539721 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39695-04e6-4e4f-8684-584e2284e99f service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:48.540088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39695-04e6-4e4f-8684-584e2284e99f service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:48.540368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39695-04e6-4e4f-8684-584e2284e99f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:48.606634 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f39695-04e6-4e4f-8684-584e2284e99f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:48.608139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f39695-04e6-4e4f-8684-584e2284e99f service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:48.617343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1323/2589] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:51.337800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ae4b2-16dd-4fa0-a954-3e95327dfa50 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:51.339609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-3a9ae4b2-16dd-4fa0-a954-3e95327dfa50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:51.398332 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ae4b2-16dd-4fa0-a954-3e95327dfa50 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:51.401994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d4d54-0285-4f8f-8e54-5393fb5d58d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:51.402637 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d4d54-0285-4f8f-8e54-5393fb5d58d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:51.402921 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d4d54-0285-4f8f-8e54-5393fb5d58d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:51.403196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d4d54-0285-4f8f-8e54-5393fb5d58d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:51.405004 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-118d4d54-0285-4f8f-8e54-5393fb5d58d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:51.473265 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d4d54-0285-4f8f-8e54-5393fb5d58d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:51.475196 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d4d54-0285-4f8f-8e54-5393fb5d58d3 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:51.486794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1267/2590] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:52.703564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39695-04e6-4e4f-8684-584e2284e99f service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:52.770040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39695-04e6-4e4f-8684-584e2284e99f service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:52.774494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6828b5-7824-4e1e-acf6-7161084d26be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:52.775363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6828b5-7824-4e1e-acf6-7161084d26be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:52.775673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6828b5-7824-4e1e-acf6-7161084d26be admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:52.775952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6828b5-7824-4e1e-acf6-7161084d26be admin admin] PATH_INFO: `/v3/users/e2e684e6e5c54eaea365dcbcd863a6a1` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:52.777162 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6828b5-7824-4e1e-acf6-7161084d26be admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e684e6e5c54eaea365dcbcd863a6a1)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:52.779099 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6828b5-7824-4e1e-acf6-7161084d26be admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:52.828106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2f6828b5-7824-4e1e-acf6-7161084d26be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e684e6e5c54eaea365dcbcd863a6a1'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:52.835591 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:52.842075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2f6828b5-7824-4e1e-acf6-7161084d26be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e684e6e5c54eaea365dcbcd863a6a1'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:52.842821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2f6828b5-7824-4e1e-acf6-7161084d26be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e684e6e5c54eaea365dcbcd863a6a1'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:52.852655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2f6828b5-7824-4e1e-acf6-7161084d26be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e684e6e5c54eaea365dcbcd863a6a1'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:52.859721 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2f6828b5-7824-4e1e-acf6-7161084d26be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e684e6e5c54eaea365dcbcd863a6a1'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:52.866264 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1324/2591] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:43:52 2022] DELETE /identity/v3/users/e2e684e6e5c54eaea365dcbcd863a6a1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:52.871195 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c0cb5-1d1e-44b7-b0e9-6eb09c50655e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:52.871716 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c0cb5-1d1e-44b7-b0e9-6eb09c50655e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:52.871833 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c0cb5-1d1e-44b7-b0e9-6eb09c50655e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:52.878382 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:52.891420 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-636c0cb5-1d1e-44b7-b0e9-6eb09c50655e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:52.892898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-636c0cb5-1d1e-44b7-b0e9-6eb09c50655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:52.953497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1268/2592] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:52.963144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6828b5-7824-4e1e-acf6-7161084d26be admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:52.964605 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2f6828b5-7824-4e1e-acf6-7161084d26be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:53.027226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6828b5-7824-4e1e-acf6-7161084d26be admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:53.030803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b255b-8f2b-4e66-b5a4-21fa26b12877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:53.031456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b255b-8f2b-4e66-b5a4-21fa26b12877 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:53.031763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b255b-8f2b-4e66-b5a4-21fa26b12877 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:53.032037 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b255b-8f2b-4e66-b5a4-21fa26b12877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:53.041850 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b255b-8f2b-4e66-b5a4-21fa26b12877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:53.043994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b255b-8f2b-4e66-b5a4-21fa26b12877 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:53.066504 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1325/2593] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:53.752874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c0cb5-1d1e-44b7-b0e9-6eb09c50655e None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:53.754427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-636c0cb5-1d1e-44b7-b0e9-6eb09c50655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:53.767762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c0cb5-1d1e-44b7-b0e9-6eb09c50655e None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:53.773143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:53.774564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:53.774825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:53.775124 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] PATH_INFO: `/v3/projects/f6bdc59500184beb938a4809c198ff17` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:53.777273 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6bdc59500184beb938a4809c198ff17)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:53.779217 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:53.858741 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6bdc59500184beb938a4809c198ff17', 'request_id': 'req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:53.865653 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6bdc59500184beb938a4809c198ff17', 'request_id': 'req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:53.873295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6bdc59500184beb938a4809c198ff17', 'request_id': 'req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:53.890868 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] The token cache is being invalidate because project f6bdc59500184beb938a4809c198ff17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:43:53.891192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:53.891864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:53.893551 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1269/2594] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:43:53 2022] DELETE /identity/v3/projects/f6bdc59500184beb938a4809c198ff17 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:53.897616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b255b-8f2b-4e66-b5a4-21fa26b12877 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:53.908481 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b255b-8f2b-4e66-b5a4-21fa26b12877 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:53.978349 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1c072-d102-4578-81b4-fec2c05a42d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:53.979327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c072-d102-4578-81b4-fec2c05a42d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:53.979551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c072-d102-4578-81b4-fec2c05a42d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:53.979881 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c072-d102-4578-81b4-fec2c05a42d7 admin admin] PATH_INFO: `/v3/users/c32f48349f2a4a7eaa37ebdb14c1366c` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:53.981190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c072-d102-4578-81b4-fec2c05a42d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32f48349f2a4a7eaa37ebdb14c1366c)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:53.983138 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1c072-d102-4578-81b4-fec2c05a42d7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:54.066812 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2cd1c072-d102-4578-81b4-fec2c05a42d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32f48349f2a4a7eaa37ebdb14c1366c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:54.083038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2cd1c072-d102-4578-81b4-fec2c05a42d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32f48349f2a4a7eaa37ebdb14c1366c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:54.083849 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2cd1c072-d102-4578-81b4-fec2c05a42d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32f48349f2a4a7eaa37ebdb14c1366c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:54.091237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2cd1c072-d102-4578-81b4-fec2c05a42d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32f48349f2a4a7eaa37ebdb14c1366c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:54.095215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:54.102242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2cd1c072-d102-4578-81b4-fec2c05a42d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32f48349f2a4a7eaa37ebdb14c1366c'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:54.110873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1326/2595] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:43:53 2022] DELETE /identity/v3/users/c32f48349f2a4a7eaa37ebdb14c1366c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:54.406808 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:54.408570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:54.430589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7b8da-7f31-426e-8d8b-90886ed3c82f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:54.496414 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:54.497322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:54.497608 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:54.497882 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5 admin admin] PATH_INFO: `/v3/projects/3abab7c922bf4895a13ca93b3c5f6c14` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:54.499319 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abab7c922bf4895a13ca93b3c5f6c14)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:54.501385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:54.539532 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:54.556078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abab7c922bf4895a13ca93b3c5f6c14', 'request_id': 'req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:54.562815 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abab7c922bf4895a13ca93b3c5f6c14', 'request_id': 'req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:54.570531 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abab7c922bf4895a13ca93b3c5f6c14', 'request_id': 'req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:54.582876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5 admin admin] The token cache is being invalidate because project 3abab7c922bf4895a13ca93b3c5f6c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:43:54.583159 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:54.583849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-1837b7cb-d565-4c4a-a6f7-59f23fb220e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:54.585393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1270/2596] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:43:54 2022] DELETE /identity/v3/projects/3abab7c922bf4895a13ca93b3c5f6c14 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:54.591065 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06a22-7d28-4b2e-8089-8dd9d613db42 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:54.591409 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06a22-7d28-4b2e-8089-8dd9d613db42 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:54.591716 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b06a22-7d28-4b2e-8089-8dd9d613db42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:54.612280 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d6b06a22-7d28-4b2e-8089-8dd9d613db42 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:54.613847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d6b06a22-7d28-4b2e-8089-8dd9d613db42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:54.679970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1327/2597] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:54.690837 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177c0f0-f768-4c40-bf2a-56ecf37a323e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:54.691074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177c0f0-f768-4c40-bf2a-56ecf37a323e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:54.691301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177c0f0-f768-4c40-bf2a-56ecf37a323e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:54.709645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-1177c0f0-f768-4c40-bf2a-56ecf37a323e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:54.710859 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1177c0f0-f768-4c40-bf2a-56ecf37a323e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:54.720785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1271/2598] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:54.724995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b06a22-7d28-4b2e-8089-8dd9d613db42 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:54.735362 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b06a22-7d28-4b2e-8089-8dd9d613db42 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:54.740065 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d7ea9-df82-4567-bd99-73b0380052ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:54.740722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d7ea9-df82-4567-bd99-73b0380052ba admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:54.741005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d7ea9-df82-4567-bd99-73b0380052ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:54.741279 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d7ea9-df82-4567-bd99-73b0380052ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:54.742038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d7ea9-df82-4567-bd99-73b0380052ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:43:54.742343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d7ea9-df82-4567-bd99-73b0380052ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:54.743966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d7ea9-df82-4567-bd99-73b0380052ba admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:54.757037 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1328/2599] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:43:54.761456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177c0f0-f768-4c40-bf2a-56ecf37a323e None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:54.770865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177c0f0-f768-4c40-bf2a-56ecf37a323e None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:54.775417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d696d-3107-44a1-bbfc-e0aef4952ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:54.776191 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d696d-3107-44a1-bbfc-e0aef4952ecc admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:54.776472 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d696d-3107-44a1-bbfc-e0aef4952ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:54.776998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d696d-3107-44a1-bbfc-e0aef4952ecc admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:54.778111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d696d-3107-44a1-bbfc-e0aef4952ecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:54.780397 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d696d-3107-44a1-bbfc-e0aef4952ecc admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:54.805827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1272/2600] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:43:54 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:54.810589 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d7ea9-df82-4567-bd99-73b0380052ba admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:54.820964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d7ea9-df82-4567-bd99-73b0380052ba admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:54.879006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5671e16-d066-45e1-96f8-2608767d5a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:54.879697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5671e16-d066-45e1-96f8-2608767d5a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:54.880238 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5671e16-d066-45e1-96f8-2608767d5a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:54.880515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5671e16-d066-45e1-96f8-2608767d5a23 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:54.881200 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5671e16-d066-45e1-96f8-2608767d5a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:54.883096 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5671e16-d066-45e1-96f8-2608767d5a23 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:54.903880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1329/2601] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:43:54 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:54.907990 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d696d-3107-44a1-bbfc-e0aef4952ecc admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:54.918627 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d696d-3107-44a1-bbfc-e0aef4952ecc admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:54.923371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fe0c1-bea5-44ea-8bb1-5c9d5bfb7f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:54.924416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fe0c1-bea5-44ea-8bb1-5c9d5bfb7f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:54.924706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fe0c1-bea5-44ea-8bb1-5c9d5bfb7f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:54.924981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fe0c1-bea5-44ea-8bb1-5c9d5bfb7f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:54.925705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fe0c1-bea5-44ea-8bb1-5c9d5bfb7f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:54.927296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fe0c1-bea5-44ea-8bb1-5c9d5bfb7f31 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:54.937859 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1273/2602] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:54.942073 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5671e16-d066-45e1-96f8-2608767d5a23 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:54.952107 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5671e16-d066-45e1-96f8-2608767d5a23 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:54.956706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fef44-f66a-4693-8a46-a305ecee3324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:54.957356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fef44-f66a-4693-8a46-a305ecee3324 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:54.957638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fef44-f66a-4693-8a46-a305ecee3324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:54.957912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fef44-f66a-4693-8a46-a305ecee3324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:54.958628 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fef44-f66a-4693-8a46-a305ecee3324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:54.960240 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fef44-f66a-4693-8a46-a305ecee3324 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:54.970760 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1330/2603] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:54.975141 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fe0c1-bea5-44ea-8bb1-5c9d5bfb7f31 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:54.985973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fe0c1-bea5-44ea-8bb1-5c9d5bfb7f31 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:54.990598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405fd54-8b47-46a8-bc91-9505f9c28ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:54.991490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405fd54-8b47-46a8-bc91-9505f9c28ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:54.991802 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405fd54-8b47-46a8-bc91-9505f9c28ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:54.992082 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405fd54-8b47-46a8-bc91-9505f9c28ab6 admin admin] PATH_INFO: `/v3/projects/a4ca9bcc0df9425d8fe678b56a5de722/users/f9f9a7b731454a2f84be1a196232078e/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:55.007344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405fd54-8b47-46a8-bc91-9505f9c28ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ca9bcc0df9425d8fe678b56a5de722, user_id=f9f9a7b731454a2f84be1a196232078e, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:55.010225 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405fd54-8b47-46a8-bc91-9505f9c28ab6 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:55.023212 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1274/2604] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:54 2022] PUT /identity/v3/projects/a4ca9bcc0df9425d8fe678b56a5de722/users/f9f9a7b731454a2f84be1a196232078e/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:55.035050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e97258-cfa2-411c-85a9-e3728322509a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:55.035334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e97258-cfa2-411c-85a9-e3728322509a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:55.035746 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e97258-cfa2-411c-85a9-e3728322509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:55.064629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a5e97258-cfa2-411c-85a9-e3728322509a None None] MFA Rules not processed for user `f9f9a7b731454a2f84be1a196232078e`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:55.065930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a5e97258-cfa2-411c-85a9-e3728322509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:55.115434 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:55.134464 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1331/2605] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:55.138764 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405fd54-8b47-46a8-bc91-9505f9c28ab6 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:55.202077 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405fd54-8b47-46a8-bc91-9505f9c28ab6 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:55.206839 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd0c33-10e4-4a9d-ae5e-772c477aeaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:55.207697 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd0c33-10e4-4a9d-ae5e-772c477aeaab admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:55.208055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd0c33-10e4-4a9d-ae5e-772c477aeaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:55.208426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd0c33-10e4-4a9d-ae5e-772c477aeaab admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:55.209207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd0c33-10e4-4a9d-ae5e-772c477aeaab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:55.211233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd0c33-10e4-4a9d-ae5e-772c477aeaab admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:55.239503 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1275/2606] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:43:55 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:55.242501 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e97258-cfa2-411c-85a9-e3728322509a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:55.253615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e97258-cfa2-411c-85a9-e3728322509a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:55.314212 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc09d9-2291-49e3-9db3-fd7818205180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:55.314889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc09d9-2291-49e3-9db3-fd7818205180 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:55.315169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc09d9-2291-49e3-9db3-fd7818205180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:55.315442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc09d9-2291-49e3-9db3-fd7818205180 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:55.316153 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc09d9-2291-49e3-9db3-fd7818205180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:55.318111 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc09d9-2291-49e3-9db3-fd7818205180 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:55.337777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1332/2607] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:43:55 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:55.342323 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd0c33-10e4-4a9d-ae5e-772c477aeaab admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:55.352961 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd0c33-10e4-4a9d-ae5e-772c477aeaab admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:55.357651 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aea31-ec27-4429-93f1-4ef7194d1d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:55.358316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aea31-ec27-4429-93f1-4ef7194d1d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:55.358605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aea31-ec27-4429-93f1-4ef7194d1d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:55.358889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aea31-ec27-4429-93f1-4ef7194d1d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:55.359658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91aea31-ec27-4429-93f1-4ef7194d1d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:55.361272 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91aea31-ec27-4429-93f1-4ef7194d1d77 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:55.372387 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1276/2608] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:55.376577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc09d9-2291-49e3-9db3-fd7818205180 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:55.387868 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc09d9-2291-49e3-9db3-fd7818205180 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:55.392886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07502294-a203-43ae-b372-3e220c124d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:55.393771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07502294-a203-43ae-b372-3e220c124d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:55.394077 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07502294-a203-43ae-b372-3e220c124d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:55.394357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07502294-a203-43ae-b372-3e220c124d64 admin admin] PATH_INFO: `/v3/projects/bea7e7ca05be41e0832453b771ece31b/users/a664f3cebaf449288de60272a99f9fda/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:55.409636 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07502294-a203-43ae-b372-3e220c124d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea7e7ca05be41e0832453b771ece31b, user_id=a664f3cebaf449288de60272a99f9fda, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:55.412304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07502294-a203-43ae-b372-3e220c124d64 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:55.424678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1333/2609] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:55 2022] PUT /identity/v3/projects/bea7e7ca05be41e0832453b771ece31b/users/a664f3cebaf449288de60272a99f9fda/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:55.428721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aea31-ec27-4429-93f1-4ef7194d1d77 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:55.439447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aea31-ec27-4429-93f1-4ef7194d1d77 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:55.466299 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:55.499639 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853b141-8ae7-40a5-af9e-ead677208ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:55.500308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853b141-8ae7-40a5-af9e-ead677208ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:55.500594 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853b141-8ae7-40a5-af9e-ead677208ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:55.500865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853b141-8ae7-40a5-af9e-ead677208ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:55.501599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853b141-8ae7-40a5-af9e-ead677208ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:55.503176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853b141-8ae7-40a5-af9e-ead677208ca4 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:55.513153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1277/2610] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:55.517402 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07502294-a203-43ae-b372-3e220c124d64 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:55.527867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07502294-a203-43ae-b372-3e220c124d64 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:55.532511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ee2a8-8f6c-4306-8555-ae8d21d64d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:55.533384 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ee2a8-8f6c-4306-8555-ae8d21d64d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:55.533671 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ee2a8-8f6c-4306-8555-ae8d21d64d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:55.533945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ee2a8-8f6c-4306-8555-ae8d21d64d0b admin admin] PATH_INFO: `/v3/projects/bea7e7ca05be41e0832453b771ece31b/users/a664f3cebaf449288de60272a99f9fda/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:55.535962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ee2a8-8f6c-4306-8555-ae8d21d64d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea7e7ca05be41e0832453b771ece31b, user_id=a664f3cebaf449288de60272a99f9fda, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:55.538574 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ee2a8-8f6c-4306-8555-ae8d21d64d0b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:55.549734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1334/2611] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:55 2022] PUT /identity/v3/projects/bea7e7ca05be41e0832453b771ece31b/users/a664f3cebaf449288de60272a99f9fda/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:55.560782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc3c9a-2a84-449f-b95d-649b7056159d None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:55.561068 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc3c9a-2a84-449f-b95d-649b7056159d None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:55.561344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc3c9a-2a84-449f-b95d-649b7056159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:55.587109 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-c3bc3c9a-2a84-449f-b95d-649b7056159d None None] MFA Rules not processed for user `a664f3cebaf449288de60272a99f9fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:55.588347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c3bc3c9a-2a84-449f-b95d-649b7056159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:55.655700 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1278/2612] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:55.666362 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ee2a8-8f6c-4306-8555-ae8d21d64d0b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:55.668810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fa1ee2a8-8f6c-4306-8555-ae8d21d64d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:55.725824 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ee2a8-8f6c-4306-8555-ae8d21d64d0b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:55.729417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b24b6-07f2-4fb3-86a2-71cbe735bd3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:55.730641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b24b6-07f2-4fb3-86a2-71cbe735bd3d service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:55.730924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b24b6-07f2-4fb3-86a2-71cbe735bd3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:55.731200 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b24b6-07f2-4fb3-86a2-71cbe735bd3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:55.740148 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b24b6-07f2-4fb3-86a2-71cbe735bd3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:55.741574 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b24b6-07f2-4fb3-86a2-71cbe735bd3d service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:55.750923 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1335/2613] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:55.881168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc3c9a-2a84-449f-b95d-649b7056159d None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:55.941809 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc3c9a-2a84-449f-b95d-649b7056159d None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:55.946318 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7b86b-78d0-4eb2-bdba-8ba1a032a932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:55.947187 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7b86b-78d0-4eb2-bdba-8ba1a032a932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:55.947484 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7b86b-78d0-4eb2-bdba-8ba1a032a932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:55.947767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7b86b-78d0-4eb2-bdba-8ba1a032a932 admin admin] PATH_INFO: `/v3/users/f9f9a7b731454a2f84be1a196232078e` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:55.948954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7b86b-78d0-4eb2-bdba-8ba1a032a932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f9a7b731454a2f84be1a196232078e)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:55.951381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7b86b-78d0-4eb2-bdba-8ba1a032a932 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:55.996277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-eef7b86b-78d0-4eb2-bdba-8ba1a032a932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f9a7b731454a2f84be1a196232078e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.000921 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:56.009701 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-eef7b86b-78d0-4eb2-bdba-8ba1a032a932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f9a7b731454a2f84be1a196232078e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.010371 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-eef7b86b-78d0-4eb2-bdba-8ba1a032a932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f9a7b731454a2f84be1a196232078e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.017390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-eef7b86b-78d0-4eb2-bdba-8ba1a032a932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f9a7b731454a2f84be1a196232078e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.018185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-eef7b86b-78d0-4eb2-bdba-8ba1a032a932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f9a7b731454a2f84be1a196232078e'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.031016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1279/2614] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:43:55 2022] DELETE /identity/v3/users/f9f9a7b731454a2f84be1a196232078e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:43:56.035699 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f038e2-8f1e-47a6-83e8-580a5dd0f320 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:56.036265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f038e2-8f1e-47a6-83e8-580a5dd0f320 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:56.036265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f038e2-8f1e-47a6-83e8-580a5dd0f320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:56.053515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-09f038e2-8f1e-47a6-83e8-580a5dd0f320 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:56.054715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-09f038e2-8f1e-47a6-83e8-580a5dd0f320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:56.096718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:56.115719 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1336/2615] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:56.125299 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7b86b-78d0-4eb2-bdba-8ba1a032a932 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:56.126797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-eef7b86b-78d0-4eb2-bdba-8ba1a032a932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:56.183584 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7b86b-78d0-4eb2-bdba-8ba1a032a932 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:56.187257 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09e370-2798-46c0-8e10-69203a9d9a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:56.187934 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09e370-2798-46c0-8e10-69203a9d9a9f service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:56.188220 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09e370-2798-46c0-8e10-69203a9d9a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:56.188497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09e370-2798-46c0-8e10-69203a9d9a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:56.197543 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09e370-2798-46c0-8e10-69203a9d9a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:56.199550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09e370-2798-46c0-8e10-69203a9d9a9f service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:56.208944 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1280/2616] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:56.475865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f038e2-8f1e-47a6-83e8-580a5dd0f320 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:56.477432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-09f038e2-8f1e-47a6-83e8-580a5dd0f320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:56.499561 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f038e2-8f1e-47a6-83e8-580a5dd0f320 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:56.506744 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:56.507882 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:56.508345 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:56.508600 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] PATH_INFO: `/v3/projects/a4ca9bcc0df9425d8fe678b56a5de722` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:56.509893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ca9bcc0df9425d8fe678b56a5de722)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:56.512395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:56.560764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ca9bcc0df9425d8fe678b56a5de722', 'request_id': 'req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.566259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ca9bcc0df9425d8fe678b56a5de722', 'request_id': 'req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.574311 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ca9bcc0df9425d8fe678b56a5de722', 'request_id': 'req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.585315 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] The token cache is being invalidate because project a4ca9bcc0df9425d8fe678b56a5de722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:43:56.585601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.586222 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.587827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1337/2617] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:43:56 2022] DELETE /identity/v3/projects/a4ca9bcc0df9425d8fe678b56a5de722 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:43:56.592007 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09e370-2798-46c0-8e10-69203a9d9a9f service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:56.601942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09e370-2798-46c0-8e10-69203a9d9a9f service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:56.658711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc65aa-0ee3-4861-90db-b693cd3d8592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:56.659619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc65aa-0ee3-4861-90db-b693cd3d8592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:56.659898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc65aa-0ee3-4861-90db-b693cd3d8592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:56.660172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc65aa-0ee3-4861-90db-b693cd3d8592 admin admin] PATH_INFO: `/v3/users/a664f3cebaf449288de60272a99f9fda` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:56.661356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc65aa-0ee3-4861-90db-b693cd3d8592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a664f3cebaf449288de60272a99f9fda)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:56.663267 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc65aa-0ee3-4861-90db-b693cd3d8592 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:56.709000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6ebc65aa-0ee3-4861-90db-b693cd3d8592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a664f3cebaf449288de60272a99f9fda'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.720663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6ebc65aa-0ee3-4861-90db-b693cd3d8592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a664f3cebaf449288de60272a99f9fda'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.721317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6ebc65aa-0ee3-4861-90db-b693cd3d8592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a664f3cebaf449288de60272a99f9fda'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.728534 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6ebc65aa-0ee3-4861-90db-b693cd3d8592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a664f3cebaf449288de60272a99f9fda'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.730301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6ebc65aa-0ee3-4861-90db-b693cd3d8592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a664f3cebaf449288de60272a99f9fda'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:56.731771 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:56.743411 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1281/2618] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:43:56 2022] DELETE /identity/v3/users/a664f3cebaf449288de60272a99f9fda => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:57.010354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:57.011898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:57.025110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1222-1a58-41e5-b495-c0514b7cfdb3 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:57.082733 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8781815-ad6d-407d-8837-21eabaed8b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:57.083638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781815-ad6d-407d-8837-21eabaed8b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:57.083923 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781815-ad6d-407d-8837-21eabaed8b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:57.084197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8781815-ad6d-407d-8837-21eabaed8b5e admin admin] PATH_INFO: `/v3/projects/bea7e7ca05be41e0832453b771ece31b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:57.085368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8781815-ad6d-407d-8837-21eabaed8b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea7e7ca05be41e0832453b771ece31b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:57.087319 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8781815-ad6d-407d-8837-21eabaed8b5e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:57.132866 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a8781815-ad6d-407d-8837-21eabaed8b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea7e7ca05be41e0832453b771ece31b', 'request_id': 'req-a8781815-ad6d-407d-8837-21eabaed8b5e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:57.139152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a8781815-ad6d-407d-8837-21eabaed8b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea7e7ca05be41e0832453b771ece31b', 'request_id': 'req-a8781815-ad6d-407d-8837-21eabaed8b5e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:57.146593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a8781815-ad6d-407d-8837-21eabaed8b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea7e7ca05be41e0832453b771ece31b', 'request_id': 'req-a8781815-ad6d-407d-8837-21eabaed8b5e'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:57.154722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:57.158751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a8781815-ad6d-407d-8837-21eabaed8b5e admin admin] The token cache is being invalidate because project bea7e7ca05be41e0832453b771ece31b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:43:57.159397 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a8781815-ad6d-407d-8837-21eabaed8b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:57.160128 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-a8781815-ad6d-407d-8837-21eabaed8b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:57.161643 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1338/2619] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:43:57 2022] DELETE /identity/v3/projects/bea7e7ca05be41e0832453b771ece31b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:57.166706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aa5a7-d9ae-4fa7-bda7-4386797f2596 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:57.167236 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aa5a7-d9ae-4fa7-bda7-4386797f2596 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:57.167907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aa5a7-d9ae-4fa7-bda7-4386797f2596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:57.185106 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-de9aa5a7-d9ae-4fa7-bda7-4386797f2596 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:57.186320 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-de9aa5a7-d9ae-4fa7-bda7-4386797f2596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:57.245605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1282/2620] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:57.254779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db8123-29d8-4aa7-bf21-f0e778015b4a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:57.255502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db8123-29d8-4aa7-bf21-f0e778015b4a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:57.255789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db8123-29d8-4aa7-bf21-f0e778015b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:57.274121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-c7db8123-29d8-4aa7-bf21-f0e778015b4a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:57.275333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c7db8123-29d8-4aa7-bf21-f0e778015b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:57.283866 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1339/2621] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:57.288178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9aa5a7-d9ae-4fa7-bda7-4386797f2596 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:57.298731 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9aa5a7-d9ae-4fa7-bda7-4386797f2596 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:57.303332 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf0862-e54d-4edd-813e-4e4585a4639c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:57.304018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf0862-e54d-4edd-813e-4e4585a4639c admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:57.304296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf0862-e54d-4edd-813e-4e4585a4639c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:57.304674 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf0862-e54d-4edd-813e-4e4585a4639c admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:57.305515 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf0862-e54d-4edd-813e-4e4585a4639c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:43:57.305819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf0862-e54d-4edd-813e-4e4585a4639c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:57.307426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf0862-e54d-4edd-813e-4e4585a4639c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:57.319023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1283/2622] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:43:57.323400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db8123-29d8-4aa7-bf21-f0e778015b4a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:57.333144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db8123-29d8-4aa7-bf21-f0e778015b4a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:57.337864 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960abf5-de3e-42d8-b956-cee40499d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:57.338448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960abf5-de3e-42d8-b956-cee40499d52a admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:57.338732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960abf5-de3e-42d8-b956-cee40499d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:57.339009 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960abf5-de3e-42d8-b956-cee40499d52a admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:57.340259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960abf5-de3e-42d8-b956-cee40499d52a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:57.342103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960abf5-de3e-42d8-b956-cee40499d52a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:57.367395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1340/2623] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:43:57 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:57.371444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf0862-e54d-4edd-813e-4e4585a4639c admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:57.381835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf0862-e54d-4edd-813e-4e4585a4639c admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:57.436428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8e1b-5b91-43b7-bfdf-7b757fde25ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:57.437100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8e1b-5b91-43b7-bfdf-7b757fde25ae admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:57.437381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8e1b-5b91-43b7-bfdf-7b757fde25ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:57.437656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8e1b-5b91-43b7-bfdf-7b757fde25ae admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:57.438347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a8e1b-5b91-43b7-bfdf-7b757fde25ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:57.440306 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a8e1b-5b91-43b7-bfdf-7b757fde25ae admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:57.460407 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1284/2624] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:43:57 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:57.465244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960abf5-de3e-42d8-b956-cee40499d52a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:57.484375 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960abf5-de3e-42d8-b956-cee40499d52a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:57.489171 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ba087-bd8e-4804-a7ca-311263d23aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:57.489835 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ba087-bd8e-4804-a7ca-311263d23aef admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:57.490121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ba087-bd8e-4804-a7ca-311263d23aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:57.490406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ba087-bd8e-4804-a7ca-311263d23aef admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:57.491135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ba087-bd8e-4804-a7ca-311263d23aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:57.492774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ba087-bd8e-4804-a7ca-311263d23aef admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:57.503295 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1341/2625] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:57.507605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8e1b-5b91-43b7-bfdf-7b757fde25ae admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:57.518019 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8e1b-5b91-43b7-bfdf-7b757fde25ae admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:57.524354 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fc082-ae59-4610-98bb-ebc1439aee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:57.525117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fc082-ae59-4610-98bb-ebc1439aee47 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:57.525400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fc082-ae59-4610-98bb-ebc1439aee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:57.525710 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fc082-ae59-4610-98bb-ebc1439aee47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:57.527252 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fc082-ae59-4610-98bb-ebc1439aee47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:57.529105 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fc082-ae59-4610-98bb-ebc1439aee47 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:57.541074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1285/2626] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:57.545361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ba087-bd8e-4804-a7ca-311263d23aef admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:57.555408 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ba087-bd8e-4804-a7ca-311263d23aef admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:57.560087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b225547-ede2-40cc-b6e0-536daeb00bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:57.560958 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b225547-ede2-40cc-b6e0-536daeb00bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:57.561239 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b225547-ede2-40cc-b6e0-536daeb00bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:57.561509 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b225547-ede2-40cc-b6e0-536daeb00bd2 admin admin] PATH_INFO: `/v3/projects/be079782c3a34a27883960654302442e/users/662cf324bac84ebc82be9f52b1705db2/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:57.576699 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b225547-ede2-40cc-b6e0-536daeb00bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be079782c3a34a27883960654302442e, user_id=662cf324bac84ebc82be9f52b1705db2, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:57.579603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b225547-ede2-40cc-b6e0-536daeb00bd2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:57.593302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1342/2627] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:57 2022] PUT /identity/v3/projects/be079782c3a34a27883960654302442e/users/662cf324bac84ebc82be9f52b1705db2/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:57.603559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f207f6a-7f3e-4c61-b7ee-b5629cca3deb None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:57.603848 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f207f6a-7f3e-4c61-b7ee-b5629cca3deb None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:57.604125 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f207f6a-7f3e-4c61-b7ee-b5629cca3deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:57.630563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-5f207f6a-7f3e-4c61-b7ee-b5629cca3deb None None] MFA Rules not processed for user `662cf324bac84ebc82be9f52b1705db2`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:57.631809 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-5f207f6a-7f3e-4c61-b7ee-b5629cca3deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:57.675948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:57.695936 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1286/2628] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:57.701017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b225547-ede2-40cc-b6e0-536daeb00bd2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:57.761806 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b225547-ede2-40cc-b6e0-536daeb00bd2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:57.766356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc4aec-5c9c-47e7-8180-8e914903e8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:57.767002 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4aec-5c9c-47e7-8180-8e914903e8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:57.767281 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4aec-5c9c-47e7-8180-8e914903e8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:57.767583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4aec-5c9c-47e7-8180-8e914903e8e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:57.768278 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc4aec-5c9c-47e7-8180-8e914903e8e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:57.770150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc4aec-5c9c-47e7-8180-8e914903e8e9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:57.794841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1343/2629] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:43:57 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:57.799117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f207f6a-7f3e-4c61-b7ee-b5629cca3deb None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:57.811505 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f207f6a-7f3e-4c61-b7ee-b5629cca3deb None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:57.870205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e5fbf-6cb1-4499-9951-bcc6c6e91148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:57.871303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e5fbf-6cb1-4499-9951-bcc6c6e91148 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:57.871599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e5fbf-6cb1-4499-9951-bcc6c6e91148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:57.871875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e5fbf-6cb1-4499-9951-bcc6c6e91148 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:57.872556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e5fbf-6cb1-4499-9951-bcc6c6e91148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:57.874471 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e5fbf-6cb1-4499-9951-bcc6c6e91148 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:57.896518 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1287/2630] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:43:57 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:43:57.900973 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc4aec-5c9c-47e7-8180-8e914903e8e9 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:57.911577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc4aec-5c9c-47e7-8180-8e914903e8e9 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:57.916142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a2e7a-8cf2-4ba1-9813-6ffee482177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:57.916795 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a2e7a-8cf2-4ba1-9813-6ffee482177b admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:57.917077 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a2e7a-8cf2-4ba1-9813-6ffee482177b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:57.917355 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a2e7a-8cf2-4ba1-9813-6ffee482177b admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:57.918071 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a2e7a-8cf2-4ba1-9813-6ffee482177b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:57.919678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a2e7a-8cf2-4ba1-9813-6ffee482177b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:57.930054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1344/2631] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:43:57.934849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e5fbf-6cb1-4499-9951-bcc6c6e91148 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:57.944943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e5fbf-6cb1-4499-9951-bcc6c6e91148 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:57.950297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea644323-ef6f-4e29-a8ab-d7f2919c6b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:57.951179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644323-ef6f-4e29-a8ab-d7f2919c6b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:57.951475 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644323-ef6f-4e29-a8ab-d7f2919c6b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:57.951767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644323-ef6f-4e29-a8ab-d7f2919c6b02 admin admin] PATH_INFO: `/v3/projects/1c3d8333b596477c8738e4ae38d7d9ea/users/d77031d602eb4d67ba51007c80886d20/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:57.966516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea644323-ef6f-4e29-a8ab-d7f2919c6b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3d8333b596477c8738e4ae38d7d9ea, user_id=d77031d602eb4d67ba51007c80886d20, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:57.969262 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea644323-ef6f-4e29-a8ab-d7f2919c6b02 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:57.982795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1288/2632] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:57 2022] PUT /identity/v3/projects/1c3d8333b596477c8738e4ae38d7d9ea/users/d77031d602eb4d67ba51007c80886d20/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:57.986958 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a2e7a-8cf2-4ba1-9813-6ffee482177b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:57.997656 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a2e7a-8cf2-4ba1-9813-6ffee482177b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:58.053768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f841491-148b-4eee-83c7-d5b26e2fc4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:58.054425 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f841491-148b-4eee-83c7-d5b26e2fc4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:58.054900 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f841491-148b-4eee-83c7-d5b26e2fc4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:58.055263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f841491-148b-4eee-83c7-d5b26e2fc4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:58.056022 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f841491-148b-4eee-83c7-d5b26e2fc4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:58.057618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f841491-148b-4eee-83c7-d5b26e2fc4a3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:58.069756 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1345/2633] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:43:58.074427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea644323-ef6f-4e29-a8ab-d7f2919c6b02 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:58.084794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea644323-ef6f-4e29-a8ab-d7f2919c6b02 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:58.089405 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcccbc-c11c-4d62-bb21-34758f442797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:58.090282 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcccbc-c11c-4d62-bb21-34758f442797 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:58.090564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcccbc-c11c-4d62-bb21-34758f442797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:58.090836 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcccbc-c11c-4d62-bb21-34758f442797 admin admin] PATH_INFO: `/v3/projects/1c3d8333b596477c8738e4ae38d7d9ea/users/d77031d602eb4d67ba51007c80886d20/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:58.092816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcccbc-c11c-4d62-bb21-34758f442797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3d8333b596477c8738e4ae38d7d9ea, user_id=d77031d602eb4d67ba51007c80886d20, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:58.095417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcccbc-c11c-4d62-bb21-34758f442797 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:58.106099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1289/2634] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:43:58 2022] PUT /identity/v3/projects/1c3d8333b596477c8738e4ae38d7d9ea/users/d77031d602eb4d67ba51007c80886d20/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:58.116292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31efb2-097f-475b-bd84-c4d22b561c82 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:58.116766 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31efb2-097f-475b-bd84-c4d22b561c82 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:58.116888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31efb2-097f-475b-bd84-c4d22b561c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:58.130657 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:58.146390 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-cf31efb2-097f-475b-bd84-c4d22b561c82 None None] MFA Rules not processed for user `d77031d602eb4d67ba51007c80886d20`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:58.147657 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cf31efb2-097f-475b-bd84-c4d22b561c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:58.214237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1346/2635] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:58.225426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcccbc-c11c-4d62-bb21-34758f442797 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:58.227178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-81fcccbc-c11c-4d62-bb21-34758f442797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:58.284171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcccbc-c11c-4d62-bb21-34758f442797 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:58.287887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a5ad1-8bab-4836-a240-909ae2f86cf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:58.288530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a5ad1-8bab-4836-a240-909ae2f86cf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:58.288818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a5ad1-8bab-4836-a240-909ae2f86cf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:58.289098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a5ad1-8bab-4836-a240-909ae2f86cf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:58.298589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a5ad1-8bab-4836-a240-909ae2f86cf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:58.300052 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a5ad1-8bab-4836-a240-909ae2f86cf9 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:58.310185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1290/2636] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:58.847562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31efb2-097f-475b-bd84-c4d22b561c82 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:58.910543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31efb2-097f-475b-bd84-c4d22b561c82 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:58.915117 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be43c2-6504-4c8c-822d-6b76f7eab2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:58.916061 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be43c2-6504-4c8c-822d-6b76f7eab2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:58.916291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be43c2-6504-4c8c-822d-6b76f7eab2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:58.916568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be43c2-6504-4c8c-822d-6b76f7eab2d7 admin admin] PATH_INFO: `/v3/users/662cf324bac84ebc82be9f52b1705db2` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:58.918370 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be43c2-6504-4c8c-822d-6b76f7eab2d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=662cf324bac84ebc82be9f52b1705db2)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:58.920334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be43c2-6504-4c8c-822d-6b76f7eab2d7 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:58.967651 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-46be43c2-6504-4c8c-822d-6b76f7eab2d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662cf324bac84ebc82be9f52b1705db2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:58.979490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-46be43c2-6504-4c8c-822d-6b76f7eab2d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662cf324bac84ebc82be9f52b1705db2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:58.980169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-46be43c2-6504-4c8c-822d-6b76f7eab2d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662cf324bac84ebc82be9f52b1705db2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:58.987005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-46be43c2-6504-4c8c-822d-6b76f7eab2d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662cf324bac84ebc82be9f52b1705db2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:58.994470 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-46be43c2-6504-4c8c-822d-6b76f7eab2d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662cf324bac84ebc82be9f52b1705db2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:59.001083 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1347/2637] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:43:58 2022] DELETE /identity/v3/users/662cf324bac84ebc82be9f52b1705db2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:59.005890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4460d-6636-4e4c-a571-c8aac6c5d763 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:59.006180 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4460d-6636-4e4c-a571-c8aac6c5d763 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:59.006460 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4460d-6636-4e4c-a571-c8aac6c5d763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:59.024161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-31a4460d-6636-4e4c-a571-c8aac6c5d763 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:43:59.025365 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-31a4460d-6636-4e4c-a571-c8aac6c5d763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:59.062496 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:59.084483 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1291/2638] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:43:59.094560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be43c2-6504-4c8c-822d-6b76f7eab2d7 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:59.096006 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-46be43c2-6504-4c8c-822d-6b76f7eab2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:59.109550 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:43:59.157050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be43c2-6504-4c8c-822d-6b76f7eab2d7 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:59.160844 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5bbe3-3ff6-46ab-9cac-84945dfe70cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:59.161499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5bbe3-3ff6-46ab-9cac-84945dfe70cf service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:59.161784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5bbe3-3ff6-46ab-9cac-84945dfe70cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:59.162061 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5bbe3-3ff6-46ab-9cac-84945dfe70cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:59.171334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5bbe3-3ff6-46ab-9cac-84945dfe70cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:59.172779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5bbe3-3ff6-46ab-9cac-84945dfe70cf service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:59.182187 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1348/2639] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:43:59.443664 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4460d-6636-4e4c-a571-c8aac6c5d763 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:59.445223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-31a4460d-6636-4e4c-a571-c8aac6c5d763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:59.459111 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4460d-6636-4e4c-a571-c8aac6c5d763 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:59.463788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:59.464648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:59.464931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:59.465205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] PATH_INFO: `/v3/projects/be079782c3a34a27883960654302442e` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:59.466379 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be079782c3a34a27883960654302442e)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:59.468982 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:59.517036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be079782c3a34a27883960654302442e', 'request_id': 'req-14e26b98-df77-4851-9738-358fe6d0e47f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:59.523512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be079782c3a34a27883960654302442e', 'request_id': 'req-14e26b98-df77-4851-9738-358fe6d0e47f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:59.529696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be079782c3a34a27883960654302442e', 'request_id': 'req-14e26b98-df77-4851-9738-358fe6d0e47f'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:59.541807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] The token cache is being invalidate because project be079782c3a34a27883960654302442e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:43:59.542099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:59.542721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:59.544598 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1292/2640] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:43:59 2022] DELETE /identity/v3/projects/be079782c3a34a27883960654302442e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:59.548681 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5bbe3-3ff6-46ab-9cac-84945dfe70cf service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:59.559243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5bbe3-3ff6-46ab-9cac-84945dfe70cf service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:43:59.614873 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f84ec9-2ccc-4cf6-8ac7-a9b5c4f67244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:43:59.615772 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f84ec9-2ccc-4cf6-8ac7-a9b5c4f67244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:43:59.616058 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f84ec9-2ccc-4cf6-8ac7-a9b5c4f67244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:43:59.616339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f84ec9-2ccc-4cf6-8ac7-a9b5c4f67244 admin admin] PATH_INFO: `/v3/users/d77031d602eb4d67ba51007c80886d20` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:43:59.617529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f84ec9-2ccc-4cf6-8ac7-a9b5c4f67244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77031d602eb4d67ba51007c80886d20)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:43:59.619442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f84ec9-2ccc-4cf6-8ac7-a9b5c4f67244 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:43:59.667896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c3f84ec9-2ccc-4cf6-8ac7-a9b5c4f67244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77031d602eb4d67ba51007c80886d20'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:59.679987 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c3f84ec9-2ccc-4cf6-8ac7-a9b5c4f67244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77031d602eb4d67ba51007c80886d20'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:59.680682 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c3f84ec9-2ccc-4cf6-8ac7-a9b5c4f67244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77031d602eb4d67ba51007c80886d20'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:59.688180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c3f84ec9-2ccc-4cf6-8ac7-a9b5c4f67244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77031d602eb4d67ba51007c80886d20'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:59.695923 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-c3f84ec9-2ccc-4cf6-8ac7-a9b5c4f67244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77031d602eb4d67ba51007c80886d20'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:43:59.702983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1349/2641] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:43:59 2022] DELETE /identity/v3/users/d77031d602eb4d67ba51007c80886d20 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:43:59.979128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:43:59.981266 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:43:59.994586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e26b98-df77-4851-9738-358fe6d0e47f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:00.053113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018e00d-11a4-4e80-bd2f-31140d65f0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:00.053975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018e00d-11a4-4e80-bd2f-31140d65f0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:00.054254 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018e00d-11a4-4e80-bd2f-31140d65f0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:00.054527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018e00d-11a4-4e80-bd2f-31140d65f0ec admin admin] PATH_INFO: `/v3/projects/1c3d8333b596477c8738e4ae38d7d9ea` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:00.055797 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018e00d-11a4-4e80-bd2f-31140d65f0ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3d8333b596477c8738e4ae38d7d9ea)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:00.057695 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018e00d-11a4-4e80-bd2f-31140d65f0ec admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:00.103886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a018e00d-11a4-4e80-bd2f-31140d65f0ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3d8333b596477c8738e4ae38d7d9ea', 'request_id': 'req-a018e00d-11a4-4e80-bd2f-31140d65f0ec'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:00.110492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a018e00d-11a4-4e80-bd2f-31140d65f0ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3d8333b596477c8738e4ae38d7d9ea', 'request_id': 'req-a018e00d-11a4-4e80-bd2f-31140d65f0ec'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:00.115969 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a018e00d-11a4-4e80-bd2f-31140d65f0ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3d8333b596477c8738e4ae38d7d9ea', 'request_id': 'req-a018e00d-11a4-4e80-bd2f-31140d65f0ec'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:00.119443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:00.130168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a018e00d-11a4-4e80-bd2f-31140d65f0ec admin admin] The token cache is being invalidate because project 1c3d8333b596477c8738e4ae38d7d9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:00.130467 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a018e00d-11a4-4e80-bd2f-31140d65f0ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:00.131424 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a018e00d-11a4-4e80-bd2f-31140d65f0ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:00.133234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1293/2642] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:43:59 2022] DELETE /identity/v3/projects/1c3d8333b596477c8738e4ae38d7d9ea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:00.138134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e55734-8447-476e-9f4c-8cfc4140665f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:00.138430 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e55734-8447-476e-9f4c-8cfc4140665f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:00.138713 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e55734-8447-476e-9f4c-8cfc4140665f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:00.157647 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d2e55734-8447-476e-9f4c-8cfc4140665f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:00.158859 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d2e55734-8447-476e-9f4c-8cfc4140665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:00.188032 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:00.220092 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1350/2643] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:00.228785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170bdc0-aa02-40cd-9cad-2d6831f0e48b None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:00.229015 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170bdc0-aa02-40cd-9cad-2d6831f0e48b None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:00.229296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170bdc0-aa02-40cd-9cad-2d6831f0e48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:00.247782 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-f170bdc0-aa02-40cd-9cad-2d6831f0e48b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:00.248985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f170bdc0-aa02-40cd-9cad-2d6831f0e48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:00.257243 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1294/2644] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:44:00.261479 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e55734-8447-476e-9f4c-8cfc4140665f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:00.271255 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e55734-8447-476e-9f4c-8cfc4140665f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:00.275859 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877913e-748b-45a5-9de3-b00676d5643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:00.276512 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877913e-748b-45a5-9de3-b00676d5643e admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:00.277302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877913e-748b-45a5-9de3-b00676d5643e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:00.277583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877913e-748b-45a5-9de3-b00676d5643e admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:00.278308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877913e-748b-45a5-9de3-b00676d5643e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:44:00.278664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877913e-748b-45a5-9de3-b00676d5643e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:00.280283 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877913e-748b-45a5-9de3-b00676d5643e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:00.296243 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1351/2645] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:44:00.300619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170bdc0-aa02-40cd-9cad-2d6831f0e48b None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:00.310080 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170bdc0-aa02-40cd-9cad-2d6831f0e48b None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:00.315011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636fcc9-1402-4e2d-b67f-399071d8dd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:00.315696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636fcc9-1402-4e2d-b67f-399071d8dd5c admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:00.315980 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636fcc9-1402-4e2d-b67f-399071d8dd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:00.316256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636fcc9-1402-4e2d-b67f-399071d8dd5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:00.316941 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636fcc9-1402-4e2d-b67f-399071d8dd5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:00.318832 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636fcc9-1402-4e2d-b67f-399071d8dd5c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:00.347657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1295/2646] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:44:00 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:00.351875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877913e-748b-45a5-9de3-b00676d5643e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:00.362674 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877913e-748b-45a5-9de3-b00676d5643e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:00.418030 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dc8f6-1290-4155-9d27-fdd9cca94cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:00.418698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dc8f6-1290-4155-9d27-fdd9cca94cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:00.418983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dc8f6-1290-4155-9d27-fdd9cca94cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:00.419258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dc8f6-1290-4155-9d27-fdd9cca94cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:00.419980 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dc8f6-1290-4155-9d27-fdd9cca94cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:00.421883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dc8f6-1290-4155-9d27-fdd9cca94cd0 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:00.441865 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1352/2647] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:44:00 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:00.446155 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636fcc9-1402-4e2d-b67f-399071d8dd5c admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:00.457100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636fcc9-1402-4e2d-b67f-399071d8dd5c admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:00.461657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd421c09-0f7d-4191-8551-d963e25b3afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:00.462311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd421c09-0f7d-4191-8551-d963e25b3afb admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:00.462592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd421c09-0f7d-4191-8551-d963e25b3afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:00.462864 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd421c09-0f7d-4191-8551-d963e25b3afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:00.463646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd421c09-0f7d-4191-8551-d963e25b3afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:00.465778 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd421c09-0f7d-4191-8551-d963e25b3afb admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:00.476028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1296/2648] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:00.479801 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dc8f6-1290-4155-9d27-fdd9cca94cd0 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:00.489666 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dc8f6-1290-4155-9d27-fdd9cca94cd0 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:00.494291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcfabd-5aae-4f14-a6ef-b9ea74484ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:00.494943 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcfabd-5aae-4f14-a6ef-b9ea74484ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:00.495223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcfabd-5aae-4f14-a6ef-b9ea74484ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:00.495549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcfabd-5aae-4f14-a6ef-b9ea74484ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:00.496294 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcfabd-5aae-4f14-a6ef-b9ea74484ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:00.497864 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcfabd-5aae-4f14-a6ef-b9ea74484ee6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:00.508140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1353/2649] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:44:00.512658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd421c09-0f7d-4191-8551-d963e25b3afb admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:00.522538 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd421c09-0f7d-4191-8551-d963e25b3afb admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:00.527755 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613dfda-8f3b-42ff-9cb2-c8811cac7de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:00.528634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613dfda-8f3b-42ff-9cb2-c8811cac7de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:00.528913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613dfda-8f3b-42ff-9cb2-c8811cac7de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:00.529181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613dfda-8f3b-42ff-9cb2-c8811cac7de8 admin admin] PATH_INFO: `/v3/projects/55a31f7d97744983bb64d3f6a9f4cffd/users/cbbddedb90284b37b4a819ec234453e3/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:00.543380 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613dfda-8f3b-42ff-9cb2-c8811cac7de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a31f7d97744983bb64d3f6a9f4cffd, user_id=cbbddedb90284b37b4a819ec234453e3, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:00.546062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613dfda-8f3b-42ff-9cb2-c8811cac7de8 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:00.558242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1297/2650] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:00 2022] PUT /identity/v3/projects/55a31f7d97744983bb64d3f6a9f4cffd/users/cbbddedb90284b37b4a819ec234453e3/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:44:00.568344 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627434f-0e36-40f5-98a0-44ce3466ae09 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:00.568649 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627434f-0e36-40f5-98a0-44ce3466ae09 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:00.568926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627434f-0e36-40f5-98a0-44ce3466ae09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:00.596183 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8627434f-0e36-40f5-98a0-44ce3466ae09 None None] MFA Rules not processed for user `cbbddedb90284b37b4a819ec234453e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:00.597377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8627434f-0e36-40f5-98a0-44ce3466ae09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:00.663519 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1354/2651] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:00.674333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613dfda-8f3b-42ff-9cb2-c8811cac7de8 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:00.676849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-1613dfda-8f3b-42ff-9cb2-c8811cac7de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:00.733251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613dfda-8f3b-42ff-9cb2-c8811cac7de8 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:00.736827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5180df-92e4-4910-b63f-3868df5319fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:00.737467 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5180df-92e4-4910-b63f-3868df5319fd service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:00.737746 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5180df-92e4-4910-b63f-3868df5319fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:00.738018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5180df-92e4-4910-b63f-3868df5319fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:00.746211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5180df-92e4-4910-b63f-3868df5319fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:00.747655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5180df-92e4-4910-b63f-3868df5319fd service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:00.756509 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1298/2652] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:06.019396 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627434f-0e36-40f5-98a0-44ce3466ae09 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:06.050254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:06.083714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627434f-0e36-40f5-98a0-44ce3466ae09 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:06.088130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ca241-71d2-400c-8332-1f78032df70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:06.088998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ca241-71d2-400c-8332-1f78032df70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:06.089277 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ca241-71d2-400c-8332-1f78032df70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:06.089547 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ca241-71d2-400c-8332-1f78032df70f admin admin] PATH_INFO: `/v3/users/cbbddedb90284b37b4a819ec234453e3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:06.090714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ca241-71d2-400c-8332-1f78032df70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbbddedb90284b37b4a819ec234453e3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:06.092629 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ca241-71d2-400c-8332-1f78032df70f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:06.140528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2d2ca241-71d2-400c-8332-1f78032df70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbbddedb90284b37b4a819ec234453e3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:06.152649 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2d2ca241-71d2-400c-8332-1f78032df70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbbddedb90284b37b4a819ec234453e3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:06.153345 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2d2ca241-71d2-400c-8332-1f78032df70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbbddedb90284b37b4a819ec234453e3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:06.160141 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2d2ca241-71d2-400c-8332-1f78032df70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbbddedb90284b37b4a819ec234453e3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:06.167491 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2d2ca241-71d2-400c-8332-1f78032df70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbbddedb90284b37b4a819ec234453e3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:06.173446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1355/2653] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:44:06 2022] DELETE /identity/v3/users/cbbddedb90284b37b4a819ec234453e3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:06.178034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9b811-2c3c-4499-924c-f9ab0426ce14 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:06.178522 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9b811-2c3c-4499-924c-f9ab0426ce14 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:06.178621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9b811-2c3c-4499-924c-f9ab0426ce14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:06.195694 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-36f9b811-2c3c-4499-924c-f9ab0426ce14 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:06.196913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-36f9b811-2c3c-4499-924c-f9ab0426ce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:06.256327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1299/2654] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:06.266444 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ca241-71d2-400c-8332-1f78032df70f admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:06.267992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2d2ca241-71d2-400c-8332-1f78032df70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:06.325893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ca241-71d2-400c-8332-1f78032df70f admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:06.329561 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789df369-acce-468a-b08a-9c2cf753ea78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:06.330282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789df369-acce-468a-b08a-9c2cf753ea78 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:06.330567 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789df369-acce-468a-b08a-9c2cf753ea78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:06.330852 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789df369-acce-468a-b08a-9c2cf753ea78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:06.339996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789df369-acce-468a-b08a-9c2cf753ea78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:06.341431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789df369-acce-468a-b08a-9c2cf753ea78 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:06.350846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1356/2655] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:06.617090 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9b811-2c3c-4499-924c-f9ab0426ce14 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:06.618707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-36f9b811-2c3c-4499-924c-f9ab0426ce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:06.633471 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9b811-2c3c-4499-924c-f9ab0426ce14 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:06.638292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96056e96-42a0-451f-9bc1-a7c721699439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:06.639245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056e96-42a0-451f-9bc1-a7c721699439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:06.639590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056e96-42a0-451f-9bc1-a7c721699439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:06.639876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056e96-42a0-451f-9bc1-a7c721699439 admin admin] PATH_INFO: `/v3/projects/55a31f7d97744983bb64d3f6a9f4cffd` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:06.641073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96056e96-42a0-451f-9bc1-a7c721699439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a31f7d97744983bb64d3f6a9f4cffd)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:06.643302 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96056e96-42a0-451f-9bc1-a7c721699439 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:06.677816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:06.692671 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-96056e96-42a0-451f-9bc1-a7c721699439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a31f7d97744983bb64d3f6a9f4cffd', 'request_id': 'req-96056e96-42a0-451f-9bc1-a7c721699439'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:06.698759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-96056e96-42a0-451f-9bc1-a7c721699439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a31f7d97744983bb64d3f6a9f4cffd', 'request_id': 'req-96056e96-42a0-451f-9bc1-a7c721699439'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:06.704379 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-96056e96-42a0-451f-9bc1-a7c721699439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a31f7d97744983bb64d3f6a9f4cffd', 'request_id': 'req-96056e96-42a0-451f-9bc1-a7c721699439'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:06.716266 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-96056e96-42a0-451f-9bc1-a7c721699439 admin admin] The token cache is being invalidate because project 55a31f7d97744983bb64d3f6a9f4cffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:06.716556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-96056e96-42a0-451f-9bc1-a7c721699439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:06.717176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-96056e96-42a0-451f-9bc1-a7c721699439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:06.718711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1300/2656] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:44:06 2022] DELETE /identity/v3/projects/55a31f7d97744983bb64d3f6a9f4cffd => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:06.723627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820daab4-d213-46a8-826c-5fbf340b8e23 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:06.723919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820daab4-d213-46a8-826c-5fbf340b8e23 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:06.724194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820daab4-d213-46a8-826c-5fbf340b8e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:06.743627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-820daab4-d213-46a8-826c-5fbf340b8e23 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:06.744830 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-820daab4-d213-46a8-826c-5fbf340b8e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:06.789633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:06.806038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1357/2657] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:06.816817 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071909ce-59ca-42b6-9fcd-7ba79cc4d6d9 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:06.817107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071909ce-59ca-42b6-9fcd-7ba79cc4d6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:06.817389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071909ce-59ca-42b6-9fcd-7ba79cc4d6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:06.835799 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-071909ce-59ca-42b6-9fcd-7ba79cc4d6d9 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:06.837009 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-071909ce-59ca-42b6-9fcd-7ba79cc4d6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:06.845668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1301/2658] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:06.849776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820daab4-d213-46a8-826c-5fbf340b8e23 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:06.860121 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820daab4-d213-46a8-826c-5fbf340b8e23 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:06.864652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40514df1-7f0a-4ef7-8e41-f3928af0b9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:06.865298 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514df1-7f0a-4ef7-8e41-f3928af0b9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:06.865577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514df1-7f0a-4ef7-8e41-f3928af0b9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:06.865849 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514df1-7f0a-4ef7-8e41-f3928af0b9d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:06.866566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40514df1-7f0a-4ef7-8e41-f3928af0b9d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:44:06.866871 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40514df1-7f0a-4ef7-8e41-f3928af0b9d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:06.868498 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40514df1-7f0a-4ef7-8e41-f3928af0b9d9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:06.880594 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1358/2659] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:44:06.884955 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071909ce-59ca-42b6-9fcd-7ba79cc4d6d9 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:06.894378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071909ce-59ca-42b6-9fcd-7ba79cc4d6d9 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:06.899063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f537371-43fe-4415-ad3b-674861fc477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:06.899747 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f537371-43fe-4415-ad3b-674861fc477e admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:06.900031 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f537371-43fe-4415-ad3b-674861fc477e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:06.900305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f537371-43fe-4415-ad3b-674861fc477e admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:06.900989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f537371-43fe-4415-ad3b-674861fc477e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:06.903378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f537371-43fe-4415-ad3b-674861fc477e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:06.929504 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1302/2660] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:44:06 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:06.933639 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40514df1-7f0a-4ef7-8e41-f3928af0b9d9 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:06.943875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40514df1-7f0a-4ef7-8e41-f3928af0b9d9 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:07.001706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa2153-b84d-42c9-a2b6-0b858df7bf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:07.002374 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa2153-b84d-42c9-a2b6-0b858df7bf77 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:07.002652 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa2153-b84d-42c9-a2b6-0b858df7bf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:07.002925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa2153-b84d-42c9-a2b6-0b858df7bf77 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:07.003632 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa2153-b84d-42c9-a2b6-0b858df7bf77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:07.005808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa2153-b84d-42c9-a2b6-0b858df7bf77 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:07.030036 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1359/2661] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:44:06 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:44:07.034035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f537371-43fe-4415-ad3b-674861fc477e admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:07.045008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f537371-43fe-4415-ad3b-674861fc477e admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:07.049726 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437ca2d-5417-41ea-a771-08cf5f30bb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:07.050387 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ca2d-5417-41ea-a771-08cf5f30bb5f admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:07.050672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ca2d-5417-41ea-a771-08cf5f30bb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:07.050949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ca2d-5417-41ea-a771-08cf5f30bb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:07.051720 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437ca2d-5417-41ea-a771-08cf5f30bb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:07.053322 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437ca2d-5417-41ea-a771-08cf5f30bb5f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:07.063800 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1303/2662] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:44:07.068075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa2153-b84d-42c9-a2b6-0b858df7bf77 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:07.078011 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa2153-b84d-42c9-a2b6-0b858df7bf77 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:07.082566 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95b76e-5635-4f35-b1b8-869dad8687ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:07.083214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95b76e-5635-4f35-b1b8-869dad8687ca admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:07.083524 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95b76e-5635-4f35-b1b8-869dad8687ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:07.083802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95b76e-5635-4f35-b1b8-869dad8687ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:07.084520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95b76e-5635-4f35-b1b8-869dad8687ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:07.086098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95b76e-5635-4f35-b1b8-869dad8687ca admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:07.096384 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1360/2663] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:07.100360 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437ca2d-5417-41ea-a771-08cf5f30bb5f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:07.110756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437ca2d-5417-41ea-a771-08cf5f30bb5f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:07.115291 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f96bd4-2d28-4fcd-838c-5e9f84f2b794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:07.116192 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f96bd4-2d28-4fcd-838c-5e9f84f2b794 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:07.116466 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f96bd4-2d28-4fcd-838c-5e9f84f2b794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:07.116733 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f96bd4-2d28-4fcd-838c-5e9f84f2b794 admin admin] PATH_INFO: `/v3/projects/6aa9a34bdf934a23859ca9c665aef44e/users/a17c22ca260548dd9c27ad47c8e361fb/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:07.131932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f96bd4-2d28-4fcd-838c-5e9f84f2b794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa9a34bdf934a23859ca9c665aef44e, user_id=a17c22ca260548dd9c27ad47c8e361fb, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:07.134618 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f96bd4-2d28-4fcd-838c-5e9f84f2b794 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:07.147445 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1304/2664] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:07 2022] PUT /identity/v3/projects/6aa9a34bdf934a23859ca9c665aef44e/users/a17c22ca260548dd9c27ad47c8e361fb/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:07.158990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34e268-cc1e-4594-ad8b-f045a1b1f802 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:07.159304 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34e268-cc1e-4594-ad8b-f045a1b1f802 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:07.159619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34e268-cc1e-4594-ad8b-f045a1b1f802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:07.185946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9e34e268-cc1e-4594-ad8b-f045a1b1f802 None None] MFA Rules not processed for user `a17c22ca260548dd9c27ad47c8e361fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:07.187148 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9e34e268-cc1e-4594-ad8b-f045a1b1f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:07.249633 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1361/2665] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:07.261278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f96bd4-2d28-4fcd-838c-5e9f84f2b794 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:07.263583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-36f96bd4-2d28-4fcd-838c-5e9f84f2b794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:07.320278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f96bd4-2d28-4fcd-838c-5e9f84f2b794 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:07.323889 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa159c-d6de-445d-a5cd-0e4aef9e056d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f1b06364a24554bba9936621127752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:07.325038 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa159c-d6de-445d-a5cd-0e4aef9e056d service glance] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:07.325324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa159c-d6de-445d-a5cd-0e4aef9e056d service glance] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:07.325603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa159c-d6de-445d-a5cd-0e4aef9e056d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:07.333817 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa159c-d6de-445d-a5cd-0e4aef9e056d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:07.335245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa159c-d6de-445d-a5cd-0e4aef9e056d service glance] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:07.344571 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1305/2666] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:17.246794 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=76,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:17.340024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:33.147297 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34e268-cc1e-4594-ad8b-f045a1b1f802 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:33.148737 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9e34e268-cc1e-4594-ad8b-f045a1b1f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:33.205272 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34e268-cc1e-4594-ad8b-f045a1b1f802 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:33.208887 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd8fc3-304b-4680-9165-cba46b6ae73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:33.209529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd8fc3-304b-4680-9165-cba46b6ae73c service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:33.209813 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd8fc3-304b-4680-9165-cba46b6ae73c service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:33.210091 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd8fc3-304b-4680-9165-cba46b6ae73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:33.211879 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bcdd8fc3-304b-4680-9165-cba46b6ae73c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:33.276129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd8fc3-304b-4680-9165-cba46b6ae73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:33.277554 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd8fc3-304b-4680-9165-cba46b6ae73c service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:33.287241 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1362/2667] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:36.422799 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa159c-d6de-445d-a5cd-0e4aef9e056d service glance] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:36.425634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-2ffa159c-d6de-445d-a5cd-0e4aef9e056d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:36.444779 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa159c-d6de-445d-a5cd-0e4aef9e056d service glance] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:36.449758 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acc125-14b2-42d4-affa-a8073f924ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:36.450669 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acc125-14b2-42d4-affa-a8073f924ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:36.451011 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acc125-14b2-42d4-affa-a8073f924ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:36.451269 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acc125-14b2-42d4-affa-a8073f924ae5 admin admin] PATH_INFO: `/v3/users/24d4ac4faaed44cbb9c20a5ae20a356a` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:36.468605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5acc125-14b2-42d4-affa-a8073f924ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d4ac4faaed44cbb9c20a5ae20a356a)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:36.470545 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5acc125-14b2-42d4-affa-a8073f924ae5 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:36.517897 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e5acc125-14b2-42d4-affa-a8073f924ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d4ac4faaed44cbb9c20a5ae20a356a'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:36.532921 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e5acc125-14b2-42d4-affa-a8073f924ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d4ac4faaed44cbb9c20a5ae20a356a'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:36.533654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e5acc125-14b2-42d4-affa-a8073f924ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d4ac4faaed44cbb9c20a5ae20a356a'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:36.543353 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e5acc125-14b2-42d4-affa-a8073f924ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d4ac4faaed44cbb9c20a5ae20a356a'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:36.544063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e5acc125-14b2-42d4-affa-a8073f924ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d4ac4faaed44cbb9c20a5ae20a356a'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:36.559490 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1306/2668] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:44:36 2022] DELETE /identity/v3/users/24d4ac4faaed44cbb9c20a5ae20a356a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:36.740725 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd8fc3-304b-4680-9165-cba46b6ae73c service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:36.752741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd8fc3-304b-4680-9165-cba46b6ae73c service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:36.811109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef981236-df21-438b-a3c5-571a889e3b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:36.812003 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef981236-df21-438b-a3c5-571a889e3b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:36.812284 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef981236-df21-438b-a3c5-571a889e3b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:36.812559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef981236-df21-438b-a3c5-571a889e3b52 admin admin] PATH_INFO: `/v3/projects/bcd2335cb8ac49098e292f17a835eac3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:36.823085 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef981236-df21-438b-a3c5-571a889e3b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd2335cb8ac49098e292f17a835eac3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:36.825045 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef981236-df21-438b-a3c5-571a889e3b52 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:36.868438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:36.872762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ef981236-df21-438b-a3c5-571a889e3b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd2335cb8ac49098e292f17a835eac3', 'request_id': 'req-ef981236-df21-438b-a3c5-571a889e3b52'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:36.878788 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ef981236-df21-438b-a3c5-571a889e3b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd2335cb8ac49098e292f17a835eac3', 'request_id': 'req-ef981236-df21-438b-a3c5-571a889e3b52'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:36.886589 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ef981236-df21-438b-a3c5-571a889e3b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd2335cb8ac49098e292f17a835eac3', 'request_id': 'req-ef981236-df21-438b-a3c5-571a889e3b52'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:36.898037 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ef981236-df21-438b-a3c5-571a889e3b52 admin admin] The token cache is being invalidate because project bcd2335cb8ac49098e292f17a835eac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:36.898321 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ef981236-df21-438b-a3c5-571a889e3b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:36.898951 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-ef981236-df21-438b-a3c5-571a889e3b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:36.900567 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1363/2669] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:44:36 2022] DELETE /identity/v3/projects/bcd2335cb8ac49098e292f17a835eac3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:44:36.906048 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f4f1d-606f-4459-b2ec-52825aac3ff1 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:36.906629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f4f1d-606f-4459-b2ec-52825aac3ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:36.906629 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f4f1d-606f-4459-b2ec-52825aac3ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:36.925148 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8a3f4f1d-606f-4459-b2ec-52825aac3ff1 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:36.926355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8a3f4f1d-606f-4459-b2ec-52825aac3ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:36.984722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1307/2670] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:36.992244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e3001-e4b3-45ec-9708-8b4afb7a4537 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:36.992537 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e3001-e4b3-45ec-9708-8b4afb7a4537 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:36.992821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e3001-e4b3-45ec-9708-8b4afb7a4537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.010855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-905e3001-e4b3-45ec-9708-8b4afb7a4537 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:37.012101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-905e3001-e4b3-45ec-9708-8b4afb7a4537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:37.020326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1364/2671] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:37.024385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f4f1d-606f-4459-b2ec-52825aac3ff1 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:37.034695 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f4f1d-606f-4459-b2ec-52825aac3ff1 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:37.039235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52230de6-331b-4d1a-b292-8e3656e32957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:37.039918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52230de6-331b-4d1a-b292-8e3656e32957 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:37.040201 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52230de6-331b-4d1a-b292-8e3656e32957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:37.040476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52230de6-331b-4d1a-b292-8e3656e32957 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.041202 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52230de6-331b-4d1a-b292-8e3656e32957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:44:37.041507 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52230de6-331b-4d1a-b292-8e3656e32957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:37.043131 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52230de6-331b-4d1a-b292-8e3656e32957 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:37.055999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1308/2672] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:44:37.060152 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e3001-e4b3-45ec-9708-8b4afb7a4537 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:37.069482 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e3001-e4b3-45ec-9708-8b4afb7a4537 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:37.074205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee61da-94b8-4f34-abb8-297e5522ff38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:37.074849 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee61da-94b8-4f34-abb8-297e5522ff38 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:37.075134 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee61da-94b8-4f34-abb8-297e5522ff38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:37.075412 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee61da-94b8-4f34-abb8-297e5522ff38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.076142 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee61da-94b8-4f34-abb8-297e5522ff38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:37.078047 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee61da-94b8-4f34-abb8-297e5522ff38 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:37.103863 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1365/2673] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:44:37 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:37.108628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52230de6-331b-4d1a-b292-8e3656e32957 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:37.118527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52230de6-331b-4d1a-b292-8e3656e32957 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:37.163029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:37.175983 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc3be4-1926-4f83-afa1-6f706da60ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:37.176682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3be4-1926-4f83-afa1-6f706da60ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:37.176968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3be4-1926-4f83-afa1-6f706da60ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:37.177245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3be4-1926-4f83-afa1-6f706da60ea7 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.177961 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc3be4-1926-4f83-afa1-6f706da60ea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:37.179912 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc3be4-1926-4f83-afa1-6f706da60ea7 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:37.203583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1309/2674] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:44:37 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:37.207605 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee61da-94b8-4f34-abb8-297e5522ff38 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:37.218414 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee61da-94b8-4f34-abb8-297e5522ff38 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:37.223062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453ee08-95fd-472a-8331-46c0b3f00883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:37.223752 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453ee08-95fd-472a-8331-46c0b3f00883 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:37.224040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453ee08-95fd-472a-8331-46c0b3f00883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:37.224316 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453ee08-95fd-472a-8331-46c0b3f00883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.225079 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453ee08-95fd-472a-8331-46c0b3f00883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:37.226676 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453ee08-95fd-472a-8331-46c0b3f00883 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:37.237139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1366/2675] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:37.241036 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc3be4-1926-4f83-afa1-6f706da60ea7 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:37.251508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc3be4-1926-4f83-afa1-6f706da60ea7 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:37.256461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34750432-4e35-41dd-930a-f87eb5374b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:37.257116 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34750432-4e35-41dd-930a-f87eb5374b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:37.257400 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34750432-4e35-41dd-930a-f87eb5374b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:37.257678 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34750432-4e35-41dd-930a-f87eb5374b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.258408 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34750432-4e35-41dd-930a-f87eb5374b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:37.260056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34750432-4e35-41dd-930a-f87eb5374b5e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:37.270590 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1310/2676] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:37.274584 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453ee08-95fd-472a-8331-46c0b3f00883 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:37.284977 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453ee08-95fd-472a-8331-46c0b3f00883 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:37.289604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e2d89-a9eb-410c-892e-503297e671e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:37.290473 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e2d89-a9eb-410c-892e-503297e671e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:37.290751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e2d89-a9eb-410c-892e-503297e671e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:37.291024 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e2d89-a9eb-410c-892e-503297e671e8 admin admin] PATH_INFO: `/v3/projects/08708d946b104e3b9d3d3d5c73456c7e/users/4a228d3d84864272afe196f26f68073a/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.307604 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e2d89-a9eb-410c-892e-503297e671e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08708d946b104e3b9d3d3d5c73456c7e, user_id=4a228d3d84864272afe196f26f68073a, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:37.310207 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e2d89-a9eb-410c-892e-503297e671e8 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:37.322540 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1367/2677] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:37 2022] PUT /identity/v3/projects/08708d946b104e3b9d3d3d5c73456c7e/users/4a228d3d84864272afe196f26f68073a/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:37.333479 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c394668-bede-45c8-acc5-ed8243e942a4 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:37.333773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c394668-bede-45c8-acc5-ed8243e942a4 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:37.334054 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c394668-bede-45c8-acc5-ed8243e942a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.360706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8c394668-bede-45c8-acc5-ed8243e942a4 None None] MFA Rules not processed for user `4a228d3d84864272afe196f26f68073a`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:37.361957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8c394668-bede-45c8-acc5-ed8243e942a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:37.424215 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1311/2678] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:37.428779 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e2d89-a9eb-410c-892e-503297e671e8 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:37.490994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e2d89-a9eb-410c-892e-503297e671e8 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:37.497228 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a6d24-0785-43cf-857a-fc404f6d97d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:37.497970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6d24-0785-43cf-857a-fc404f6d97d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:37.498864 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6d24-0785-43cf-857a-fc404f6d97d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:37.499205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6d24-0785-43cf-857a-fc404f6d97d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.500194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a6d24-0785-43cf-857a-fc404f6d97d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:37.502275 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a6d24-0785-43cf-857a-fc404f6d97d6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:37.530611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1368/2679] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:44:37 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:37.535087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c394668-bede-45c8-acc5-ed8243e942a4 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:37.547152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c394668-bede-45c8-acc5-ed8243e942a4 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:37.607662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3627b-8e55-4593-bd4b-c3274be0aa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:37.608456 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3627b-8e55-4593-bd4b-c3274be0aa3f admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:37.608760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3627b-8e55-4593-bd4b-c3274be0aa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:37.609035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3627b-8e55-4593-bd4b-c3274be0aa3f admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.609740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3627b-8e55-4593-bd4b-c3274be0aa3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:37.612063 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3627b-8e55-4593-bd4b-c3274be0aa3f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:37.635845 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1312/2680] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:44:37 2022] POST /identity/v3/users => generated 308 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:44:37.637046 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a6d24-0785-43cf-857a-fc404f6d97d6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:37.648765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a6d24-0785-43cf-857a-fc404f6d97d6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:37.653360 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f4fdd-8c76-4d5c-9d62-696c499eca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:37.654018 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f4fdd-8c76-4d5c-9d62-696c499eca7d admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:37.654299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f4fdd-8c76-4d5c-9d62-696c499eca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:37.654614 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f4fdd-8c76-4d5c-9d62-696c499eca7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.655375 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f4fdd-8c76-4d5c-9d62-696c499eca7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:37.657010 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f4fdd-8c76-4d5c-9d62-696c499eca7d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:37.667954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1369/2681] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:37.672126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3627b-8e55-4593-bd4b-c3274be0aa3f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:37.682549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3627b-8e55-4593-bd4b-c3274be0aa3f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:37.688723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d9134-b574-4395-b097-05c587142ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:37.690089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d9134-b574-4395-b097-05c587142ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:37.690448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d9134-b574-4395-b097-05c587142ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:37.690796 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d9134-b574-4395-b097-05c587142ba4 admin admin] PATH_INFO: `/v3/projects/405d277c9cee4d048c02e48dd606f82c/users/e77aabbac4ca4010b9eae44bb2ffc0da/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.708305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d9134-b574-4395-b097-05c587142ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405d277c9cee4d048c02e48dd606f82c, user_id=e77aabbac4ca4010b9eae44bb2ffc0da, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:37.710935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d9134-b574-4395-b097-05c587142ba4 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:37.723347 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1313/2682] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:37 2022] PUT /identity/v3/projects/405d277c9cee4d048c02e48dd606f82c/users/e77aabbac4ca4010b9eae44bb2ffc0da/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:37.727247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f4fdd-8c76-4d5c-9d62-696c499eca7d admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:37.737590 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f4fdd-8c76-4d5c-9d62-696c499eca7d admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:37.779258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:37.799254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd2e60-5703-4e6a-a417-b87853f35f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:37.799961 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd2e60-5703-4e6a-a417-b87853f35f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:37.800245 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd2e60-5703-4e6a-a417-b87853f35f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:37.800523 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd2e60-5703-4e6a-a417-b87853f35f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.801254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd2e60-5703-4e6a-a417-b87853f35f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:37.802844 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd2e60-5703-4e6a-a417-b87853f35f56 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:37.813565 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1370/2683] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:37.817985 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d9134-b574-4395-b097-05c587142ba4 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:37.831029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d9134-b574-4395-b097-05c587142ba4 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:37.836008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b6cb4-aee1-4a5a-8056-fb1e6addd438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:37.836896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b6cb4-aee1-4a5a-8056-fb1e6addd438 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:37.837181 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b6cb4-aee1-4a5a-8056-fb1e6addd438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:37.837458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b6cb4-aee1-4a5a-8056-fb1e6addd438 admin admin] PATH_INFO: `/v3/projects/405d277c9cee4d048c02e48dd606f82c/users/e77aabbac4ca4010b9eae44bb2ffc0da/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.839736 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b6cb4-aee1-4a5a-8056-fb1e6addd438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405d277c9cee4d048c02e48dd606f82c, user_id=e77aabbac4ca4010b9eae44bb2ffc0da, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:37.842631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b6cb4-aee1-4a5a-8056-fb1e6addd438 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:37.854233 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1314/2684] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:37 2022] PUT /identity/v3/projects/405d277c9cee4d048c02e48dd606f82c/users/e77aabbac4ca4010b9eae44bb2ffc0da/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:37.864972 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ce987-05b8-407a-9ac3-9f8b5da26ae5 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:37.865265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ce987-05b8-407a-9ac3-9f8b5da26ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:37.865548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ce987-05b8-407a-9ac3-9f8b5da26ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:37.892299 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-ab7ce987-05b8-407a-9ac3-9f8b5da26ae5 None None] MFA Rules not processed for user `e77aabbac4ca4010b9eae44bb2ffc0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:37.893523 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-ab7ce987-05b8-407a-9ac3-9f8b5da26ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:37.968946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1371/2685] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:37.979948 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b6cb4-aee1-4a5a-8056-fb1e6addd438 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:37.981695 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-2c5b6cb4-aee1-4a5a-8056-fb1e6addd438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:37.998028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:38.044898 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b6cb4-aee1-4a5a-8056-fb1e6addd438 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:38.049092 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc328d17-fdd6-4d29-91f3-ab56dfe9f1c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:38.049734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc328d17-fdd6-4d29-91f3-ab56dfe9f1c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:38.050014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc328d17-fdd6-4d29-91f3-ab56dfe9f1c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:38.050287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc328d17-fdd6-4d29-91f3-ab56dfe9f1c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:38.059182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc328d17-fdd6-4d29-91f3-ab56dfe9f1c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:38.060642 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc328d17-fdd6-4d29-91f3-ab56dfe9f1c2 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:38.070677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1315/2686] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:38.212124 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ce987-05b8-407a-9ac3-9f8b5da26ae5 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:38.275869 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ce987-05b8-407a-9ac3-9f8b5da26ae5 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:38.280800 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442b352-67e3-4e88-97a3-a204eac36e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:38.281845 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442b352-67e3-4e88-97a3-a204eac36e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:38.281971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442b352-67e3-4e88-97a3-a204eac36e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:38.282201 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442b352-67e3-4e88-97a3-a204eac36e15 admin admin] PATH_INFO: `/v3/users/4a228d3d84864272afe196f26f68073a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:38.283396 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442b352-67e3-4e88-97a3-a204eac36e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a228d3d84864272afe196f26f68073a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:38.285333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442b352-67e3-4e88-97a3-a204eac36e15 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:38.330347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7442b352-67e3-4e88-97a3-a204eac36e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a228d3d84864272afe196f26f68073a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:38.342899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7442b352-67e3-4e88-97a3-a204eac36e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a228d3d84864272afe196f26f68073a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:38.343603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7442b352-67e3-4e88-97a3-a204eac36e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a228d3d84864272afe196f26f68073a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:38.344921 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:38.352451 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7442b352-67e3-4e88-97a3-a204eac36e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a228d3d84864272afe196f26f68073a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:38.360745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7442b352-67e3-4e88-97a3-a204eac36e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a228d3d84864272afe196f26f68073a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:38.366625 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1372/2687] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:44:38 2022] DELETE /identity/v3/users/4a228d3d84864272afe196f26f68073a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:38.371121 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf25b2b-62c6-4cba-9448-6c5ac5c80703 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:38.371409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf25b2b-62c6-4cba-9448-6c5ac5c80703 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:38.371712 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf25b2b-62c6-4cba-9448-6c5ac5c80703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:38.389124 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-eaf25b2b-62c6-4cba-9448-6c5ac5c80703 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:38.390397 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-eaf25b2b-62c6-4cba-9448-6c5ac5c80703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:38.449072 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1316/2688] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:38.459091 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442b352-67e3-4e88-97a3-a204eac36e15 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:38.460584 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7442b352-67e3-4e88-97a3-a204eac36e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:38.518305 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442b352-67e3-4e88-97a3-a204eac36e15 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:38.522018 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ec4fa-51a5-44da-a907-b5b8ccb4c2e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:38.522665 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ec4fa-51a5-44da-a907-b5b8ccb4c2e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:38.522952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ec4fa-51a5-44da-a907-b5b8ccb4c2e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:38.523230 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ec4fa-51a5-44da-a907-b5b8ccb4c2e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:38.533843 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ec4fa-51a5-44da-a907-b5b8ccb4c2e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:38.535244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ec4fa-51a5-44da-a907-b5b8ccb4c2e3 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:38.544618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1373/2689] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:38.823297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf25b2b-62c6-4cba-9448-6c5ac5c80703 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:38.824838 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-eaf25b2b-62c6-4cba-9448-6c5ac5c80703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:38.844428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf25b2b-62c6-4cba-9448-6c5ac5c80703 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:38.849706 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:38.850609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:38.850890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:38.851163 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] PATH_INFO: `/v3/projects/08708d946b104e3b9d3d3d5c73456c7e` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:38.852469 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08708d946b104e3b9d3d3d5c73456c7e)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:38.854284 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:38.901691 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08708d946b104e3b9d3d3d5c73456c7e', 'request_id': 'req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:38.908808 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08708d946b104e3b9d3d3d5c73456c7e', 'request_id': 'req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:38.914892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08708d946b104e3b9d3d3d5c73456c7e', 'request_id': 'req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:38.927079 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] The token cache is being invalidate because project 08708d946b104e3b9d3d3d5c73456c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:38.927366 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:38.928006 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:38.929553 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1317/2690] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:44:38 2022] DELETE /identity/v3/projects/08708d946b104e3b9d3d3d5c73456c7e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:38.933764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ec4fa-51a5-44da-a907-b5b8ccb4c2e3 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:38.944227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ec4fa-51a5-44da-a907-b5b8ccb4c2e3 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:39.005826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02b8ed-ba65-442a-b322-28ff5497ffbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:39.006699 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02b8ed-ba65-442a-b322-28ff5497ffbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:39.006975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02b8ed-ba65-442a-b322-28ff5497ffbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:39.007246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02b8ed-ba65-442a-b322-28ff5497ffbd admin admin] PATH_INFO: `/v3/users/e77aabbac4ca4010b9eae44bb2ffc0da` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:39.008452 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02b8ed-ba65-442a-b322-28ff5497ffbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77aabbac4ca4010b9eae44bb2ffc0da)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:39.010380 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02b8ed-ba65-442a-b322-28ff5497ffbd admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:39.056745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cd02b8ed-ba65-442a-b322-28ff5497ffbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77aabbac4ca4010b9eae44bb2ffc0da'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.071019 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cd02b8ed-ba65-442a-b322-28ff5497ffbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77aabbac4ca4010b9eae44bb2ffc0da'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.071701 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cd02b8ed-ba65-442a-b322-28ff5497ffbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77aabbac4ca4010b9eae44bb2ffc0da'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.079282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cd02b8ed-ba65-442a-b322-28ff5497ffbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77aabbac4ca4010b9eae44bb2ffc0da'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.087458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-cd02b8ed-ba65-442a-b322-28ff5497ffbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77aabbac4ca4010b9eae44bb2ffc0da'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.093458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1374/2691] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:44:38 2022] DELETE /identity/v3/users/e77aabbac4ca4010b9eae44bb2ffc0da => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:39.373853 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:39.375276 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:39.392146 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73280c-cfbc-4cf3-b7c0-1cdbaac62162 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:39.425325 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:39.452277 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:39.453143 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:39.453700 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:39.453700 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52 admin admin] PATH_INFO: `/v3/projects/405d277c9cee4d048c02e48dd606f82c` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:39.454884 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=405d277c9cee4d048c02e48dd606f82c)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:39.456821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:39.503957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405d277c9cee4d048c02e48dd606f82c', 'request_id': 'req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.510284 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405d277c9cee4d048c02e48dd606f82c', 'request_id': 'req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.516288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405d277c9cee4d048c02e48dd606f82c', 'request_id': 'req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.530334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52 admin admin] The token cache is being invalidate because project 405d277c9cee4d048c02e48dd606f82c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:39.530631 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.531348 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f9d729a0-cc9f-4d20-a51a-e6bda6f06a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.533048 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1318/2692] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:44:39 2022] DELETE /identity/v3/projects/405d277c9cee4d048c02e48dd606f82c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:39.538021 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4657c10-0ce4-495d-8258-867d5b1db90b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:39.538313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4657c10-0ce4-495d-8258-867d5b1db90b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:39.538590 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4657c10-0ce4-495d-8258-867d5b1db90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:39.545938 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:39.558564 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d4657c10-0ce4-495d-8258-867d5b1db90b None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:39.559846 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d4657c10-0ce4-495d-8258-867d5b1db90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:39.620244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1375/2693] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:39.629174 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88efdba-aac9-4939-9b54-c1db5d02399e None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:39.629469 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88efdba-aac9-4939-9b54-c1db5d02399e None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:39.629752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88efdba-aac9-4939-9b54-c1db5d02399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:39.648812 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-b88efdba-aac9-4939-9b54-c1db5d02399e None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:39.650024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b88efdba-aac9-4939-9b54-c1db5d02399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:39.658668 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1319/2694] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:39.662864 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4657c10-0ce4-495d-8258-867d5b1db90b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:39.672944 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4657c10-0ce4-495d-8258-867d5b1db90b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:39.677597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293dc55-b7ea-4029-aab3-dd07f8d486ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:39.678258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293dc55-b7ea-4029-aab3-dd07f8d486ef admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:39.678542 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293dc55-b7ea-4029-aab3-dd07f8d486ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:39.678819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293dc55-b7ea-4029-aab3-dd07f8d486ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:39.679581 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293dc55-b7ea-4029-aab3-dd07f8d486ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:44:39.679892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293dc55-b7ea-4029-aab3-dd07f8d486ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:39.681499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293dc55-b7ea-4029-aab3-dd07f8d486ef admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:39.693339 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1376/2695] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:44:39.697648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88efdba-aac9-4939-9b54-c1db5d02399e None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:39.707580 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88efdba-aac9-4939-9b54-c1db5d02399e None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:39.712123 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50f0a4-d4cf-4e14-a3d2-d9cc65fd11d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:39.712793 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50f0a4-d4cf-4e14-a3d2-d9cc65fd11d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:39.713070 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50f0a4-d4cf-4e14-a3d2-d9cc65fd11d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:39.713343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50f0a4-d4cf-4e14-a3d2-d9cc65fd11d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:39.714016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50f0a4-d4cf-4e14-a3d2-d9cc65fd11d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:39.715956 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50f0a4-d4cf-4e14-a3d2-d9cc65fd11d0 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:39.746959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1320/2696] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:44:39 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:39.747084 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293dc55-b7ea-4029-aab3-dd07f8d486ef admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:39.748150 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50f0a4-d4cf-4e14-a3d2-d9cc65fd11d0 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:39.750592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-5d50f0a4-d4cf-4e14-a3d2-d9cc65fd11d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:39.758209 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293dc55-b7ea-4029-aab3-dd07f8d486ef admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:39.815932 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343aec6-66de-41ea-9552-f2f72629729f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:39.816410 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50f0a4-d4cf-4e14-a3d2-d9cc65fd11d0 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:39.816599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343aec6-66de-41ea-9552-f2f72629729f admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:39.816876 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343aec6-66de-41ea-9552-f2f72629729f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:39.817146 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343aec6-66de-41ea-9552-f2f72629729f admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:39.817924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343aec6-66de-41ea-9552-f2f72629729f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:39.819918 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343aec6-66de-41ea-9552-f2f72629729f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:39.821572 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ee94e-e8e2-4f5f-b65b-a1412832abe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:39.822432 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ee94e-e8e2-4f5f-b65b-a1412832abe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:39.822721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ee94e-e8e2-4f5f-b65b-a1412832abe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:39.822995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ee94e-e8e2-4f5f-b65b-a1412832abe7 admin admin] PATH_INFO: `/v3/users/a17c22ca260548dd9c27ad47c8e361fb` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:39.824207 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ee94e-e8e2-4f5f-b65b-a1412832abe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17c22ca260548dd9c27ad47c8e361fb)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:39.826106 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ee94e-e8e2-4f5f-b65b-a1412832abe7 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:39.844192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1377/2697] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:44:39 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:39.847950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343aec6-66de-41ea-9552-f2f72629729f admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:39.857808 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343aec6-66de-41ea-9552-f2f72629729f admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:39.862710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc481e9-dbb2-48b9-92c0-3ce485234369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:39.863352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc481e9-dbb2-48b9-92c0-3ce485234369 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:39.863673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc481e9-dbb2-48b9-92c0-3ce485234369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:39.863978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc481e9-dbb2-48b9-92c0-3ce485234369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:39.864761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc481e9-dbb2-48b9-92c0-3ce485234369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:39.866246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc481e9-dbb2-48b9-92c0-3ce485234369 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:39.872699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:39.877644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1378/2698] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:44:39.881978 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc481e9-dbb2-48b9-92c0-3ce485234369 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:39.884189 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6e9ee94e-e8e2-4f5f-b65b-a1412832abe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17c22ca260548dd9c27ad47c8e361fb'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.892503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc481e9-dbb2-48b9-92c0-3ce485234369 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:39.896646 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6e9ee94e-e8e2-4f5f-b65b-a1412832abe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17c22ca260548dd9c27ad47c8e361fb'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.897326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6e9ee94e-e8e2-4f5f-b65b-a1412832abe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17c22ca260548dd9c27ad47c8e361fb'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.897472 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffeb88-b010-4ba7-b61c-3863f3c522de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:39.898050 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffeb88-b010-4ba7-b61c-3863f3c522de admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:39.898336 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffeb88-b010-4ba7-b61c-3863f3c522de admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:39.898617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffeb88-b010-4ba7-b61c-3863f3c522de admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:39.899343 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ffeb88-b010-4ba7-b61c-3863f3c522de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:39.900995 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ffeb88-b010-4ba7-b61c-3863f3c522de admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:39.905232 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6e9ee94e-e8e2-4f5f-b65b-a1412832abe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17c22ca260548dd9c27ad47c8e361fb'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.906032 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-6e9ee94e-e8e2-4f5f-b65b-a1412832abe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17c22ca260548dd9c27ad47c8e361fb'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:39.912655 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1379/2699] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:44:39.916711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffeb88-b010-4ba7-b61c-3863f3c522de admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:39.918462 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-25ffeb88-b010-4ba7-b61c-3863f3c522de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:39.922507 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1321/2700] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:44:39 2022] DELETE /identity/v3/users/a17c22ca260548dd9c27ad47c8e361fb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:39.926867 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9873c83-726a-452c-93c8-61545bb78390 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:39.927162 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9873c83-726a-452c-93c8-61545bb78390 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:39.927443 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9873c83-726a-452c-93c8-61545bb78390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:39.931238 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffeb88-b010-4ba7-b61c-3863f3c522de admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:39.944838 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-b9873c83-726a-452c-93c8-61545bb78390 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:39.946048 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b9873c83-726a-452c-93c8-61545bb78390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:39.988291 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35c140-de15-4dec-b7ac-79e9c287408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:39.989258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35c140-de15-4dec-b7ac-79e9c287408d admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:39.989553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35c140-de15-4dec-b7ac-79e9c287408d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:39.989893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35c140-de15-4dec-b7ac-79e9c287408d admin admin] PATH_INFO: `/v3/projects/77e95f3f3fe34e28b02231a5118dc71b/users/72f0634d98fa46f9828a0be56234a80b/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:39.993173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:40.008745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35c140-de15-4dec-b7ac-79e9c287408d admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e95f3f3fe34e28b02231a5118dc71b, user_id=72f0634d98fa46f9828a0be56234a80b, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:40.011406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35c140-de15-4dec-b7ac-79e9c287408d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:40.017583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1322/2701] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:44:40.026974 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1380/2702] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:39 2022] PUT /identity/v3/projects/77e95f3f3fe34e28b02231a5118dc71b/users/72f0634d98fa46f9828a0be56234a80b/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:44:40.035374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9873c83-726a-452c-93c8-61545bb78390 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:40.035374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b9873c83-726a-452c-93c8-61545bb78390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:40.037976 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dca801-a013-44b9-af62-ea6a2ba8a647 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.038266 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dca801-a013-44b9-af62-ea6a2ba8a647 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.038546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dca801-a013-44b9-af62-ea6a2ba8a647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.066606 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-d4dca801-a013-44b9-af62-ea6a2ba8a647 None None] MFA Rules not processed for user `72f0634d98fa46f9828a0be56234a80b`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:40.067192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d4dca801-a013-44b9-af62-ea6a2ba8a647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:40.089794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9873c83-726a-452c-93c8-61545bb78390 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:40.134007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1381/2703] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:40.138330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dca801-a013-44b9-af62-ea6a2ba8a647 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:40.140506 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576ee79-dd38-4041-a452-b2ae657dba24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:40.141377 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576ee79-dd38-4041-a452-b2ae657dba24 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.141539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576ee79-dd38-4041-a452-b2ae657dba24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.141805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576ee79-dd38-4041-a452-b2ae657dba24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.168415 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:40.202389 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dca801-a013-44b9-af62-ea6a2ba8a647 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:40.206489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576ee79-dd38-4041-a452-b2ae657dba24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:40.207222 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4f0c-8bcc-435a-b8cf-6ca84fad603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:40.207907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4f0c-8bcc-435a-b8cf-6ca84fad603c admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.208040 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576ee79-dd38-4041-a452-b2ae657dba24 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:40.208188 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4f0c-8bcc-435a-b8cf-6ca84fad603c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.208461 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4f0c-8bcc-435a-b8cf-6ca84fad603c admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.209174 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f4f0c-8bcc-435a-b8cf-6ca84fad603c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:40.211076 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f4f0c-8bcc-435a-b8cf-6ca84fad603c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:40.217788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1323/2704] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:40.244610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1382/2705] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:44:40 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:44:40.245887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576ee79-dd38-4041-a452-b2ae657dba24 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:40.257146 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576ee79-dd38-4041-a452-b2ae657dba24 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:40.318133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c54cb-9e0a-4eff-89a2-aa0feb9bd620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:40.318813 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c54cb-9e0a-4eff-89a2-aa0feb9bd620 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.319343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c54cb-9e0a-4eff-89a2-aa0feb9bd620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.319742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c54cb-9e0a-4eff-89a2-aa0feb9bd620 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.320589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c54cb-9e0a-4eff-89a2-aa0feb9bd620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:40.322698 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c54cb-9e0a-4eff-89a2-aa0feb9bd620 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:40.345056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1324/2706] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:44:40 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:44:40.348722 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4f0c-8bcc-435a-b8cf-6ca84fad603c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:40.359515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4f0c-8bcc-435a-b8cf-6ca84fad603c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:40.364233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9a94f-8a01-4a27-aa33-19a0b2787911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:40.364893 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9a94f-8a01-4a27-aa33-19a0b2787911 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.365172 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9a94f-8a01-4a27-aa33-19a0b2787911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.365446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9a94f-8a01-4a27-aa33-19a0b2787911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.366221 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9a94f-8a01-4a27-aa33-19a0b2787911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:40.367788 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9a94f-8a01-4a27-aa33-19a0b2787911 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:40.390344 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1383/2707] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:40.391822 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c54cb-9e0a-4eff-89a2-aa0feb9bd620 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:40.402062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c54cb-9e0a-4eff-89a2-aa0feb9bd620 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:40.406788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c65d5b-17aa-4aa0-84c4-44a28fd9c7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:40.407704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c65d5b-17aa-4aa0-84c4-44a28fd9c7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.407991 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c65d5b-17aa-4aa0-84c4-44a28fd9c7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.408270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c65d5b-17aa-4aa0-84c4-44a28fd9c7ad admin admin] PATH_INFO: `/v3/projects/6bb8709824c047f486b2fe9f3bd19d4b/users/d67e6edb9ce941cb83918793959a95a1/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.423503 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c65d5b-17aa-4aa0-84c4-44a28fd9c7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bb8709824c047f486b2fe9f3bd19d4b, user_id=d67e6edb9ce941cb83918793959a95a1, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:40.426149 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c65d5b-17aa-4aa0-84c4-44a28fd9c7ad admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:40.440536 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1325/2708] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:40 2022] PUT /identity/v3/projects/6bb8709824c047f486b2fe9f3bd19d4b/users/d67e6edb9ce941cb83918793959a95a1/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:40.444699 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9a94f-8a01-4a27-aa33-19a0b2787911 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:40.455513 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9a94f-8a01-4a27-aa33-19a0b2787911 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:40.505657 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:40.507597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c65d5b-17aa-4aa0-84c4-44a28fd9c7ad admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:40.509566 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-20c65d5b-17aa-4aa0-84c4-44a28fd9c7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:40.524763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4275467-6bbb-4ddf-ad32-0106db6b3762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:40.525446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4275467-6bbb-4ddf-ad32-0106db6b3762 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.525736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4275467-6bbb-4ddf-ad32-0106db6b3762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.526017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4275467-6bbb-4ddf-ad32-0106db6b3762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.526961 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4275467-6bbb-4ddf-ad32-0106db6b3762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:40.528761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4275467-6bbb-4ddf-ad32-0106db6b3762 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:40.540586 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1384/2709] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:40.544553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4275467-6bbb-4ddf-ad32-0106db6b3762 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:40.555672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4275467-6bbb-4ddf-ad32-0106db6b3762 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:40.560444 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558808a6-5586-42e7-a35f-71c993f2db30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:40.561357 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558808a6-5586-42e7-a35f-71c993f2db30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.561645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558808a6-5586-42e7-a35f-71c993f2db30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.561923 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558808a6-5586-42e7-a35f-71c993f2db30 admin admin] PATH_INFO: `/v3/projects/6bb8709824c047f486b2fe9f3bd19d4b/users/d67e6edb9ce941cb83918793959a95a1/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.564071 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558808a6-5586-42e7-a35f-71c993f2db30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bb8709824c047f486b2fe9f3bd19d4b, user_id=d67e6edb9ce941cb83918793959a95a1, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:40.566745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558808a6-5586-42e7-a35f-71c993f2db30 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:40.577456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1385/2710] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:40 2022] PUT /identity/v3/projects/6bb8709824c047f486b2fe9f3bd19d4b/users/d67e6edb9ce941cb83918793959a95a1/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:44:40.583742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c65d5b-17aa-4aa0-84c4-44a28fd9c7ad admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:40.587660 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d2372-fe9f-4fd6-a755-f656dfdd3215 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.587959 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d2372-fe9f-4fd6-a755-f656dfdd3215 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.588257 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d2372-fe9f-4fd6-a755-f656dfdd3215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.616703 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-e81d2372-fe9f-4fd6-a755-f656dfdd3215 None None] MFA Rules not processed for user `d67e6edb9ce941cb83918793959a95a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:40.617762 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:40.618044 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e81d2372-fe9f-4fd6-a755-f656dfdd3215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:40.643243 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bcf24-343c-49dd-bc6c-f0f53e72c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:40.644052 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bcf24-343c-49dd-bc6c-f0f53e72c00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.644329 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bcf24-343c-49dd-bc6c-f0f53e72c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.644597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bcf24-343c-49dd-bc6c-f0f53e72c00d admin admin] PATH_INFO: `/v3/projects/6aa9a34bdf934a23859ca9c665aef44e` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.645821 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bcf24-343c-49dd-bc6c-f0f53e72c00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa9a34bdf934a23859ca9c665aef44e)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:40.647749 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bcf24-343c-49dd-bc6c-f0f53e72c00d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:40.692875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1386/2711] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:44:40.697682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-162bcf24-343c-49dd-bc6c-f0f53e72c00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa9a34bdf934a23859ca9c665aef44e', 'request_id': 'req-162bcf24-343c-49dd-bc6c-f0f53e72c00d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:40.704176 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d2372-fe9f-4fd6-a755-f656dfdd3215 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:40.704341 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-162bcf24-343c-49dd-bc6c-f0f53e72c00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa9a34bdf934a23859ca9c665aef44e', 'request_id': 'req-162bcf24-343c-49dd-bc6c-f0f53e72c00d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:40.705581 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-e81d2372-fe9f-4fd6-a755-f656dfdd3215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:40.710126 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-162bcf24-343c-49dd-bc6c-f0f53e72c00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa9a34bdf934a23859ca9c665aef44e', 'request_id': 'req-162bcf24-343c-49dd-bc6c-f0f53e72c00d'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:40.723589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-162bcf24-343c-49dd-bc6c-f0f53e72c00d admin admin] The token cache is being invalidate because project 6aa9a34bdf934a23859ca9c665aef44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:40.723909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-162bcf24-343c-49dd-bc6c-f0f53e72c00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:40.724558 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-162bcf24-343c-49dd-bc6c-f0f53e72c00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:40.726186 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1326/2712] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:44:40 2022] DELETE /identity/v3/projects/6aa9a34bdf934a23859ca9c665aef44e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:44:40.731740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbe38a-8c08-4357-9aa9-7c0efe056ecd None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.732034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbe38a-8c08-4357-9aa9-7c0efe056ecd None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.732317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbe38a-8c08-4357-9aa9-7c0efe056ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.751997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-4ccbe38a-8c08-4357-9aa9-7c0efe056ecd None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:40.753217 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4ccbe38a-8c08-4357-9aa9-7c0efe056ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:40.768400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d2372-fe9f-4fd6-a755-f656dfdd3215 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:40.815781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1327/2713] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:44:40.819680 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4464a-8e5c-4de5-87bf-af134ca4ee83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:40.821102 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4464a-8e5c-4de5-87bf-af134ca4ee83 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.821385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4464a-8e5c-4de5-87bf-af134ca4ee83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.821819 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4464a-8e5c-4de5-87bf-af134ca4ee83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.823439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d16c0-1688-4ffc-8db0-847d296dd18f None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.823904 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d16c0-1688-4ffc-8db0-847d296dd18f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.824016 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-98d4464a-8e5c-4de5-87bf-af134ca4ee83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:40.824321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d16c0-1688-4ffc-8db0-847d296dd18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.846465 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-a12d16c0-1688-4ffc-8db0-847d296dd18f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:40.847733 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a12d16c0-1688-4ffc-8db0-847d296dd18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:40.852303 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:40.857005 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1328/2714] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:44:40.861987 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d16c0-1688-4ffc-8db0-847d296dd18f None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:40.873473 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d16c0-1688-4ffc-8db0-847d296dd18f None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:40.879228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8142d-5bda-4775-8f33-ac0ac2f156f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:40.880005 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8142d-5bda-4775-8f33-ac0ac2f156f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.880619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8142d-5bda-4775-8f33-ac0ac2f156f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.880969 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8142d-5bda-4775-8f33-ac0ac2f156f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.881784 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8142d-5bda-4775-8f33-ac0ac2f156f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:44:40.882095 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8142d-5bda-4775-8f33-ac0ac2f156f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:40.883730 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8142d-5bda-4775-8f33-ac0ac2f156f5 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:40.894367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4464a-8e5c-4de5-87bf-af134ca4ee83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:40.895872 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4464a-8e5c-4de5-87bf-af134ca4ee83 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:40.896246 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1329/2715] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 10:44:40.900423 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8142d-5bda-4775-8f33-ac0ac2f156f5 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:40.908880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1387/2716] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:44:40.912010 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8142d-5bda-4775-8f33-ac0ac2f156f5 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:40.917283 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86337ab-c35a-4315-aeee-a7258c7a7bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:40.917954 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86337ab-c35a-4315-aeee-a7258c7a7bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:40.918242 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86337ab-c35a-4315-aeee-a7258c7a7bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:40.918523 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86337ab-c35a-4315-aeee-a7258c7a7bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:40.919224 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86337ab-c35a-4315-aeee-a7258c7a7bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:40.921275 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86337ab-c35a-4315-aeee-a7258c7a7bd6 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:40.936593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4464a-8e5c-4de5-87bf-af134ca4ee83 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:40.938292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-98d4464a-8e5c-4de5-87bf-af134ca4ee83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:40.954753 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1330/2717] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:44:40 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:44:40.954981 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4464a-8e5c-4de5-87bf-af134ca4ee83 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:40.956334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86337ab-c35a-4315-aeee-a7258c7a7bd6 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:40.990602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:41.020411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3b121-dd71-4770-a4fe-ffb1f37093c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:41.021315 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3b121-dd71-4770-a4fe-ffb1f37093c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:41.021602 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3b121-dd71-4770-a4fe-ffb1f37093c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:41.021904 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3b121-dd71-4770-a4fe-ffb1f37093c8 admin admin] PATH_INFO: `/v3/users/72f0634d98fa46f9828a0be56234a80b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:41.023129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3b121-dd71-4770-a4fe-ffb1f37093c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f0634d98fa46f9828a0be56234a80b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:41.025143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3b121-dd71-4770-a4fe-ffb1f37093c8 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:41.036654 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86337ab-c35a-4315-aeee-a7258c7a7bd6 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:41.043586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2365a-5d29-4ea7-acf9-a83cc3ff2d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:41.044266 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2365a-5d29-4ea7-acf9-a83cc3ff2d76 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:41.044549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2365a-5d29-4ea7-acf9-a83cc3ff2d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:41.044823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2365a-5d29-4ea7-acf9-a83cc3ff2d76 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:41.045578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2365a-5d29-4ea7-acf9-a83cc3ff2d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:41.047573 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2365a-5d29-4ea7-acf9-a83cc3ff2d76 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:41.068604 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1331/2718] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:44:40 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:44:41.076994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2365a-5d29-4ea7-acf9-a83cc3ff2d76 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:41.083571 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e0d3b121-dd71-4770-a4fe-ffb1f37093c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f0634d98fa46f9828a0be56234a80b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:41.090763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2365a-5d29-4ea7-acf9-a83cc3ff2d76 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:41.098851 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879eed0-c4a1-44e4-86cf-b59eb7e96773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:41.099559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879eed0-c4a1-44e4-86cf-b59eb7e96773 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:41.099845 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879eed0-c4a1-44e4-86cf-b59eb7e96773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:41.100128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879eed0-c4a1-44e4-86cf-b59eb7e96773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:41.100884 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879eed0-c4a1-44e4-86cf-b59eb7e96773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:41.102503 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879eed0-c4a1-44e4-86cf-b59eb7e96773 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:41.104619 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e0d3b121-dd71-4770-a4fe-ffb1f37093c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f0634d98fa46f9828a0be56234a80b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:41.105192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e0d3b121-dd71-4770-a4fe-ffb1f37093c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f0634d98fa46f9828a0be56234a80b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:41.114126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e0d3b121-dd71-4770-a4fe-ffb1f37093c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f0634d98fa46f9828a0be56234a80b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:41.116564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1332/2719] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:41.117422 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879eed0-c4a1-44e4-86cf-b59eb7e96773 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:41.119177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8879eed0-c4a1-44e4-86cf-b59eb7e96773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:41.124767 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-e0d3b121-dd71-4770-a4fe-ffb1f37093c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f0634d98fa46f9828a0be56234a80b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:41.132448 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879eed0-c4a1-44e4-86cf-b59eb7e96773 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:41.133492 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1388/2720] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:44:40 2022] DELETE /identity/v3/users/72f0634d98fa46f9828a0be56234a80b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:41.137986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b96a6-d0a7-4731-a056-35a505bfa0d0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:41.138126 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b96a6-d0a7-4731-a056-35a505bfa0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:41.138517 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b96a6-d0a7-4731-a056-35a505bfa0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:41.160700 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-9a4b96a6-d0a7-4731-a056-35a505bfa0d0 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:41.161941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9a4b96a6-d0a7-4731-a056-35a505bfa0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:41.196151 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e46a0-5bb9-4df7-9186-1e02dba5bae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:41.196919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e46a0-5bb9-4df7-9186-1e02dba5bae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:41.197274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e46a0-5bb9-4df7-9186-1e02dba5bae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:41.197623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e46a0-5bb9-4df7-9186-1e02dba5bae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:41.198432 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e46a0-5bb9-4df7-9186-1e02dba5bae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:41.200222 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e46a0-5bb9-4df7-9186-1e02dba5bae8 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:41.200492 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:41.216323 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1333/2721] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:41.218401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e46a0-5bb9-4df7-9186-1e02dba5bae8 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:41.229321 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e46a0-5bb9-4df7-9186-1e02dba5bae8 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:41.234744 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57405d8-06e0-48b5-a3db-c6980effee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:41.235683 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57405d8-06e0-48b5-a3db-c6980effee14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:41.235810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1389/2722] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:44:41.235934 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57405d8-06e0-48b5-a3db-c6980effee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:41.236175 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57405d8-06e0-48b5-a3db-c6980effee14 admin admin] PATH_INFO: `/v3/projects/8ebbf6ca0dd8478e98d60259fc79df0d/users/a057a8b09b224d268ad055a7c15ef37b/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:41.247322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b96a6-d0a7-4731-a056-35a505bfa0d0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:41.249536 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9a4b96a6-d0a7-4731-a056-35a505bfa0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:41.253311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57405d8-06e0-48b5-a3db-c6980effee14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ebbf6ca0dd8478e98d60259fc79df0d, user_id=a057a8b09b224d268ad055a7c15ef37b, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:41.256327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57405d8-06e0-48b5-a3db-c6980effee14 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:41.271658 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1334/2723] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:41 2022] PUT /identity/v3/projects/8ebbf6ca0dd8478e98d60259fc79df0d/users/a057a8b09b224d268ad055a7c15ef37b/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:41.282837 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aef94-52e9-41b3-b62c-e5a023214802 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:41.283160 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aef94-52e9-41b3-b62c-e5a023214802 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:41.283600 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aef94-52e9-41b3-b62c-e5a023214802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:41.310029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-282aef94-52e9-41b3-b62c-e5a023214802 None None] MFA Rules not processed for user `a057a8b09b224d268ad055a7c15ef37b`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:41.312087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-282aef94-52e9-41b3-b62c-e5a023214802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:41.317010 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b96a6-d0a7-4731-a056-35a505bfa0d0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:41.372068 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c14aa-a474-46ef-85e4-f2a60b4c3b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:41.372600 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c14aa-a474-46ef-85e4-f2a60b4c3b0c service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:41.372889 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c14aa-a474-46ef-85e4-f2a60b4c3b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:41.373174 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c14aa-a474-46ef-85e4-f2a60b4c3b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:41.385850 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1335/2724] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:41.398394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282aef94-52e9-41b3-b62c-e5a023214802 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:41.399856 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-282aef94-52e9-41b3-b62c-e5a023214802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:41.407644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:41.443552 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c14aa-a474-46ef-85e4-f2a60b4c3b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:41.446941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c14aa-a474-46ef-85e4-f2a60b4c3b0c service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:41.460481 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1390/2725] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:44:41.473259 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282aef94-52e9-41b3-b62c-e5a023214802 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:41.477336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0dd76-c82b-4d0e-b563-463b6ac26da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:41.477993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0dd76-c82b-4d0e-b563-463b6ac26da5 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:41.478278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0dd76-c82b-4d0e-b563-463b6ac26da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:41.478556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0dd76-c82b-4d0e-b563-463b6ac26da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:41.488659 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0dd76-c82b-4d0e-b563-463b6ac26da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:41.489909 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0dd76-c82b-4d0e-b563-463b6ac26da5 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:41.503325 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1336/2726] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:44:41.749514 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c14aa-a474-46ef-85e4-f2a60b4c3b0c service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:41.750948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d59c14aa-a474-46ef-85e4-f2a60b4c3b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:41.784764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c14aa-a474-46ef-85e4-f2a60b4c3b0c service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:41.794721 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:41.795734 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:41.796025 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:41.796461 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] PATH_INFO: `/v3/projects/77e95f3f3fe34e28b02231a5118dc71b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:41.797620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77e95f3f3fe34e28b02231a5118dc71b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:41.800223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:41.851000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:41.859783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77e95f3f3fe34e28b02231a5118dc71b', 'request_id': 'req-55cca9c9-7204-4f2b-a4b0-53add0859e30'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:41.866499 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77e95f3f3fe34e28b02231a5118dc71b', 'request_id': 'req-55cca9c9-7204-4f2b-a4b0-53add0859e30'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:41.882761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77e95f3f3fe34e28b02231a5118dc71b', 'request_id': 'req-55cca9c9-7204-4f2b-a4b0-53add0859e30'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:41.896741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] The token cache is being invalidate because project 77e95f3f3fe34e28b02231a5118dc71b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:41.897033 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:41.897704 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:41.899233 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1391/2727] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:44:41 2022] DELETE /identity/v3/projects/77e95f3f3fe34e28b02231a5118dc71b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:41.903392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0dd76-c82b-4d0e-b563-463b6ac26da5 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:41.916645 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0dd76-c82b-4d0e-b563-463b6ac26da5 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:41.978743 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c3eae-f1bd-4f74-a262-217fe8f2ed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:41.979562 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3eae-f1bd-4f74-a262-217fe8f2ed66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:41.979992 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3eae-f1bd-4f74-a262-217fe8f2ed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:41.980130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3eae-f1bd-4f74-a262-217fe8f2ed66 admin admin] PATH_INFO: `/v3/users/d67e6edb9ce941cb83918793959a95a1` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:41.981298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c3eae-f1bd-4f74-a262-217fe8f2ed66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67e6edb9ce941cb83918793959a95a1)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:41.983809 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c3eae-f1bd-4f74-a262-217fe8f2ed66 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:42.032607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5d6c3eae-f1bd-4f74-a262-217fe8f2ed66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67e6edb9ce941cb83918793959a95a1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:42.044728 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5d6c3eae-f1bd-4f74-a262-217fe8f2ed66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67e6edb9ce941cb83918793959a95a1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:42.045950 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5d6c3eae-f1bd-4f74-a262-217fe8f2ed66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67e6edb9ce941cb83918793959a95a1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:42.052841 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5d6c3eae-f1bd-4f74-a262-217fe8f2ed66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67e6edb9ce941cb83918793959a95a1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:42.053609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-5d6c3eae-f1bd-4f74-a262-217fe8f2ed66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67e6edb9ce941cb83918793959a95a1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:42.066230 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1337/2728] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:44:41 2022] DELETE /identity/v3/users/d67e6edb9ce941cb83918793959a95a1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:42.336028 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:42.337508 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:42.352322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cca9c9-7204-4f2b-a4b0-53add0859e30 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:42.415737 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214700e-3a88-4b47-9cd0-850edfbbb727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:42.416649 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214700e-3a88-4b47-9cd0-850edfbbb727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:42.416930 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214700e-3a88-4b47-9cd0-850edfbbb727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:42.417201 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214700e-3a88-4b47-9cd0-850edfbbb727 admin admin] PATH_INFO: `/v3/projects/6bb8709824c047f486b2fe9f3bd19d4b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:42.418387 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214700e-3a88-4b47-9cd0-850edfbbb727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bb8709824c047f486b2fe9f3bd19d4b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:42.420329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214700e-3a88-4b47-9cd0-850edfbbb727 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:42.466500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9214700e-3a88-4b47-9cd0-850edfbbb727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bb8709824c047f486b2fe9f3bd19d4b', 'request_id': 'req-9214700e-3a88-4b47-9cd0-850edfbbb727'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:42.472627 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9214700e-3a88-4b47-9cd0-850edfbbb727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bb8709824c047f486b2fe9f3bd19d4b', 'request_id': 'req-9214700e-3a88-4b47-9cd0-850edfbbb727'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:42.480777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9214700e-3a88-4b47-9cd0-850edfbbb727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bb8709824c047f486b2fe9f3bd19d4b', 'request_id': 'req-9214700e-3a88-4b47-9cd0-850edfbbb727'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:42.492721 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9214700e-3a88-4b47-9cd0-850edfbbb727 admin admin] The token cache is being invalidate because project 6bb8709824c047f486b2fe9f3bd19d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:42.493013 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9214700e-3a88-4b47-9cd0-850edfbbb727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:42.493662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9214700e-3a88-4b47-9cd0-850edfbbb727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:42.495240 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1392/2729] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:44:42 2022] DELETE /identity/v3/projects/6bb8709824c047f486b2fe9f3bd19d4b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:42.500549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950a51a-332c-466a-9709-ef9c87b77157 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:42.501024 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950a51a-332c-466a-9709-ef9c87b77157 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:42.501308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950a51a-332c-466a-9709-ef9c87b77157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:42.525039 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-2950a51a-332c-466a-9709-ef9c87b77157 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:42.526633 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-2950a51a-332c-466a-9709-ef9c87b77157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:42.549623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:42.588655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1338/2730] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:42.597948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2ba40-bc51-4094-8dd5-a82f86654115 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:42.598336 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2ba40-bc51-4094-8dd5-a82f86654115 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:42.598616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2ba40-bc51-4094-8dd5-a82f86654115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:42.616606 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-99a2ba40-bc51-4094-8dd5-a82f86654115 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:42.617817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-99a2ba40-bc51-4094-8dd5-a82f86654115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:42.625651 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1393/2731] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:42.629885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950a51a-332c-466a-9709-ef9c87b77157 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:42.640259 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950a51a-332c-466a-9709-ef9c87b77157 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:42.645042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76d7a9-05fd-4fa6-a2e5-20061f8631c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:42.645689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76d7a9-05fd-4fa6-a2e5-20061f8631c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:42.645967 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76d7a9-05fd-4fa6-a2e5-20061f8631c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:42.646239 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76d7a9-05fd-4fa6-a2e5-20061f8631c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:42.646957 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76d7a9-05fd-4fa6-a2e5-20061f8631c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:44:42.647262 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76d7a9-05fd-4fa6-a2e5-20061f8631c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:42.648892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76d7a9-05fd-4fa6-a2e5-20061f8631c4 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:42.661099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1339/2732] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:44:42.665423 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2ba40-bc51-4094-8dd5-a82f86654115 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:42.674821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2ba40-bc51-4094-8dd5-a82f86654115 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:42.679720 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed30f6-280d-443e-b051-6a461d9d703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:42.680395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed30f6-280d-443e-b051-6a461d9d703b admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:42.680675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed30f6-280d-443e-b051-6a461d9d703b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:42.680947 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed30f6-280d-443e-b051-6a461d9d703b admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:42.681626 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed30f6-280d-443e-b051-6a461d9d703b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:42.683509 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed30f6-280d-443e-b051-6a461d9d703b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:42.708615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1394/2733] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:44:42 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:42.712796 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76d7a9-05fd-4fa6-a2e5-20061f8631c4 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:42.723197 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76d7a9-05fd-4fa6-a2e5-20061f8631c4 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:42.777804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11fd05-9191-4719-bfea-6b61dd947d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:42.778392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11fd05-9191-4719-bfea-6b61dd947d39 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:42.778672 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11fd05-9191-4719-bfea-6b61dd947d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:42.778945 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11fd05-9191-4719-bfea-6b61dd947d39 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:42.779656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11fd05-9191-4719-bfea-6b61dd947d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:42.781569 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11fd05-9191-4719-bfea-6b61dd947d39 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:42.800602 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1340/2734] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:44:42 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:42.804840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed30f6-280d-443e-b051-6a461d9d703b admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:42.815738 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed30f6-280d-443e-b051-6a461d9d703b admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:42.820394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddb9c4-589f-4e40-a524-f525a2b22262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:42.821048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddb9c4-589f-4e40-a524-f525a2b22262 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:42.821334 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddb9c4-589f-4e40-a524-f525a2b22262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:42.821612 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddb9c4-589f-4e40-a524-f525a2b22262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:42.822338 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddb9c4-589f-4e40-a524-f525a2b22262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:42.823968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddb9c4-589f-4e40-a524-f525a2b22262 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:42.835764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1395/2735] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:42.839483 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11fd05-9191-4719-bfea-6b61dd947d39 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:42.850547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11fd05-9191-4719-bfea-6b61dd947d39 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:42.855705 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251fd30-ab57-468d-9204-508906f3b54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:42.856373 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251fd30-ab57-468d-9204-508906f3b54f admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:42.856657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251fd30-ab57-468d-9204-508906f3b54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:42.856932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251fd30-ab57-468d-9204-508906f3b54f admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:42.857663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251fd30-ab57-468d-9204-508906f3b54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:42.859246 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251fd30-ab57-468d-9204-508906f3b54f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:42.869667 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1341/2736] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:42.874215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddb9c4-589f-4e40-a524-f525a2b22262 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:42.885007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddb9c4-589f-4e40-a524-f525a2b22262 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:42.891056 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18a425-2692-42c0-9d03-72300b67b644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:42.891975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18a425-2692-42c0-9d03-72300b67b644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:42.892267 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18a425-2692-42c0-9d03-72300b67b644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:42.892548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18a425-2692-42c0-9d03-72300b67b644 admin admin] PATH_INFO: `/v3/projects/03ad8db95d20441db0ce9925e19a8c7b/users/3bce4a020a6541c7814ef924a87a51ee/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:42.907597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18a425-2692-42c0-9d03-72300b67b644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ad8db95d20441db0ce9925e19a8c7b, user_id=3bce4a020a6541c7814ef924a87a51ee, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:42.910351 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18a425-2692-42c0-9d03-72300b67b644 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:42.913457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:42.925975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1396/2737] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:42 2022] PUT /identity/v3/projects/03ad8db95d20441db0ce9925e19a8c7b/users/3bce4a020a6541c7814ef924a87a51ee/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:42.936940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2edef-6903-4b02-b58e-9c4070e5e878 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:42.937454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2edef-6903-4b02-b58e-9c4070e5e878 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:42.937699 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2edef-6903-4b02-b58e-9c4070e5e878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:42.969008 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-fde2edef-6903-4b02-b58e-9c4070e5e878 None None] MFA Rules not processed for user `3bce4a020a6541c7814ef924a87a51ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:42.970216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-fde2edef-6903-4b02-b58e-9c4070e5e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:43.045692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1342/2738] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:43.050082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18a425-2692-42c0-9d03-72300b67b644 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:43.114626 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18a425-2692-42c0-9d03-72300b67b644 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:43.119317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ba21f-90dc-49b8-8bbc-5dd733079e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:43.119988 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ba21f-90dc-49b8-8bbc-5dd733079e4a admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:43.120271 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ba21f-90dc-49b8-8bbc-5dd733079e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:43.120543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ba21f-90dc-49b8-8bbc-5dd733079e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:43.121289 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ba21f-90dc-49b8-8bbc-5dd733079e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:43.123880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ba21f-90dc-49b8-8bbc-5dd733079e4a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:43.149485 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1397/2739] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:44:43 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:43.153597 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2edef-6903-4b02-b58e-9c4070e5e878 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:43.164387 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2edef-6903-4b02-b58e-9c4070e5e878 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:43.185478 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:43.234588 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3705f8-16b8-43a8-b6b9-81b85954fa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:43.235265 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3705f8-16b8-43a8-b6b9-81b85954fa7f admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:43.235587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3705f8-16b8-43a8-b6b9-81b85954fa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:43.236100 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3705f8-16b8-43a8-b6b9-81b85954fa7f admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:43.236825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3705f8-16b8-43a8-b6b9-81b85954fa7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:43.238733 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3705f8-16b8-43a8-b6b9-81b85954fa7f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:43.260078 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1343/2740] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:44:43 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:43.264313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ba21f-90dc-49b8-8bbc-5dd733079e4a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:43.275169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ba21f-90dc-49b8-8bbc-5dd733079e4a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:43.279773 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83771c-3e09-4929-ad02-69f3e7337aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:43.280474 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83771c-3e09-4929-ad02-69f3e7337aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:43.280702 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83771c-3e09-4929-ad02-69f3e7337aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:43.280971 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83771c-3e09-4929-ad02-69f3e7337aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:43.281715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83771c-3e09-4929-ad02-69f3e7337aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:43.283276 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83771c-3e09-4929-ad02-69f3e7337aa2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:43.293875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1398/2741] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:43.298605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3705f8-16b8-43a8-b6b9-81b85954fa7f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:43.308426 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3705f8-16b8-43a8-b6b9-81b85954fa7f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:43.313609 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5c875-a7f5-4d3d-be80-0ea69d68b6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:43.314475 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5c875-a7f5-4d3d-be80-0ea69d68b6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:43.314754 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5c875-a7f5-4d3d-be80-0ea69d68b6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:43.315026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5c875-a7f5-4d3d-be80-0ea69d68b6c9 admin admin] PATH_INFO: `/v3/projects/e334b7901b2d4219a3c043648322a036/users/452325c323d64488967b0e605629c5a1/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:43.329308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5c875-a7f5-4d3d-be80-0ea69d68b6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e334b7901b2d4219a3c043648322a036, user_id=452325c323d64488967b0e605629c5a1, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:43.332028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5c875-a7f5-4d3d-be80-0ea69d68b6c9 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:43.345230 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1344/2742] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:43 2022] PUT /identity/v3/projects/e334b7901b2d4219a3c043648322a036/users/452325c323d64488967b0e605629c5a1/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:43.349373 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83771c-3e09-4929-ad02-69f3e7337aa2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:43.359919 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83771c-3e09-4929-ad02-69f3e7337aa2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:43.416189 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787ffea-7053-4f0a-b1c5-6ec1d92a6802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:43.416853 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ffea-7053-4f0a-b1c5-6ec1d92a6802 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:43.417139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ffea-7053-4f0a-b1c5-6ec1d92a6802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:43.417417 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ffea-7053-4f0a-b1c5-6ec1d92a6802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:43.418139 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787ffea-7053-4f0a-b1c5-6ec1d92a6802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:43.419769 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787ffea-7053-4f0a-b1c5-6ec1d92a6802 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:43.430045 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1399/2743] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:43.434251 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5c875-a7f5-4d3d-be80-0ea69d68b6c9 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:43.445103 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5c875-a7f5-4d3d-be80-0ea69d68b6c9 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:43.449750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c448e60-2b59-4e38-998c-fa014162e90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:43.450621 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c448e60-2b59-4e38-998c-fa014162e90f admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:43.450905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c448e60-2b59-4e38-998c-fa014162e90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:43.451180 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c448e60-2b59-4e38-998c-fa014162e90f admin admin] PATH_INFO: `/v3/projects/e334b7901b2d4219a3c043648322a036/users/452325c323d64488967b0e605629c5a1/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:43.453182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c448e60-2b59-4e38-998c-fa014162e90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e334b7901b2d4219a3c043648322a036, user_id=452325c323d64488967b0e605629c5a1, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:43.455835 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c448e60-2b59-4e38-998c-fa014162e90f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:43.466531 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1345/2744] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:43 2022] PUT /identity/v3/projects/e334b7901b2d4219a3c043648322a036/users/452325c323d64488967b0e605629c5a1/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:43.477033 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9d0bb-d494-4f52-9a18-27194b52bc1b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:43.477329 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9d0bb-d494-4f52-9a18-27194b52bc1b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:43.477640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9d0bb-d494-4f52-9a18-27194b52bc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:43.504259 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-bfb9d0bb-d494-4f52-9a18-27194b52bc1b None None] MFA Rules not processed for user `452325c323d64488967b0e605629c5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:43.505736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-bfb9d0bb-d494-4f52-9a18-27194b52bc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:43.557584 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:43.579026 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1400/2745] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:44:43.589904 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c448e60-2b59-4e38-998c-fa014162e90f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:43.591652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-9c448e60-2b59-4e38-998c-fa014162e90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:43.650727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c448e60-2b59-4e38-998c-fa014162e90f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:43.654991 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40711f4-7930-4a03-83e5-7c80f1f0716f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:43.655666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40711f4-7930-4a03-83e5-7c80f1f0716f service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:43.655952 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40711f4-7930-4a03-83e5-7c80f1f0716f service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:43.656231 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40711f4-7930-4a03-83e5-7c80f1f0716f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:43.665603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40711f4-7930-4a03-83e5-7c80f1f0716f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:43.667033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40711f4-7930-4a03-83e5-7c80f1f0716f service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:43.677504 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1346/2746] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:43.774922 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9d0bb-d494-4f52-9a18-27194b52bc1b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:43.785320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9d0bb-d494-4f52-9a18-27194b52bc1b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:43.788840 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1208625-e817-4c92-822d-fd9e523ccb09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:43.789476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1208625-e817-4c92-822d-fd9e523ccb09 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:43.789758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1208625-e817-4c92-822d-fd9e523ccb09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:43.790034 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1208625-e817-4c92-822d-fd9e523ccb09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:43.846775 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1208625-e817-4c92-822d-fd9e523ccb09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:43.848244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1208625-e817-4c92-822d-fd9e523ccb09 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:43.857170 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1401/2747] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:44.078361 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40711f4-7930-4a03-83e5-7c80f1f0716f service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:44.080041 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a40711f4-7930-4a03-83e5-7c80f1f0716f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:44.159158 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40711f4-7930-4a03-83e5-7c80f1f0716f service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:44.163886 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cdce0-46d1-4af6-b795-39f0181ad472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:44.164756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cdce0-46d1-4af6-b795-39f0181ad472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:44.165035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cdce0-46d1-4af6-b795-39f0181ad472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:44.165304 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68cdce0-46d1-4af6-b795-39f0181ad472 admin admin] PATH_INFO: `/v3/users/a057a8b09b224d268ad055a7c15ef37b` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:44.166497 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cdce0-46d1-4af6-b795-39f0181ad472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a057a8b09b224d268ad055a7c15ef37b)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:44.168440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68cdce0-46d1-4af6-b795-39f0181ad472 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:44.190794 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:44.218339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e68cdce0-46d1-4af6-b795-39f0181ad472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a057a8b09b224d268ad055a7c15ef37b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:44.229912 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e68cdce0-46d1-4af6-b795-39f0181ad472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a057a8b09b224d268ad055a7c15ef37b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:44.230582 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e68cdce0-46d1-4af6-b795-39f0181ad472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a057a8b09b224d268ad055a7c15ef37b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:44.243086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e68cdce0-46d1-4af6-b795-39f0181ad472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a057a8b09b224d268ad055a7c15ef37b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:44.243819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-e68cdce0-46d1-4af6-b795-39f0181ad472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a057a8b09b224d268ad055a7c15ef37b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:44.257362 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1347/2748] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:44:44 2022] DELETE /identity/v3/users/a057a8b09b224d268ad055a7c15ef37b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:44.262072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48175-bb02-4193-b4e4-34f9f5b8b2a9 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:44.262409 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48175-bb02-4193-b4e4-34f9f5b8b2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:44.262693 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48175-bb02-4193-b4e4-34f9f5b8b2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:44.281247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-efa48175-bb02-4193-b4e4-34f9f5b8b2a9 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:44.282657 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-efa48175-bb02-4193-b4e4-34f9f5b8b2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:44.341437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1402/2749] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:44.351104 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cdce0-46d1-4af6-b795-39f0181ad472 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:44.352611 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-e68cdce0-46d1-4af6-b795-39f0181ad472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:44.409935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68cdce0-46d1-4af6-b795-39f0181ad472 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:44.413460 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa5246-57b4-4008-be02-87743577d0d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:44.414099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5246-57b4-4008-be02-87743577d0d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:44.414378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5246-57b4-4008-be02-87743577d0d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:44.414653 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa5246-57b4-4008-be02-87743577d0d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:44.423890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa5246-57b4-4008-be02-87743577d0d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:44.425311 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa5246-57b4-4008-be02-87743577d0d4 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:44.434636 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1348/2750] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:44.704368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa48175-bb02-4193-b4e4-34f9f5b8b2a9 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:44.705826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-efa48175-bb02-4193-b4e4-34f9f5b8b2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:44.719294 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa48175-bb02-4193-b4e4-34f9f5b8b2a9 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:44.724378 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22ebf7-7c2a-403b-8334-8430b87c9f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:44.725248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22ebf7-7c2a-403b-8334-8430b87c9f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:44.725676 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22ebf7-7c2a-403b-8334-8430b87c9f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:44.725965 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22ebf7-7c2a-403b-8334-8430b87c9f18 admin admin] PATH_INFO: `/v3/projects/8ebbf6ca0dd8478e98d60259fc79df0d` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:44.727161 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22ebf7-7c2a-403b-8334-8430b87c9f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ebbf6ca0dd8478e98d60259fc79df0d)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:44.729106 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22ebf7-7c2a-403b-8334-8430b87c9f18 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:44.779681 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4b22ebf7-7c2a-403b-8334-8430b87c9f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ebbf6ca0dd8478e98d60259fc79df0d', 'request_id': 'req-4b22ebf7-7c2a-403b-8334-8430b87c9f18'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:44.785696 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4b22ebf7-7c2a-403b-8334-8430b87c9f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ebbf6ca0dd8478e98d60259fc79df0d', 'request_id': 'req-4b22ebf7-7c2a-403b-8334-8430b87c9f18'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:44.792992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4b22ebf7-7c2a-403b-8334-8430b87c9f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ebbf6ca0dd8478e98d60259fc79df0d', 'request_id': 'req-4b22ebf7-7c2a-403b-8334-8430b87c9f18'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:44.804592 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4b22ebf7-7c2a-403b-8334-8430b87c9f18 admin admin] The token cache is being invalidate because project 8ebbf6ca0dd8478e98d60259fc79df0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:44.804933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4b22ebf7-7c2a-403b-8334-8430b87c9f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:44.805732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-4b22ebf7-7c2a-403b-8334-8430b87c9f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:44.807327 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1403/2751] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:44:44 2022] DELETE /identity/v3/projects/8ebbf6ca0dd8478e98d60259fc79df0d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:46.434677 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa5246-57b4-4008-be02-87743577d0d4 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:46.436177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-06aa5246-57b4-4008-be02-87743577d0d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:46.448874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa5246-57b4-4008-be02-87743577d0d4 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:46.506031 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aacb67-557e-421b-b79f-daf1f593b036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:46.506902 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aacb67-557e-421b-b79f-daf1f593b036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:46.507179 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aacb67-557e-421b-b79f-daf1f593b036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:46.507450 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aacb67-557e-421b-b79f-daf1f593b036 admin admin] PATH_INFO: `/v3/users/3bce4a020a6541c7814ef924a87a51ee` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:46.508641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aacb67-557e-421b-b79f-daf1f593b036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bce4a020a6541c7814ef924a87a51ee)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:46.510570 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aacb67-557e-421b-b79f-daf1f593b036 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:46.551681 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:46.556827 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-40aacb67-557e-421b-b79f-daf1f593b036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bce4a020a6541c7814ef924a87a51ee'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:46.573062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-40aacb67-557e-421b-b79f-daf1f593b036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bce4a020a6541c7814ef924a87a51ee'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:46.573804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-40aacb67-557e-421b-b79f-daf1f593b036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bce4a020a6541c7814ef924a87a51ee'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:46.586769 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-40aacb67-557e-421b-b79f-daf1f593b036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bce4a020a6541c7814ef924a87a51ee'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:46.587401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-40aacb67-557e-421b-b79f-daf1f593b036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bce4a020a6541c7814ef924a87a51ee'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:46.600291 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1349/2752] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:44:46 2022] DELETE /identity/v3/users/3bce4a020a6541c7814ef924a87a51ee => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:46.604969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0251b9-1563-4b5f-b629-84a47809ea5f None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:46.605460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0251b9-1563-4b5f-b629-84a47809ea5f None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:46.605562 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0251b9-1563-4b5f-b629-84a47809ea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:46.622855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-8d0251b9-1563-4b5f-b629-84a47809ea5f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:46.624599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8d0251b9-1563-4b5f-b629-84a47809ea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:46.633235 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:46.697188 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1404/2753] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:46.707389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aacb67-557e-421b-b79f-daf1f593b036 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:46.708807 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-40aacb67-557e-421b-b79f-daf1f593b036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:46.765112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aacb67-557e-421b-b79f-daf1f593b036 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:46.768816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aaf6a-63c3-4fb7-b383-5adf02915d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:46.769465 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aaf6a-63c3-4fb7-b383-5adf02915d8b service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:46.769749 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aaf6a-63c3-4fb7-b383-5adf02915d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:46.770025 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aaf6a-63c3-4fb7-b383-5adf02915d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:46.779212 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10aaf6a-63c3-4fb7-b383-5adf02915d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:46.780711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10aaf6a-63c3-4fb7-b383-5adf02915d8b service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:46.790091 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1350/2754] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:47.068061 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0251b9-1563-4b5f-b629-84a47809ea5f None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:47.069493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-8d0251b9-1563-4b5f-b629-84a47809ea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:47.083135 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0251b9-1563-4b5f-b629-84a47809ea5f None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:47.087993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:47.088854 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:47.089129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:47.089410 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] PATH_INFO: `/v3/projects/03ad8db95d20441db0ce9925e19a8c7b` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:47.090586 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ad8db95d20441db0ce9925e19a8c7b)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:47.092570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:47.140719 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ad8db95d20441db0ce9925e19a8c7b', 'request_id': 'req-35308334-f87f-4537-9a89-5179f6dc7e10'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.146674 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ad8db95d20441db0ce9925e19a8c7b', 'request_id': 'req-35308334-f87f-4537-9a89-5179f6dc7e10'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.153452 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ad8db95d20441db0ce9925e19a8c7b', 'request_id': 'req-35308334-f87f-4537-9a89-5179f6dc7e10'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.164451 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] The token cache is being invalidate because project 03ad8db95d20441db0ce9925e19a8c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:47.164747 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.165356 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.166906 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1405/2755] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:44:47 2022] DELETE /identity/v3/projects/03ad8db95d20441db0ce9925e19a8c7b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:47.171378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aaf6a-63c3-4fb7-b383-5adf02915d8b service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:47.181023 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aaf6a-63c3-4fb7-b383-5adf02915d8b service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:47.237860 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6d1b1-738e-4601-995b-d1cc472c054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:47.238649 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6d1b1-738e-4601-995b-d1cc472c054d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:47.238934 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6d1b1-738e-4601-995b-d1cc472c054d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:47.239217 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6d1b1-738e-4601-995b-d1cc472c054d admin admin] PATH_INFO: `/v3/users/452325c323d64488967b0e605629c5a1` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:47.240440 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6d1b1-738e-4601-995b-d1cc472c054d admin admin] RBAC: Authorizing `identity:delete_user(user_id=452325c323d64488967b0e605629c5a1)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:47.242397 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6d1b1-738e-4601-995b-d1cc472c054d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:47.286300 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-94d6d1b1-738e-4601-995b-d1cc472c054d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452325c323d64488967b0e605629c5a1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.297625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:47.298777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-94d6d1b1-738e-4601-995b-d1cc472c054d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452325c323d64488967b0e605629c5a1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.299543 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-94d6d1b1-738e-4601-995b-d1cc472c054d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452325c323d64488967b0e605629c5a1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.306881 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-94d6d1b1-738e-4601-995b-d1cc472c054d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452325c323d64488967b0e605629c5a1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.307720 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-94d6d1b1-738e-4601-995b-d1cc472c054d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452325c323d64488967b0e605629c5a1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.320377 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1351/2756] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:44:47 2022] DELETE /identity/v3/users/452325c323d64488967b0e605629c5a1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:47.590615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:47.592051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:47.608602 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35308334-f87f-4537-9a89-5179f6dc7e10 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:47.668319 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727354e-4350-4f68-9be3-363fccce789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:47.669192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727354e-4350-4f68-9be3-363fccce789d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:47.669476 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727354e-4350-4f68-9be3-363fccce789d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:47.669751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727354e-4350-4f68-9be3-363fccce789d admin admin] PATH_INFO: `/v3/projects/e334b7901b2d4219a3c043648322a036` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:47.670954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727354e-4350-4f68-9be3-363fccce789d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e334b7901b2d4219a3c043648322a036)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:47.673066 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727354e-4350-4f68-9be3-363fccce789d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:47.713317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:47.722693 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d727354e-4350-4f68-9be3-363fccce789d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e334b7901b2d4219a3c043648322a036', 'request_id': 'req-d727354e-4350-4f68-9be3-363fccce789d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.728094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d727354e-4350-4f68-9be3-363fccce789d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e334b7901b2d4219a3c043648322a036', 'request_id': 'req-d727354e-4350-4f68-9be3-363fccce789d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.735523 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d727354e-4350-4f68-9be3-363fccce789d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e334b7901b2d4219a3c043648322a036', 'request_id': 'req-d727354e-4350-4f68-9be3-363fccce789d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.746465 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d727354e-4350-4f68-9be3-363fccce789d admin admin] The token cache is being invalidate because project e334b7901b2d4219a3c043648322a036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:47.746750 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d727354e-4350-4f68-9be3-363fccce789d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.747363 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d727354e-4350-4f68-9be3-363fccce789d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:47.748956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1406/2757] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:44:47 2022] DELETE /identity/v3/projects/e334b7901b2d4219a3c043648322a036 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:47.754768 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3425f5-8695-4e37-8ddc-bd4583aacafc None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:47.755280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3425f5-8695-4e37-8ddc-bd4583aacafc None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:47.755714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3425f5-8695-4e37-8ddc-bd4583aacafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:47.774157 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-6f3425f5-8695-4e37-8ddc-bd4583aacafc None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:47.775298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6f3425f5-8695-4e37-8ddc-bd4583aacafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:47.833866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1352/2758] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:47.841650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9356f5-fc2f-4e9a-9fe7-f7bf3abd1216 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:47.841941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9356f5-fc2f-4e9a-9fe7-f7bf3abd1216 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:47.842220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9356f5-fc2f-4e9a-9fe7-f7bf3abd1216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:47.860578 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-cf9356f5-fc2f-4e9a-9fe7-f7bf3abd1216 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:47.861764 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-cf9356f5-fc2f-4e9a-9fe7-f7bf3abd1216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:47.869523 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1407/2759] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:47.873624 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3425f5-8695-4e37-8ddc-bd4583aacafc None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:47.883392 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3425f5-8695-4e37-8ddc-bd4583aacafc None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:47.887922 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bdfc7-94ed-4b59-ba19-64486e96c873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:47.888565 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bdfc7-94ed-4b59-ba19-64486e96c873 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:47.888843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bdfc7-94ed-4b59-ba19-64486e96c873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:47.889112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bdfc7-94ed-4b59-ba19-64486e96c873 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:47.890327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bdfc7-94ed-4b59-ba19-64486e96c873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:44:47.890627 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bdfc7-94ed-4b59-ba19-64486e96c873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:47.892240 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bdfc7-94ed-4b59-ba19-64486e96c873 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:47.903330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1353/2760] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:44:47.908163 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9356f5-fc2f-4e9a-9fe7-f7bf3abd1216 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:47.917257 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9356f5-fc2f-4e9a-9fe7-f7bf3abd1216 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:47.921839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e6253-0196-404f-8af9-ef33c3d918dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:47.922477 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e6253-0196-404f-8af9-ef33c3d918dd admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:47.922755 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e6253-0196-404f-8af9-ef33c3d918dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:47.923027 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e6253-0196-404f-8af9-ef33c3d918dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:47.923749 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e6253-0196-404f-8af9-ef33c3d918dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:47.925679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e6253-0196-404f-8af9-ef33c3d918dd admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:47.950217 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1408/2761] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:44:47 2022] POST /identity/v3/projects => generated 385 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:47.955243 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bdfc7-94ed-4b59-ba19-64486e96c873 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:47.965129 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bdfc7-94ed-4b59-ba19-64486e96c873 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:48.025514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c355410-79ec-44dd-bb72-e989f4f5fca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:48.026106 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c355410-79ec-44dd-bb72-e989f4f5fca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:48.026390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c355410-79ec-44dd-bb72-e989f4f5fca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:48.026663 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c355410-79ec-44dd-bb72-e989f4f5fca6 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:48.027359 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c355410-79ec-44dd-bb72-e989f4f5fca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:48.029315 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c355410-79ec-44dd-bb72-e989f4f5fca6 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:48.049243 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1354/2762] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:44:47 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:48.053620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e6253-0196-404f-8af9-ef33c3d918dd admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:48.064966 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e6253-0196-404f-8af9-ef33c3d918dd admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:48.069505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f549ae-8191-4811-914f-8a293351642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:48.070154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f549ae-8191-4811-914f-8a293351642a admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:48.070438 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f549ae-8191-4811-914f-8a293351642a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:48.070712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f549ae-8191-4811-914f-8a293351642a admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:48.071440 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f549ae-8191-4811-914f-8a293351642a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:48.073052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f549ae-8191-4811-914f-8a293351642a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:48.083891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1409/2763] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:44:48.087731 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c355410-79ec-44dd-bb72-e989f4f5fca6 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:48.097939 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c355410-79ec-44dd-bb72-e989f4f5fca6 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:48.102592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff5c84-f85a-4f27-9b6f-5836beda4023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:48.103253 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5c84-f85a-4f27-9b6f-5836beda4023 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:48.103580 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5c84-f85a-4f27-9b6f-5836beda4023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:48.103865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5c84-f85a-4f27-9b6f-5836beda4023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:48.104595 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff5c84-f85a-4f27-9b6f-5836beda4023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:48.106188 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff5c84-f85a-4f27-9b6f-5836beda4023 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:48.116243 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1355/2764] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:48.120286 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f549ae-8191-4811-914f-8a293351642a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:48.130941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f549ae-8191-4811-914f-8a293351642a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:48.135520 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b727de4-0449-42cd-8c24-7f7705acd601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:48.136391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b727de4-0449-42cd-8c24-7f7705acd601 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:48.136673 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b727de4-0449-42cd-8c24-7f7705acd601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:48.136946 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b727de4-0449-42cd-8c24-7f7705acd601 admin admin] PATH_INFO: `/v3/projects/d344616259ad4f7fb26febc842cdb09c/users/1550ffb201aa4610aa2ec3c4d0270f07/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:48.152352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b727de4-0449-42cd-8c24-7f7705acd601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d344616259ad4f7fb26febc842cdb09c, user_id=1550ffb201aa4610aa2ec3c4d0270f07, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:48.155100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b727de4-0449-42cd-8c24-7f7705acd601 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:48.167596 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1410/2765] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:48 2022] PUT /identity/v3/projects/d344616259ad4f7fb26febc842cdb09c/users/1550ffb201aa4610aa2ec3c4d0270f07/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:48.178156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533354ab-5b18-49b4-82a6-58ccfb12a18c None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:48.178495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533354ab-5b18-49b4-82a6-58ccfb12a18c None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:48.178861 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533354ab-5b18-49b4-82a6-58ccfb12a18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:48.207750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-533354ab-5b18-49b4-82a6-58ccfb12a18c None None] MFA Rules not processed for user `1550ffb201aa4610aa2ec3c4d0270f07`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:48.208955 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-533354ab-5b18-49b4-82a6-58ccfb12a18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:48.241717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:48.284203 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1356/2766] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:48.296542 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b727de4-0449-42cd-8c24-7f7705acd601 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:48.298455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6b727de4-0449-42cd-8c24-7f7705acd601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:48.360739 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b727de4-0449-42cd-8c24-7f7705acd601 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:48.365094 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd828cf8-66ea-452b-96ff-529dfb295035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:48.365915 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd828cf8-66ea-452b-96ff-529dfb295035 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:48.366154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd828cf8-66ea-452b-96ff-529dfb295035 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:48.366481 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd828cf8-66ea-452b-96ff-529dfb295035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:48.376018 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd828cf8-66ea-452b-96ff-529dfb295035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:48.377645 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd828cf8-66ea-452b-96ff-529dfb295035 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:48.387728 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1411/2767] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:44:48.409033 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533354ab-5b18-49b4-82a6-58ccfb12a18c None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:48.475942 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533354ab-5b18-49b4-82a6-58ccfb12a18c None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:48.480653 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96df3e-6e0a-4feb-a844-e066f691a3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:48.481534 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96df3e-6e0a-4feb-a844-e066f691a3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:48.481818 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96df3e-6e0a-4feb-a844-e066f691a3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:48.482095 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96df3e-6e0a-4feb-a844-e066f691a3a1 admin admin] PATH_INFO: `/v3/users/1550ffb201aa4610aa2ec3c4d0270f07` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:48.483356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96df3e-6e0a-4feb-a844-e066f691a3a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1550ffb201aa4610aa2ec3c4d0270f07)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:48.485894 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96df3e-6e0a-4feb-a844-e066f691a3a1 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:48.539154 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4b96df3e-6e0a-4feb-a844-e066f691a3a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1550ffb201aa4610aa2ec3c4d0270f07'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:48.551932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4b96df3e-6e0a-4feb-a844-e066f691a3a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1550ffb201aa4610aa2ec3c4d0270f07'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:48.552689 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4b96df3e-6e0a-4feb-a844-e066f691a3a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1550ffb201aa4610aa2ec3c4d0270f07'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:48.561292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4b96df3e-6e0a-4feb-a844-e066f691a3a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1550ffb201aa4610aa2ec3c4d0270f07'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:48.562637 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-4b96df3e-6e0a-4feb-a844-e066f691a3a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1550ffb201aa4610aa2ec3c4d0270f07'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:48.578433 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1357/2768] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:44:48 2022] DELETE /identity/v3/users/1550ffb201aa4610aa2ec3c4d0270f07 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:44:48.583062 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26a112-204f-40e0-8494-43a2f42dc767 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:48.583350 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26a112-204f-40e0-8494-43a2f42dc767 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:48.583659 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26a112-204f-40e0-8494-43a2f42dc767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:48.601794 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6f26a112-204f-40e0-8494-43a2f42dc767 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:48.602997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6f26a112-204f-40e0-8494-43a2f42dc767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:48.667968 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1412/2769] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:48.678394 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96df3e-6e0a-4feb-a844-e066f691a3a1 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:48.679847 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4b96df3e-6e0a-4feb-a844-e066f691a3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:48.737786 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96df3e-6e0a-4feb-a844-e066f691a3a1 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:48.741417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db1337-4053-4b81-9f4d-bef24e55bc9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:48.742066 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db1337-4053-4b81-9f4d-bef24e55bc9f service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:48.742351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db1337-4053-4b81-9f4d-bef24e55bc9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:48.742635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db1337-4053-4b81-9f4d-bef24e55bc9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:48.751949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db1337-4053-4b81-9f4d-bef24e55bc9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:48.753381 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db1337-4053-4b81-9f4d-bef24e55bc9f service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:48.757554 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:48.765365 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1358/2770] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:49.028205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26a112-204f-40e0-8494-43a2f42dc767 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:49.029664 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6f26a112-204f-40e0-8494-43a2f42dc767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:49.042678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26a112-204f-40e0-8494-43a2f42dc767 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:49.048052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d22a5-2d6e-414e-b143-3b964fc254ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:49.049402 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d22a5-2d6e-414e-b143-3b964fc254ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.049402 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d22a5-2d6e-414e-b143-3b964fc254ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:49.049650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d22a5-2d6e-414e-b143-3b964fc254ea admin admin] PATH_INFO: `/v3/projects/d344616259ad4f7fb26febc842cdb09c` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:49.050805 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d22a5-2d6e-414e-b143-3b964fc254ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d344616259ad4f7fb26febc842cdb09c)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:49.053395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d22a5-2d6e-414e-b143-3b964fc254ea admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:49.055163 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:49.102406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-324d22a5-2d6e-414e-b143-3b964fc254ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd344616259ad4f7fb26febc842cdb09c', 'request_id': 'req-324d22a5-2d6e-414e-b143-3b964fc254ea'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:49.107928 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-324d22a5-2d6e-414e-b143-3b964fc254ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd344616259ad4f7fb26febc842cdb09c', 'request_id': 'req-324d22a5-2d6e-414e-b143-3b964fc254ea'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:49.115583 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-324d22a5-2d6e-414e-b143-3b964fc254ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd344616259ad4f7fb26febc842cdb09c', 'request_id': 'req-324d22a5-2d6e-414e-b143-3b964fc254ea'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:49.126851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-324d22a5-2d6e-414e-b143-3b964fc254ea admin admin] The token cache is being invalidate because project d344616259ad4f7fb26febc842cdb09c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:49.127138 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-324d22a5-2d6e-414e-b143-3b964fc254ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:49.127778 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-324d22a5-2d6e-414e-b143-3b964fc254ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:49.129348 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1413/2771] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:44:49 2022] DELETE /identity/v3/projects/d344616259ad4f7fb26febc842cdb09c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:49.134487 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc7dfd-c696-49b9-97e5-7a29a872f327 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.134772 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc7dfd-c696-49b9-97e5-7a29a872f327 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:49.135062 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc7dfd-c696-49b9-97e5-7a29a872f327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:49.154317 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-badc7dfd-c696-49b9-97e5-7a29a872f327 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:49.155657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-badc7dfd-c696-49b9-97e5-7a29a872f327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:49.216340 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1359/2772] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:49.225330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ff567-55d1-49d0-a9da-4c505c5b79c8 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.225626 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ff567-55d1-49d0-a9da-4c505c5b79c8 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:49.225912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ff567-55d1-49d0-a9da-4c505c5b79c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:49.244659 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-b68ff567-55d1-49d0-a9da-4c505c5b79c8 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:49.245908 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-b68ff567-55d1-49d0-a9da-4c505c5b79c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:49.257377 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1414/2773] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:49.261586 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc7dfd-c696-49b9-97e5-7a29a872f327 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:49.271896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc7dfd-c696-49b9-97e5-7a29a872f327 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:49.277018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e35f4f-92c6-434e-9bd4-e2e5fbcdff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:49.277681 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e35f4f-92c6-434e-9bd4-e2e5fbcdff80 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.277970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e35f4f-92c6-434e-9bd4-e2e5fbcdff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:49.278258 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e35f4f-92c6-434e-9bd4-e2e5fbcdff80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:49.278989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e35f4f-92c6-434e-9bd4-e2e5fbcdff80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:44:49.279304 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e35f4f-92c6-434e-9bd4-e2e5fbcdff80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:49.281014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e35f4f-92c6-434e-9bd4-e2e5fbcdff80 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:49.293081 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1360/2774] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:44:49.298994 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ff567-55d1-49d0-a9da-4c505c5b79c8 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:49.308939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ff567-55d1-49d0-a9da-4c505c5b79c8 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:49.314947 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d13a-9733-458a-83c8-3508faa1dd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:49.315640 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d13a-9733-458a-83c8-3508faa1dd17 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.315923 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d13a-9733-458a-83c8-3508faa1dd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:49.316264 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6d13a-9733-458a-83c8-3508faa1dd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:49.316962 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6d13a-9733-458a-83c8-3508faa1dd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:49.318936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6d13a-9733-458a-83c8-3508faa1dd17 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:49.344972 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1415/2775] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:44:49 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:49.349512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e35f4f-92c6-434e-9bd4-e2e5fbcdff80 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:49.361210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e35f4f-92c6-434e-9bd4-e2e5fbcdff80 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:49.421000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdd306-009e-456d-9800-ee6d95df407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:49.422211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdd306-009e-456d-9800-ee6d95df407f admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.422499 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdd306-009e-456d-9800-ee6d95df407f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:49.422777 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdd306-009e-456d-9800-ee6d95df407f admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:49.423508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdd306-009e-456d-9800-ee6d95df407f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:49.425652 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdd306-009e-456d-9800-ee6d95df407f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:49.448459 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1361/2776] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:44:49 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:49.453821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d13a-9733-458a-83c8-3508faa1dd17 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:49.467658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6d13a-9733-458a-83c8-3508faa1dd17 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:49.474404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0755f8-8c29-43b3-8614-d4e9194c7db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:49.475169 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0755f8-8c29-43b3-8614-d4e9194c7db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.475607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0755f8-8c29-43b3-8614-d4e9194c7db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:49.476054 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0755f8-8c29-43b3-8614-d4e9194c7db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:49.476993 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0755f8-8c29-43b3-8614-d4e9194c7db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:49.479133 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0755f8-8c29-43b3-8614-d4e9194c7db9 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:49.492732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1416/2777] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:49.496843 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdd306-009e-456d-9800-ee6d95df407f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:49.507626 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdd306-009e-456d-9800-ee6d95df407f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:49.513238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb446e-911a-4ddb-88e1-be3c17da3077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:49.513891 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb446e-911a-4ddb-88e1-be3c17da3077 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.514177 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb446e-911a-4ddb-88e1-be3c17da3077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:49.514509 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb446e-911a-4ddb-88e1-be3c17da3077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:49.515298 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb446e-911a-4ddb-88e1-be3c17da3077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:49.517019 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb446e-911a-4ddb-88e1-be3c17da3077 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:49.527493 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1362/2778] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:44:49.532741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0755f8-8c29-43b3-8614-d4e9194c7db9 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:49.542997 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0755f8-8c29-43b3-8614-d4e9194c7db9 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:49.548385 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce40b4-7d24-4118-b70f-eb1d069aef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:49.549253 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce40b4-7d24-4118-b70f-eb1d069aef38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.549538 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce40b4-7d24-4118-b70f-eb1d069aef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:49.549809 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce40b4-7d24-4118-b70f-eb1d069aef38 admin admin] PATH_INFO: `/v3/projects/68a255eceb0a412f8462145c9d03e283/users/95c4dd1f407e422d8b67330a212ad706/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:49.565067 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce40b4-7d24-4118-b70f-eb1d069aef38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a255eceb0a412f8462145c9d03e283, user_id=95c4dd1f407e422d8b67330a212ad706, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:49.567853 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce40b4-7d24-4118-b70f-eb1d069aef38 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:49.582207 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1417/2779] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:49 2022] PUT /identity/v3/projects/68a255eceb0a412f8462145c9d03e283/users/95c4dd1f407e422d8b67330a212ad706/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:44:49.595828 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284f43a-1751-4e0d-a7a3-cbc87bf88faa None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.596133 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284f43a-1751-4e0d-a7a3-cbc87bf88faa None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:49.596544 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284f43a-1751-4e0d-a7a3-cbc87bf88faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:49.629385 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-e284f43a-1751-4e0d-a7a3-cbc87bf88faa None None] MFA Rules not processed for user `95c4dd1f407e422d8b67330a212ad706`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:49.630795 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-e284f43a-1751-4e0d-a7a3-cbc87bf88faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:49.691424 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:49.707330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1363/2780] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:49.711967 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce40b4-7d24-4118-b70f-eb1d069aef38 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:49.776937 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce40b4-7d24-4118-b70f-eb1d069aef38 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:49.782212 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9cb5a-a3fe-4f95-8701-8736f3af327e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:49.782861 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9cb5a-a3fe-4f95-8701-8736f3af327e admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.783143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9cb5a-a3fe-4f95-8701-8736f3af327e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:49.783428 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9cb5a-a3fe-4f95-8701-8736f3af327e admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:49.784351 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9cb5a-a3fe-4f95-8701-8736f3af327e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:49.786058 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9cb5a-a3fe-4f95-8701-8736f3af327e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:49.812458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1418/2781] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:44:49 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:49.816883 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284f43a-1751-4e0d-a7a3-cbc87bf88faa None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:49.828016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284f43a-1751-4e0d-a7a3-cbc87bf88faa None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:49.884245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd288107-4332-4231-a627-cc3b131dbacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:49.884840 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd288107-4332-4231-a627-cc3b131dbacf admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.885117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd288107-4332-4231-a627-cc3b131dbacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:49.885389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd288107-4332-4231-a627-cc3b131dbacf admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:49.886084 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd288107-4332-4231-a627-cc3b131dbacf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:49.888042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd288107-4332-4231-a627-cc3b131dbacf admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:49.909638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1364/2782] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:44:49 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:44:49.913644 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9cb5a-a3fe-4f95-8701-8736f3af327e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:49.924015 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9cb5a-a3fe-4f95-8701-8736f3af327e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:49.929026 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4614b3-9b05-4b64-ac8f-079099b0b626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:49.929689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4614b3-9b05-4b64-ac8f-079099b0b626 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.929970 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4614b3-9b05-4b64-ac8f-079099b0b626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:49.930244 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4614b3-9b05-4b64-ac8f-079099b0b626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:49.930972 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4614b3-9b05-4b64-ac8f-079099b0b626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:49.932598 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4614b3-9b05-4b64-ac8f-079099b0b626 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:49.938017 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:49.944776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1419/2783] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:49.949124 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd288107-4332-4231-a627-cc3b131dbacf admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:49.959994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd288107-4332-4231-a627-cc3b131dbacf admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:49.964934 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf3ddb-7f16-4952-8755-3746770cd537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:49.965592 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3ddb-7f16-4952-8755-3746770cd537 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.965895 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3ddb-7f16-4952-8755-3746770cd537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:49.966171 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3ddb-7f16-4952-8755-3746770cd537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:49.966897 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf3ddb-7f16-4952-8755-3746770cd537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:49.969076 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf3ddb-7f16-4952-8755-3746770cd537 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:49.979295 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1365/2784] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:44:49.983379 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4614b3-9b05-4b64-ac8f-079099b0b626 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:49.993876 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4614b3-9b05-4b64-ac8f-079099b0b626 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:49.998556 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051a8dc-b9b4-44cc-b03e-4c84e7b5f41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:49.999446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051a8dc-b9b4-44cc-b03e-4c84e7b5f41a admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:49.999757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051a8dc-b9b4-44cc-b03e-4c84e7b5f41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:50.000031 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051a8dc-b9b4-44cc-b03e-4c84e7b5f41a admin admin] PATH_INFO: `/v3/projects/093701de390545af82550bbbaeb179b6/users/024b7137c4334b80849282f3f485bee2/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:50.014761 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051a8dc-b9b4-44cc-b03e-4c84e7b5f41a admin admin] RBAC: Authorizing `identity:create_grant(project_id=093701de390545af82550bbbaeb179b6, user_id=024b7137c4334b80849282f3f485bee2, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:50.019416 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051a8dc-b9b4-44cc-b03e-4c84e7b5f41a admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:50.039109 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1420/2785] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:49 2022] PUT /identity/v3/projects/093701de390545af82550bbbaeb179b6/users/024b7137c4334b80849282f3f485bee2/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:50.049804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d073c7-289f-424f-be7b-c658ec1a9524 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:50.050120 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d073c7-289f-424f-be7b-c658ec1a9524 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:50.050427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d073c7-289f-424f-be7b-c658ec1a9524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:50.078613 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-d0d073c7-289f-424f-be7b-c658ec1a9524 None None] MFA Rules not processed for user `024b7137c4334b80849282f3f485bee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:50.079874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-d0d073c7-289f-424f-be7b-c658ec1a9524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:50.143817 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1366/2786] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:50.148158 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051a8dc-b9b4-44cc-b03e-4c84e7b5f41a admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:50.211912 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051a8dc-b9b4-44cc-b03e-4c84e7b5f41a admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:50.218690 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a0797-79c3-4f48-b889-7b4e0bef2fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:50.219821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a0797-79c3-4f48-b889-7b4e0bef2fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:50.220110 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a0797-79c3-4f48-b889-7b4e0bef2fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:50.220394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a0797-79c3-4f48-b889-7b4e0bef2fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:50.221087 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a0797-79c3-4f48-b889-7b4e0bef2fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:50.223047 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a0797-79c3-4f48-b889-7b4e0bef2fb6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:50.248685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1421/2787] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:44:50 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:50.256350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d073c7-289f-424f-be7b-c658ec1a9524 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:50.269932 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d073c7-289f-424f-be7b-c658ec1a9524 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:50.332258 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741225ec-d705-409d-9e0c-5f66d371d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:50.332925 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741225ec-d705-409d-9e0c-5f66d371d9da admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:50.333208 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741225ec-d705-409d-9e0c-5f66d371d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:50.333478 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741225ec-d705-409d-9e0c-5f66d371d9da admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:50.334178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741225ec-d705-409d-9e0c-5f66d371d9da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:50.336168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741225ec-d705-409d-9e0c-5f66d371d9da admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:50.344214 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:50.359537 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1367/2788] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:44:50 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:50.363688 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a0797-79c3-4f48-b889-7b4e0bef2fb6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:50.375444 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a0797-79c3-4f48-b889-7b4e0bef2fb6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:50.381694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e31dde-c8bd-4e40-a7f5-2f1272a01597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:50.382529 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e31dde-c8bd-4e40-a7f5-2f1272a01597 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:50.382826 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e31dde-c8bd-4e40-a7f5-2f1272a01597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:50.383234 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e31dde-c8bd-4e40-a7f5-2f1272a01597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:50.384288 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e31dde-c8bd-4e40-a7f5-2f1272a01597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:50.386199 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e31dde-c8bd-4e40-a7f5-2f1272a01597 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:50.398776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1422/2789] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:50.403780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741225ec-d705-409d-9e0c-5f66d371d9da admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:50.414785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741225ec-d705-409d-9e0c-5f66d371d9da admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:50.419693 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed62b2-6f35-4af8-8723-925ca7481325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:50.420578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed62b2-6f35-4af8-8723-925ca7481325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:50.420866 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed62b2-6f35-4af8-8723-925ca7481325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:50.421199 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed62b2-6f35-4af8-8723-925ca7481325 admin admin] PATH_INFO: `/v3/projects/a20f9e37c11a42ea9f7d8a2c66ac4dd8/users/10fed46f05ca4f26b69f91d55eebebbd/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:50.438204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed62b2-6f35-4af8-8723-925ca7481325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20f9e37c11a42ea9f7d8a2c66ac4dd8, user_id=10fed46f05ca4f26b69f91d55eebebbd, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:50.440906 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed62b2-6f35-4af8-8723-925ca7481325 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:50.455234 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1368/2790] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:50 2022] PUT /identity/v3/projects/a20f9e37c11a42ea9f7d8a2c66ac4dd8/users/10fed46f05ca4f26b69f91d55eebebbd/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:50.459424 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e31dde-c8bd-4e40-a7f5-2f1272a01597 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:50.470302 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e31dde-c8bd-4e40-a7f5-2f1272a01597 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:50.532096 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d4dad-9ecb-444f-a106-b71527078cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:50.532847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d4dad-9ecb-444f-a106-b71527078cee admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:50.533053 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d4dad-9ecb-444f-a106-b71527078cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:50.533326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d4dad-9ecb-444f-a106-b71527078cee admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:50.534060 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d4dad-9ecb-444f-a106-b71527078cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:50.535689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d4dad-9ecb-444f-a106-b71527078cee admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:50.546141 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1423/2791] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:44:50.550865 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed62b2-6f35-4af8-8723-925ca7481325 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:50.561279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed62b2-6f35-4af8-8723-925ca7481325 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:50.566991 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23cfe4-c79b-44e6-8746-0863e86a5120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:50.567916 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23cfe4-c79b-44e6-8746-0863e86a5120 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:50.568375 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23cfe4-c79b-44e6-8746-0863e86a5120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:50.568656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23cfe4-c79b-44e6-8746-0863e86a5120 admin admin] PATH_INFO: `/v3/projects/a20f9e37c11a42ea9f7d8a2c66ac4dd8/users/10fed46f05ca4f26b69f91d55eebebbd/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:50.570633 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23cfe4-c79b-44e6-8746-0863e86a5120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20f9e37c11a42ea9f7d8a2c66ac4dd8, user_id=10fed46f05ca4f26b69f91d55eebebbd, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:50.573293 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23cfe4-c79b-44e6-8746-0863e86a5120 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:50.585114 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1369/2792] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:50 2022] PUT /identity/v3/projects/a20f9e37c11a42ea9f7d8a2c66ac4dd8/users/10fed46f05ca4f26b69f91d55eebebbd/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:50.597597 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb01dd-a749-48f7-b4f1-ea7775a6ed07 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:50.597907 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb01dd-a749-48f7-b4f1-ea7775a6ed07 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:50.598190 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb01dd-a749-48f7-b4f1-ea7775a6ed07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:50.624996 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-aecb01dd-a749-48f7-b4f1-ea7775a6ed07 None None] MFA Rules not processed for user `10fed46f05ca4f26b69f91d55eebebbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:50.626214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-aecb01dd-a749-48f7-b4f1-ea7775a6ed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:50.674497 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:50.714114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1424/2793] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:50.725802 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23cfe4-c79b-44e6-8746-0863e86a5120 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:50.727567 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-af23cfe4-c79b-44e6-8746-0863e86a5120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:50.786195 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23cfe4-c79b-44e6-8746-0863e86a5120 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:50.789875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cae01-ff2d-4a33-b3fa-112a09c817fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:50.790531 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cae01-ff2d-4a33-b3fa-112a09c817fa service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:50.790814 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cae01-ff2d-4a33-b3fa-112a09c817fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:50.791093 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cae01-ff2d-4a33-b3fa-112a09c817fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:50.849390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cae01-ff2d-4a33-b3fa-112a09c817fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:50.850855 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cae01-ff2d-4a33-b3fa-112a09c817fa service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:50.860904 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1370/2794] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:52.360129 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb01dd-a749-48f7-b4f1-ea7775a6ed07 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:52.361530 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-aecb01dd-a749-48f7-b4f1-ea7775a6ed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:52.373352 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb01dd-a749-48f7-b4f1-ea7775a6ed07 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:52.376922 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683d6d0-32f1-434b-b96d-4ec6aadc5069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:52.377558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683d6d0-32f1-434b-b96d-4ec6aadc5069 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:52.377841 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683d6d0-32f1-434b-b96d-4ec6aadc5069 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:52.378119 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683d6d0-32f1-434b-b96d-4ec6aadc5069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:52.434568 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683d6d0-32f1-434b-b96d-4ec6aadc5069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:52.435963 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683d6d0-32f1-434b-b96d-4ec6aadc5069 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:52.445423 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1425/2795] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:52.963431 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cae01-ff2d-4a33-b3fa-112a09c817fa service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:52.971997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cae01-ff2d-4a33-b3fa-112a09c817fa service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:52.975738 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99b4cd-03ff-40f0-bb28-1ed7c8d206cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:52.976368 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99b4cd-03ff-40f0-bb28-1ed7c8d206cd service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:52.976648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99b4cd-03ff-40f0-bb28-1ed7c8d206cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:52.976919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99b4cd-03ff-40f0-bb28-1ed7c8d206cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:52.986723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99b4cd-03ff-40f0-bb28-1ed7c8d206cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:52.988172 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99b4cd-03ff-40f0-bb28-1ed7c8d206cd service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:52.997482 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1371/2796] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:56.853059 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683d6d0-32f1-434b-b96d-4ec6aadc5069 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:56.916558 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683d6d0-32f1-434b-b96d-4ec6aadc5069 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:56.921030 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f31a0a-63e7-4c65-bfa2-b3ba82976cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:56.921924 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f31a0a-63e7-4c65-bfa2-b3ba82976cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:56.922376 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f31a0a-63e7-4c65-bfa2-b3ba82976cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:56.922500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f31a0a-63e7-4c65-bfa2-b3ba82976cd6 admin admin] PATH_INFO: `/v3/users/95c4dd1f407e422d8b67330a212ad706` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:56.923726 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f31a0a-63e7-4c65-bfa2-b3ba82976cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c4dd1f407e422d8b67330a212ad706)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:56.925663 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f31a0a-63e7-4c65-bfa2-b3ba82976cd6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:56.971730 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-45f31a0a-63e7-4c65-bfa2-b3ba82976cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c4dd1f407e422d8b67330a212ad706'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:56.983320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-45f31a0a-63e7-4c65-bfa2-b3ba82976cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c4dd1f407e422d8b67330a212ad706'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:56.984005 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-45f31a0a-63e7-4c65-bfa2-b3ba82976cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c4dd1f407e422d8b67330a212ad706'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:56.989186 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:56.991293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-45f31a0a-63e7-4c65-bfa2-b3ba82976cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c4dd1f407e422d8b67330a212ad706'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:56.998796 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-45f31a0a-63e7-4c65-bfa2-b3ba82976cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c4dd1f407e422d8b67330a212ad706'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:57.006101 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1426/2797] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:44:56 2022] DELETE /identity/v3/users/95c4dd1f407e422d8b67330a212ad706 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:57.010599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc39d-18b1-4ebb-b19e-6c295c0021ea None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:57.011059 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc39d-18b1-4ebb-b19e-6c295c0021ea None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:57.011244 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc39d-18b1-4ebb-b19e-6c295c0021ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:57.028486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-db2cc39d-18b1-4ebb-b19e-6c295c0021ea None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:57.029710 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-db2cc39d-18b1-4ebb-b19e-6c295c0021ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:57.076218 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:57.089255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1372/2798] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:57.099014 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f31a0a-63e7-4c65-bfa2-b3ba82976cd6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:57.100437 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-45f31a0a-63e7-4c65-bfa2-b3ba82976cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:57.158042 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f31a0a-63e7-4c65-bfa2-b3ba82976cd6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:57.161745 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333df33-c720-4c5e-9489-ec1d4176092c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:57.162383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333df33-c720-4c5e-9489-ec1d4176092c service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:57.162672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333df33-c720-4c5e-9489-ec1d4176092c service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:57.162950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333df33-c720-4c5e-9489-ec1d4176092c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:57.172013 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333df33-c720-4c5e-9489-ec1d4176092c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:57.173469 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333df33-c720-4c5e-9489-ec1d4176092c service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:57.182945 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1427/2799] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:44:57.451823 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cc39d-18b1-4ebb-b19e-6c295c0021ea None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:57.454441 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-db2cc39d-18b1-4ebb-b19e-6c295c0021ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:57.465454 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cc39d-18b1-4ebb-b19e-6c295c0021ea None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:57.470375 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:57.471246 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:57.471563 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:57.471845 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] PATH_INFO: `/v3/projects/68a255eceb0a412f8462145c9d03e283` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:57.473052 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a255eceb0a412f8462145c9d03e283)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:57.474973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:57.525546 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a255eceb0a412f8462145c9d03e283', 'request_id': 'req-dcea0541-7044-4435-b356-a89d2e5fac60'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:57.532243 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a255eceb0a412f8462145c9d03e283', 'request_id': 'req-dcea0541-7044-4435-b356-a89d2e5fac60'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:57.537887 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a255eceb0a412f8462145c9d03e283', 'request_id': 'req-dcea0541-7044-4435-b356-a89d2e5fac60'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:57.550686 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] The token cache is being invalidate because project 68a255eceb0a412f8462145c9d03e283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:57.550972 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:57.551628 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:57.553230 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1373/2800] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:44:57 2022] DELETE /identity/v3/projects/68a255eceb0a412f8462145c9d03e283 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:57.557192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333df33-c720-4c5e-9489-ec1d4176092c service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:57.567858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333df33-c720-4c5e-9489-ec1d4176092c service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:57.623100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0095a8d-59af-4e76-a338-d04853a19dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:57.624096 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0095a8d-59af-4e76-a338-d04853a19dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:57.624384 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0095a8d-59af-4e76-a338-d04853a19dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:57.624665 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0095a8d-59af-4e76-a338-d04853a19dad admin admin] PATH_INFO: `/v3/users/024b7137c4334b80849282f3f485bee2` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:57.626510 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0095a8d-59af-4e76-a338-d04853a19dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=024b7137c4334b80849282f3f485bee2)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:57.628456 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0095a8d-59af-4e76-a338-d04853a19dad admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:57.676228 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d0095a8d-59af-4e76-a338-d04853a19dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024b7137c4334b80849282f3f485bee2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:57.689012 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d0095a8d-59af-4e76-a338-d04853a19dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024b7137c4334b80849282f3f485bee2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:57.689866 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d0095a8d-59af-4e76-a338-d04853a19dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024b7137c4334b80849282f3f485bee2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:57.697600 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d0095a8d-59af-4e76-a338-d04853a19dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024b7137c4334b80849282f3f485bee2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:57.704757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d0095a8d-59af-4e76-a338-d04853a19dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024b7137c4334b80849282f3f485bee2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:57.710925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1428/2801] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:44:57 2022] DELETE /identity/v3/users/024b7137c4334b80849282f3f485bee2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:57.980919 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:57.982384 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:57.996211 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea0541-7044-4435-b356-a89d2e5fac60 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:58.062124 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:58.063267 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:58.063589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:58.063874 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] PATH_INFO: `/v3/projects/093701de390545af82550bbbaeb179b6` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:58.065141 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=093701de390545af82550bbbaeb179b6)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:58.067073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:58.113495 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '093701de390545af82550bbbaeb179b6', 'request_id': 'req-f5558133-69b4-464a-813c-0398446c57e8'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.119458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '093701de390545af82550bbbaeb179b6', 'request_id': 'req-f5558133-69b4-464a-813c-0398446c57e8'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.125016 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '093701de390545af82550bbbaeb179b6', 'request_id': 'req-f5558133-69b4-464a-813c-0398446c57e8'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.138042 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] The token cache is being invalidate because project 093701de390545af82550bbbaeb179b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:58.138334 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.138959 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.140534 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1374/2802] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:44:57 2022] DELETE /identity/v3/projects/093701de390545af82550bbbaeb179b6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:58.145430 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0095a8d-59af-4e76-a338-d04853a19dad admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:58.146869 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d0095a8d-59af-4e76-a338-d04853a19dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:58.160493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0095a8d-59af-4e76-a338-d04853a19dad admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:58.168330 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:58.218037 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257df91-2815-4909-a44f-433708ff6c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:58.219550 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257df91-2815-4909-a44f-433708ff6c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:58.219850 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257df91-2815-4909-a44f-433708ff6c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:58.220130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257df91-2815-4909-a44f-433708ff6c29 admin admin] PATH_INFO: `/v3/users/10fed46f05ca4f26b69f91d55eebebbd` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:58.221340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257df91-2815-4909-a44f-433708ff6c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10fed46f05ca4f26b69f91d55eebebbd)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:58.223250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257df91-2815-4909-a44f-433708ff6c29 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:58.267704 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6257df91-2815-4909-a44f-433708ff6c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10fed46f05ca4f26b69f91d55eebebbd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.280395 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6257df91-2815-4909-a44f-433708ff6c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10fed46f05ca4f26b69f91d55eebebbd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.281114 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6257df91-2815-4909-a44f-433708ff6c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10fed46f05ca4f26b69f91d55eebebbd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.288453 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6257df91-2815-4909-a44f-433708ff6c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10fed46f05ca4f26b69f91d55eebebbd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.295607 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6257df91-2815-4909-a44f-433708ff6c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10fed46f05ca4f26b69f91d55eebebbd'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.301511 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1429/2803] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:44:58 2022] DELETE /identity/v3/users/10fed46f05ca4f26b69f91d55eebebbd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:58.575451 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:58.576849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:58.590401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5558133-69b4-464a-813c-0398446c57e8 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:58.595444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:58.652681 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e95285-ea3c-4d94-9ed0-69d7174d290c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:58.653539 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e95285-ea3c-4d94-9ed0-69d7174d290c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:58.653819 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e95285-ea3c-4d94-9ed0-69d7174d290c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:58.654090 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e95285-ea3c-4d94-9ed0-69d7174d290c admin admin] PATH_INFO: `/v3/projects/a20f9e37c11a42ea9f7d8a2c66ac4dd8` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:58.655373 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e95285-ea3c-4d94-9ed0-69d7174d290c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a20f9e37c11a42ea9f7d8a2c66ac4dd8)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:58.657401 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e95285-ea3c-4d94-9ed0-69d7174d290c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:58.705605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a0e95285-ea3c-4d94-9ed0-69d7174d290c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a20f9e37c11a42ea9f7d8a2c66ac4dd8', 'request_id': 'req-a0e95285-ea3c-4d94-9ed0-69d7174d290c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.711427 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a0e95285-ea3c-4d94-9ed0-69d7174d290c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a20f9e37c11a42ea9f7d8a2c66ac4dd8', 'request_id': 'req-a0e95285-ea3c-4d94-9ed0-69d7174d290c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.716854 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a0e95285-ea3c-4d94-9ed0-69d7174d290c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a20f9e37c11a42ea9f7d8a2c66ac4dd8', 'request_id': 'req-a0e95285-ea3c-4d94-9ed0-69d7174d290c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.728594 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a0e95285-ea3c-4d94-9ed0-69d7174d290c admin admin] The token cache is being invalidate because project a20f9e37c11a42ea9f7d8a2c66ac4dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:44:58.728878 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a0e95285-ea3c-4d94-9ed0-69d7174d290c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.729489 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a0e95285-ea3c-4d94-9ed0-69d7174d290c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:44:58.731014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1375/2804] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:44:58 2022] DELETE /identity/v3/projects/a20f9e37c11a42ea9f7d8a2c66ac4dd8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:58.735890 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2edb6-1ab6-44df-be03-667a89bce831 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:58.736183 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2edb6-1ab6-44df-be03-667a89bce831 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:58.736457 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2edb6-1ab6-44df-be03-667a89bce831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:58.754552 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-26a2edb6-1ab6-44df-be03-667a89bce831 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:58.756032 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-26a2edb6-1ab6-44df-be03-667a89bce831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:58.814732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1430/2805] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:58.822833 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7c9b6-2758-4a7a-9bfc-c50688bb0af6 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:58.823127 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7c9b6-2758-4a7a-9bfc-c50688bb0af6 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:58.823411 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7c9b6-2758-4a7a-9bfc-c50688bb0af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:58.842461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-6af7c9b6-2758-4a7a-9bfc-c50688bb0af6 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:58.843711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-6af7c9b6-2758-4a7a-9bfc-c50688bb0af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:58.851871 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1376/2806] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:44:58.856195 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2edb6-1ab6-44df-be03-667a89bce831 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:58.866586 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2edb6-1ab6-44df-be03-667a89bce831 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:58.871242 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccdb79-ae5b-4282-b1d6-0913b6479f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:58.871925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccdb79-ae5b-4282-b1d6-0913b6479f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:58.872213 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccdb79-ae5b-4282-b1d6-0913b6479f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:58.872493 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccdb79-ae5b-4282-b1d6-0913b6479f67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:58.873224 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccdb79-ae5b-4282-b1d6-0913b6479f67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:44:58.873534 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccdb79-ae5b-4282-b1d6-0913b6479f67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:58.875153 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccdb79-ae5b-4282-b1d6-0913b6479f67 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:58.887710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1431/2807] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:44:58.892098 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7c9b6-2758-4a7a-9bfc-c50688bb0af6 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:58.901292 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7c9b6-2758-4a7a-9bfc-c50688bb0af6 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:58.906001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995b53a-f8f2-4ae2-8116-22d8f8bf6284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:58.907004 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b53a-f8f2-4ae2-8116-22d8f8bf6284 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:58.907296 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b53a-f8f2-4ae2-8116-22d8f8bf6284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:58.907661 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b53a-f8f2-4ae2-8116-22d8f8bf6284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:58.908356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995b53a-f8f2-4ae2-8116-22d8f8bf6284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:58.910256 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995b53a-f8f2-4ae2-8116-22d8f8bf6284 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:58.936043 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1377/2808] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:44:58 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:58.940941 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccdb79-ae5b-4282-b1d6-0913b6479f67 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:58.951843 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccdb79-ae5b-4282-b1d6-0913b6479f67 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:58.966489 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:59.014839 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26393fb2-1420-42a9-8405-f66b61d6a2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:59.015536 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26393fb2-1420-42a9-8405-f66b61d6a2ce admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:59.015853 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26393fb2-1420-42a9-8405-f66b61d6a2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:59.016127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26393fb2-1420-42a9-8405-f66b61d6a2ce admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:59.016851 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26393fb2-1420-42a9-8405-f66b61d6a2ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:59.018776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26393fb2-1420-42a9-8405-f66b61d6a2ce admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:59.038236 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1432/2809] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:44:58 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:44:59.042374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995b53a-f8f2-4ae2-8116-22d8f8bf6284 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:59.054113 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995b53a-f8f2-4ae2-8116-22d8f8bf6284 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:59.059001 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6ff30-5b3d-4542-a67b-1c0a576bbaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:59.059690 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6ff30-5b3d-4542-a67b-1c0a576bbaff admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:59.059976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6ff30-5b3d-4542-a67b-1c0a576bbaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:59.060806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6ff30-5b3d-4542-a67b-1c0a576bbaff admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:59.060967 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6ff30-5b3d-4542-a67b-1c0a576bbaff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:59.062712 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6ff30-5b3d-4542-a67b-1c0a576bbaff admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:59.074086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1378/2810] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:59.078066 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26393fb2-1420-42a9-8405-f66b61d6a2ce admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:59.088220 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26393fb2-1420-42a9-8405-f66b61d6a2ce admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:59.093895 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1afae-d304-4b39-8e37-4650a0e918e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:59.094611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1afae-d304-4b39-8e37-4650a0e918e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:59.094914 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1afae-d304-4b39-8e37-4650a0e918e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:59.095194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1afae-d304-4b39-8e37-4650a0e918e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:59.095954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1afae-d304-4b39-8e37-4650a0e918e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:59.097554 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1afae-d304-4b39-8e37-4650a0e918e2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:59.107549 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1433/2811] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:44:59.112091 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6ff30-5b3d-4542-a67b-1c0a576bbaff admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:59.122432 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6ff30-5b3d-4542-a67b-1c0a576bbaff admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:59.127829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4a0e7-c884-4893-ab07-9e2282217a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:59.128696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4a0e7-c884-4893-ab07-9e2282217a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:59.128973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4a0e7-c884-4893-ab07-9e2282217a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:59.129245 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4a0e7-c884-4893-ab07-9e2282217a87 admin admin] PATH_INFO: `/v3/projects/391501df67894867a7b7dfb3ac4db069/users/9c589eece9f8467882187dda192fc7c2/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:59.143859 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4a0e7-c884-4893-ab07-9e2282217a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=391501df67894867a7b7dfb3ac4db069, user_id=9c589eece9f8467882187dda192fc7c2, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:59.146470 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4a0e7-c884-4893-ab07-9e2282217a87 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:59.159041 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1379/2812] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:44:59 2022] PUT /identity/v3/projects/391501df67894867a7b7dfb3ac4db069/users/9c589eece9f8467882187dda192fc7c2/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:44:59.169309 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9b7e6-d4a1-4d49-9384-1f705d29c630 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:59.169791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9b7e6-d4a1-4d49-9384-1f705d29c630 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:59.169898 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d9b7e6-d4a1-4d49-9384-1f705d29c630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:59.198132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-62d9b7e6-d4a1-4d49-9384-1f705d29c630 None None] MFA Rules not processed for user `9c589eece9f8467882187dda192fc7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:44:59.199354 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-62d9b7e6-d4a1-4d49-9384-1f705d29c630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:59.262585 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1434/2813] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:44:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:44:59.273935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4a0e7-c884-4893-ab07-9e2282217a87 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:44:59.275666 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-07f4a0e7-c884-4893-ab07-9e2282217a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:44:59.316990 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:44:59.336162 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4a0e7-c884-4893-ab07-9e2282217a87 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:44:59.339787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b3342-e586-4f5e-bf0f-850d26446e7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:44:59.340428 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b3342-e586-4f5e-bf0f-850d26446e7f service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:44:59.340708 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b3342-e586-4f5e-bf0f-850d26446e7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:44:59.340979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b3342-e586-4f5e-bf0f-850d26446e7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:44:59.349583 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b3342-e586-4f5e-bf0f-850d26446e7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:44:59.351000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b3342-e586-4f5e-bf0f-850d26446e7f service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:44:59.359660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1380/2814] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:44:59 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:45:09.259810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:09.355702 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=10 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:14.983022 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9b7e6-d4a1-4d49-9384-1f705d29c630 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:14.984465 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-62d9b7e6-d4a1-4d49-9384-1f705d29c630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:14.996337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d9b7e6-d4a1-4d49-9384-1f705d29c630 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:14.999939 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc516696-abd7-4ed5-9bd7-c13a8cbf06e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:15.000573 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516696-abd7-4ed5-9bd7-c13a8cbf06e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:15.000858 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516696-abd7-4ed5-9bd7-c13a8cbf06e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:15.001136 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516696-abd7-4ed5-9bd7-c13a8cbf06e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:15.002837 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fc516696-abd7-4ed5-9bd7-c13a8cbf06e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:15.077419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc516696-abd7-4ed5-9bd7-c13a8cbf06e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:15.078875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc516696-abd7-4ed5-9bd7-c13a8cbf06e2 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:15.092013 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1435/2815] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:45:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:45:17.706045 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b3342-e586-4f5e-bf0f-850d26446e7f service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:17.715058 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b3342-e586-4f5e-bf0f-850d26446e7f service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:17.718907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f18f0-2e0b-4dfd-a42a-d2f9c75cd893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:17.719633 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f18f0-2e0b-4dfd-a42a-d2f9c75cd893 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:17.719935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f18f0-2e0b-4dfd-a42a-d2f9c75cd893 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:17.720830 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f18f0-2e0b-4dfd-a42a-d2f9c75cd893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:17.722788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f13f18f0-2e0b-4dfd-a42a-d2f9c75cd893 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:17.737303 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f18f0-2e0b-4dfd-a42a-d2f9c75cd893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:17.738729 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f18f0-2e0b-4dfd-a42a-d2f9c75cd893 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:17.751350 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1381/2816] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:45:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:45:25.085849 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=34 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:27.745561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=6 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:28.225859 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc516696-abd7-4ed5-9bd7-c13a8cbf06e2 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:28.227448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-fc516696-abd7-4ed5-9bd7-c13a8cbf06e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:28.284039 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc516696-abd7-4ed5-9bd7-c13a8cbf06e2 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:28.288143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3285c1e-c8e2-42ca-846d-fe648dbc994b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:28.288770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3285c1e-c8e2-42ca-846d-fe648dbc994b service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:28.289048 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3285c1e-c8e2-42ca-846d-fe648dbc994b service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:28.289320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3285c1e-c8e2-42ca-846d-fe648dbc994b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:28.291058 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-c3285c1e-c8e2-42ca-846d-fe648dbc994b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:28.354246 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3285c1e-c8e2-42ca-846d-fe648dbc994b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:28.355874 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3285c1e-c8e2-42ca-846d-fe648dbc994b service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:28.366718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1436/2817] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:45:31.786486 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f18f0-2e0b-4dfd-a42a-d2f9c75cd893 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:31.788578 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-f13f18f0-2e0b-4dfd-a42a-d2f9c75cd893 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:31.803396 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f18f0-2e0b-4dfd-a42a-d2f9c75cd893 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:31.808079 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b00031-5d5e-41eb-9514-5403e037cc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:31.808951 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b00031-5d5e-41eb-9514-5403e037cc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:31.809236 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b00031-5d5e-41eb-9514-5403e037cc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:31.809513 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b00031-5d5e-41eb-9514-5403e037cc0f admin admin] PATH_INFO: `/v3/users/0d6ad1725257401888617fdcf7e57386` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:31.810703 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b00031-5d5e-41eb-9514-5403e037cc0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6ad1725257401888617fdcf7e57386)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:31.812665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b00031-5d5e-41eb-9514-5403e037cc0f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:31.859041 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-70b00031-5d5e-41eb-9514-5403e037cc0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6ad1725257401888617fdcf7e57386'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:31.870435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-70b00031-5d5e-41eb-9514-5403e037cc0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6ad1725257401888617fdcf7e57386'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:31.871089 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-70b00031-5d5e-41eb-9514-5403e037cc0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6ad1725257401888617fdcf7e57386'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:31.878282 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-70b00031-5d5e-41eb-9514-5403e037cc0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6ad1725257401888617fdcf7e57386'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:31.878870 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-70b00031-5d5e-41eb-9514-5403e037cc0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6ad1725257401888617fdcf7e57386'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:31.891773 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1382/2818] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:45:31 2022] DELETE /identity/v3/users/0d6ad1725257401888617fdcf7e57386 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:45:32.069948 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3285c1e-c8e2-42ca-846d-fe648dbc994b service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:32.081866 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3285c1e-c8e2-42ca-846d-fe648dbc994b service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:32.145055 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c31cf-bc5e-4cf2-ac1b-b84915667d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:32.145985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c31cf-bc5e-4cf2-ac1b-b84915667d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:32.150369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c31cf-bc5e-4cf2-ac1b-b84915667d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:32.150369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c31cf-bc5e-4cf2-ac1b-b84915667d56 admin admin] PATH_INFO: `/v3/projects/8ad63b720a0044a7bcb0cb1d8628ad09` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:32.150369 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c31cf-bc5e-4cf2-ac1b-b84915667d56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad63b720a0044a7bcb0cb1d8628ad09)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:32.150780 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c31cf-bc5e-4cf2-ac1b-b84915667d56 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:32.198484 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-512c31cf-bc5e-4cf2-ac1b-b84915667d56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad63b720a0044a7bcb0cb1d8628ad09', 'request_id': 'req-512c31cf-bc5e-4cf2-ac1b-b84915667d56'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:32.200442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:32.205149 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-512c31cf-bc5e-4cf2-ac1b-b84915667d56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad63b720a0044a7bcb0cb1d8628ad09', 'request_id': 'req-512c31cf-bc5e-4cf2-ac1b-b84915667d56'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:32.212918 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-512c31cf-bc5e-4cf2-ac1b-b84915667d56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad63b720a0044a7bcb0cb1d8628ad09', 'request_id': 'req-512c31cf-bc5e-4cf2-ac1b-b84915667d56'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:32.224413 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-512c31cf-bc5e-4cf2-ac1b-b84915667d56 admin admin] The token cache is being invalidate because project 8ad63b720a0044a7bcb0cb1d8628ad09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:45:32.224787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-512c31cf-bc5e-4cf2-ac1b-b84915667d56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:32.225506 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-512c31cf-bc5e-4cf2-ac1b-b84915667d56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:32.227103 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1437/2819] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:45:32 2022] DELETE /identity/v3/projects/8ad63b720a0044a7bcb0cb1d8628ad09 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:45:32.233241 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f1cb0-b49f-4abb-b7d1-5889db848414 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:32.233888 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f1cb0-b49f-4abb-b7d1-5889db848414 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:32.234429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f1cb0-b49f-4abb-b7d1-5889db848414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:32.258326 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-e77f1cb0-b49f-4abb-b7d1-5889db848414 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:45:32.259559 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-e77f1cb0-b49f-4abb-b7d1-5889db848414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:32.321102 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1383/2820] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:45:32.328914 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848c88d-9e9c-4953-9851-d2419d252b4a None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:32.329207 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848c88d-9e9c-4953-9851-d2419d252b4a None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:32.329494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848c88d-9e9c-4953-9851-d2419d252b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:32.351008 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-2848c88d-9e9c-4953-9851-d2419d252b4a None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:45:32.352420 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-2848c88d-9e9c-4953-9851-d2419d252b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:32.360990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1438/2821] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:45:32.365176 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f1cb0-b49f-4abb-b7d1-5889db848414 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:32.374896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f1cb0-b49f-4abb-b7d1-5889db848414 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:32.379455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b054439-9c91-41e0-8c24-e31a128514a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:32.380134 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b054439-9c91-41e0-8c24-e31a128514a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:32.380417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b054439-9c91-41e0-8c24-e31a128514a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:32.381235 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b054439-9c91-41e0-8c24-e31a128514a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:32.381970 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b054439-9c91-41e0-8c24-e31a128514a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80118) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:45:32.382278 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b054439-9c91-41e0-8c24-e31a128514a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:32.383912 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b054439-9c91-41e0-8c24-e31a128514a5 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:32.395337 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1384/2822] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:45:32.400308 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848c88d-9e9c-4953-9851-d2419d252b4a None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:32.409828 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848c88d-9e9c-4953-9851-d2419d252b4a None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:32.414548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf7576-02bc-42ef-bcea-e9342d647364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:32.415198 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf7576-02bc-42ef-bcea-e9342d647364 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:32.415516 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf7576-02bc-42ef-bcea-e9342d647364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:32.415803 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf7576-02bc-42ef-bcea-e9342d647364 admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:32.416505 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf7576-02bc-42ef-bcea-e9342d647364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:32.418392 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf7576-02bc-42ef-bcea-e9342d647364 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:32.445468 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1439/2823] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:45:32 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:45:32.449723 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b054439-9c91-41e0-8c24-e31a128514a5 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:32.464168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b054439-9c91-41e0-8c24-e31a128514a5 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:32.520938 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f820-8f91-488f-824c-1ef23b6c74c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:32.521781 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f820-8f91-488f-824c-1ef23b6c74c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:32.522070 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f820-8f91-488f-824c-1ef23b6c74c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:32.522351 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f820-8f91-488f-824c-1ef23b6c74c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:32.523270 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348f820-8f91-488f-824c-1ef23b6c74c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:32.525128 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348f820-8f91-488f-824c-1ef23b6c74c8 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:32.533247 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:32.551876 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1385/2824] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:45:32 2022] POST /identity/v3/users => generated 278 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:45:32.553768 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf7576-02bc-42ef-bcea-e9342d647364 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:32.565029 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf7576-02bc-42ef-bcea-e9342d647364 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:32.570605 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf3355-74e0-4742-9b18-b1d617524d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:32.571288 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3355-74e0-4742-9b18-b1d617524d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:32.571620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3355-74e0-4742-9b18-b1d617524d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:32.571897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3355-74e0-4742-9b18-b1d617524d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:32.572659 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf3355-74e0-4742-9b18-b1d617524d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:32.574262 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf3355-74e0-4742-9b18-b1d617524d0c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:32.585326 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1440/2825] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 10:45:32.589355 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f820-8f91-488f-824c-1ef23b6c74c8 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:32.600183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f820-8f91-488f-824c-1ef23b6c74c8 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:32.605301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e9c19-32b8-4a5f-961c-69f9fc729b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:32.605979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e9c19-32b8-4a5f-961c-69f9fc729b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:32.606268 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e9c19-32b8-4a5f-961c-69f9fc729b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:32.606549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e9c19-32b8-4a5f-961c-69f9fc729b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:32.607289 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e9c19-32b8-4a5f-961c-69f9fc729b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:32.608981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e9c19-32b8-4a5f-961c-69f9fc729b4d admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:32.623983 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1386/2826] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:45:32.625712 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf3355-74e0-4742-9b18-b1d617524d0c admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:32.636860 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf3355-74e0-4742-9b18-b1d617524d0c admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:32.641694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c21dd-f43e-45ba-a0d2-8e2e98ca806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:32.648192 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c21dd-f43e-45ba-a0d2-8e2e98ca806e admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:32.648601 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c21dd-f43e-45ba-a0d2-8e2e98ca806e admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:32.648847 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c21dd-f43e-45ba-a0d2-8e2e98ca806e admin admin] PATH_INFO: `/v3/projects/c31d3a0c59d34b5087b70749b6a45101/users/d30a8ef215384e1f8a58505f4ad785ff/roles/484f610225884740911a5c3333f22221` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:32.664580 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c21dd-f43e-45ba-a0d2-8e2e98ca806e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31d3a0c59d34b5087b70749b6a45101, user_id=d30a8ef215384e1f8a58505f4ad785ff, role_id=484f610225884740911a5c3333f22221)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:32.667229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c21dd-f43e-45ba-a0d2-8e2e98ca806e admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:32.680989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1441/2827] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:45:32 2022] PUT /identity/v3/projects/c31d3a0c59d34b5087b70749b6a45101/users/d30a8ef215384e1f8a58505f4ad785ff/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 10:45:32.690999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d988b-2532-4f6f-a0b7-50739f6e5a32 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:32.691356 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d988b-2532-4f6f-a0b7-50739f6e5a32 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:32.691665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d988b-2532-4f6f-a0b7-50739f6e5a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:32.718632 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-ef9d988b-2532-4f6f-a0b7-50739f6e5a32 None None] MFA Rules not processed for user `d30a8ef215384e1f8a58505f4ad785ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:45:32.719804 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ef9d988b-2532-4f6f-a0b7-50739f6e5a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:32.781505 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1387/2828] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:45:32 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:45:32.785932 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c21dd-f43e-45ba-a0d2-8e2e98ca806e admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:32.847758 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c21dd-f43e-45ba-a0d2-8e2e98ca806e admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:32.857855 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d605b98-d5eb-4c47-9e72-c52b45ab04fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:32.858555 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d605b98-d5eb-4c47-9e72-c52b45ab04fa admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:32.858843 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d605b98-d5eb-4c47-9e72-c52b45ab04fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:32.859215 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d605b98-d5eb-4c47-9e72-c52b45ab04fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:32.860657 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d605b98-d5eb-4c47-9e72-c52b45ab04fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:32.864368 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d605b98-d5eb-4c47-9e72-c52b45ab04fa admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:32.891965 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1442/2829] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:45:32 2022] POST /identity/v3/projects => generated 357 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:45:32.896028 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d988b-2532-4f6f-a0b7-50739f6e5a32 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:32.907944 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d988b-2532-4f6f-a0b7-50739f6e5a32 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:32.963095 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a1f1c-c4e7-4b54-bb7c-a636963538a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:32.963788 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a1f1c-c4e7-4b54-bb7c-a636963538a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:32.964069 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a1f1c-c4e7-4b54-bb7c-a636963538a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:32.964339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a1f1c-c4e7-4b54-bb7c-a636963538a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:32.965014 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a1f1c-c4e7-4b54-bb7c-a636963538a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:32.966907 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a1f1c-c4e7-4b54-bb7c-a636963538a6 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:32.985205 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1388/2830] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:45:32 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:45:32.989386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d605b98-d5eb-4c47-9e72-c52b45ab04fa admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:32.999925 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d605b98-d5eb-4c47-9e72-c52b45ab04fa admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:33.004661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf7b06-2409-45a8-95a9-5e74013885c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:33.005321 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7b06-2409-45a8-95a9-5e74013885c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:33.005606 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7b06-2409-45a8-95a9-5e74013885c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:33.006423 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf7b06-2409-45a8-95a9-5e74013885c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:33.007150 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf7b06-2409-45a8-95a9-5e74013885c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:33.008794 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf7b06-2409-45a8-95a9-5e74013885c2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:33.019800 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1443/2831] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:45:33.024308 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a1f1c-c4e7-4b54-bb7c-a636963538a6 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:33.034463 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a1f1c-c4e7-4b54-bb7c-a636963538a6 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:33.039378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbece957-e4c8-4f30-978f-0b2db72e56eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:33.040318 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbece957-e4c8-4f30-978f-0b2db72e56eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:33.040601 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbece957-e4c8-4f30-978f-0b2db72e56eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:33.040875 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbece957-e4c8-4f30-978f-0b2db72e56eb admin admin] PATH_INFO: `/v3/projects/f2621adc27e144119207ddd5981932fb/users/c7215813c6354e52bea5ee1e801a5de3/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:33.055682 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbece957-e4c8-4f30-978f-0b2db72e56eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2621adc27e144119207ddd5981932fb, user_id=c7215813c6354e52bea5ee1e801a5de3, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:33.058363 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbece957-e4c8-4f30-978f-0b2db72e56eb admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:33.071607 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1389/2832] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:45:33 2022] PUT /identity/v3/projects/f2621adc27e144119207ddd5981932fb/users/c7215813c6354e52bea5ee1e801a5de3/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:45:33.075538 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf7b06-2409-45a8-95a9-5e74013885c2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:33.086285 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf7b06-2409-45a8-95a9-5e74013885c2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:33.140460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:33.154070 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c8d5e-4532-4aa6-8ab4-808141dbf8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:33.154748 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c8d5e-4532-4aa6-8ab4-808141dbf8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:33.155038 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c8d5e-4532-4aa6-8ab4-808141dbf8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:33.155317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c8d5e-4532-4aa6-8ab4-808141dbf8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:33.156089 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c8d5e-4532-4aa6-8ab4-808141dbf8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:33.157695 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c8d5e-4532-4aa6-8ab4-808141dbf8c6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:33.168422 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1444/2833] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:45:33.172779 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbece957-e4c8-4f30-978f-0b2db72e56eb admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:33.184006 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbece957-e4c8-4f30-978f-0b2db72e56eb admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:33.189904 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521aec86-961c-40e6-b046-8fd541695f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:33.191767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521aec86-961c-40e6-b046-8fd541695f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:33.192193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521aec86-961c-40e6-b046-8fd541695f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:33.193003 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521aec86-961c-40e6-b046-8fd541695f4e admin admin] PATH_INFO: `/v3/projects/f2621adc27e144119207ddd5981932fb/users/c7215813c6354e52bea5ee1e801a5de3/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:33.196466 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521aec86-961c-40e6-b046-8fd541695f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2621adc27e144119207ddd5981932fb, user_id=c7215813c6354e52bea5ee1e801a5de3, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:33.200043 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521aec86-961c-40e6-b046-8fd541695f4e admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:33.216904 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1390/2834] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:45:33 2022] PUT /identity/v3/projects/f2621adc27e144119207ddd5981932fb/users/c7215813c6354e52bea5ee1e801a5de3/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:45:33.228495 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c093f2-a58d-4df7-9cfd-d41670f9420b None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:33.228866 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c093f2-a58d-4df7-9cfd-d41670f9420b None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:33.229225 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c093f2-a58d-4df7-9cfd-d41670f9420b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:33.259362 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-79c093f2-a58d-4df7-9cfd-d41670f9420b None None] MFA Rules not processed for user `c7215813c6354e52bea5ee1e801a5de3`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:45:33.260603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-79c093f2-a58d-4df7-9cfd-d41670f9420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:33.331641 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1445/2835] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:45:33 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:45:33.343734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521aec86-961c-40e6-b046-8fd541695f4e admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:33.345478 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-521aec86-961c-40e6-b046-8fd541695f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:33.369280 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:33.406274 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521aec86-961c-40e6-b046-8fd541695f4e admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:33.409912 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e713da-3b9f-4ccf-9268-2a94c97ebf42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:33.410549 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e713da-3b9f-4ccf-9268-2a94c97ebf42 service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:33.410829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e713da-3b9f-4ccf-9268-2a94c97ebf42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:33.411102 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e713da-3b9f-4ccf-9268-2a94c97ebf42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:33.420692 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e713da-3b9f-4ccf-9268-2a94c97ebf42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:33.422228 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e713da-3b9f-4ccf-9268-2a94c97ebf42 service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:33.431708 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1391/2836] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:45:33 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:45:33.509473 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c093f2-a58d-4df7-9cfd-d41670f9420b None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:33.519203 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c093f2-a58d-4df7-9cfd-d41670f9420b None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:33.523480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8590e5d-eb6a-449a-8d21-5359d6c2d240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:33.524122 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8590e5d-eb6a-449a-8d21-5359d6c2d240 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:33.524405 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8590e5d-eb6a-449a-8d21-5359d6c2d240 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:33.524684 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8590e5d-eb6a-449a-8d21-5359d6c2d240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:33.587982 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8590e5d-eb6a-449a-8d21-5359d6c2d240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:33.589411 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8590e5d-eb6a-449a-8d21-5359d6c2d240 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:33.598283 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1446/2837] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:45:33 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:45:34.271018 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e713da-3b9f-4ccf-9268-2a94c97ebf42 service cinder] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:34.272438 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c6e713da-3b9f-4ccf-9268-2a94c97ebf42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:34.341166 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e713da-3b9f-4ccf-9268-2a94c97ebf42 service cinder] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:34.345735 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74eb6a-4c3b-4509-9bb1-ca5b0c927b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:34.346599 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74eb6a-4c3b-4509-9bb1-ca5b0c927b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:34.346885 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74eb6a-4c3b-4509-9bb1-ca5b0c927b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:34.347161 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74eb6a-4c3b-4509-9bb1-ca5b0c927b49 admin admin] PATH_INFO: `/v3/users/9c589eece9f8467882187dda192fc7c2` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:34.348378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74eb6a-4c3b-4509-9bb1-ca5b0c927b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c589eece9f8467882187dda192fc7c2)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:34.350806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74eb6a-4c3b-4509-9bb1-ca5b0c927b49 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:34.396147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-de74eb6a-4c3b-4509-9bb1-ca5b0c927b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c589eece9f8467882187dda192fc7c2'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:34.407740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-de74eb6a-4c3b-4509-9bb1-ca5b0c927b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c589eece9f8467882187dda192fc7c2'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:34.408412 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-de74eb6a-4c3b-4509-9bb1-ca5b0c927b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c589eece9f8467882187dda192fc7c2'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:34.415913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-de74eb6a-4c3b-4509-9bb1-ca5b0c927b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c589eece9f8467882187dda192fc7c2'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:34.416625 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-de74eb6a-4c3b-4509-9bb1-ca5b0c927b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c589eece9f8467882187dda192fc7c2'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:34.429366 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1392/2838] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:45:34 2022] DELETE /identity/v3/users/9c589eece9f8467882187dda192fc7c2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:45:34.433876 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc03b2e-a2cb-4e99-b125-25782bf9990c None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:34.434358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc03b2e-a2cb-4e99-b125-25782bf9990c None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:34.434480 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc03b2e-a2cb-4e99-b125-25782bf9990c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:34.451886 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-3cc03b2e-a2cb-4e99-b125-25782bf9990c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:45:34.453097 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3cc03b2e-a2cb-4e99-b125-25782bf9990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:34.511715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1447/2839] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:45:34.521052 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74eb6a-4c3b-4509-9bb1-ca5b0c927b49 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:34.522482 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-de74eb6a-4c3b-4509-9bb1-ca5b0c927b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:34.571055 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:34.583937 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74eb6a-4c3b-4509-9bb1-ca5b0c927b49 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:34.588044 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6153d-a407-4e9b-a8d9-849fe04e8f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:34.588700 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6153d-a407-4e9b-a8d9-849fe04e8f1d service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:34.588984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6153d-a407-4e9b-a8d9-849fe04e8f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:34.589261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6153d-a407-4e9b-a8d9-849fe04e8f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:34.598468 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6153d-a407-4e9b-a8d9-849fe04e8f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:34.599931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6153d-a407-4e9b-a8d9-849fe04e8f1d service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:34.609869 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1393/2840] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:45:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:45:34.886603 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc03b2e-a2cb-4e99-b125-25782bf9990c None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:34.889383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3cc03b2e-a2cb-4e99-b125-25782bf9990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:34.904952 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc03b2e-a2cb-4e99-b125-25782bf9990c None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:34.911440 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:34.912448 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:34.913335 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:34.913687 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] PATH_INFO: `/v3/projects/391501df67894867a7b7dfb3ac4db069` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:34.915197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=391501df67894867a7b7dfb3ac4db069)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:34.917301 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:34.924178 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:34.965663 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '391501df67894867a7b7dfb3ac4db069', 'request_id': 'req-6d09d048-2a39-425e-bbfe-3701439a9125'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:34.971318 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '391501df67894867a7b7dfb3ac4db069', 'request_id': 'req-6d09d048-2a39-425e-bbfe-3701439a9125'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:34.979160 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '391501df67894867a7b7dfb3ac4db069', 'request_id': 'req-6d09d048-2a39-425e-bbfe-3701439a9125'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:34.990247 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] The token cache is being invalidate because project 391501df67894867a7b7dfb3ac4db069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:45:34.990533 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:34.991693 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:34.993231 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1448/2841] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:45:34 2022] DELETE /identity/v3/projects/391501df67894867a7b7dfb3ac4db069 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:45:41.838955 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6153d-a407-4e9b-a8d9-849fe04e8f1d service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:41.848130 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6153d-a407-4e9b-a8d9-849fe04e8f1d service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:41.896073 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f5bfe-7ef6-4717-ae6c-8a68e8335bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:41.896638 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f5bfe-7ef6-4717-ae6c-8a68e8335bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:41.896921 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f5bfe-7ef6-4717-ae6c-8a68e8335bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:41.897198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f5bfe-7ef6-4717-ae6c-8a68e8335bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:41.899744 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-ce4f5bfe-7ef6-4717-ae6c-8a68e8335bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:41.908960 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f5bfe-7ef6-4717-ae6c-8a68e8335bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:41.910416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f5bfe-7ef6-4717-ae6c-8a68e8335bb4 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:41.918435 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1394/2842] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:45:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:45:44.987231 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:48.291336 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:48.292956 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:48.357735 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09d048-2a39-425e-bbfe-3701439a9125 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:48.362309 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36b9b8-54c5-4b94-aaa4-f02a5c3fb0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:48.363173 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36b9b8-54c5-4b94-aaa4-f02a5c3fb0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:48.363458 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36b9b8-54c5-4b94-aaa4-f02a5c3fb0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:48.363763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36b9b8-54c5-4b94-aaa4-f02a5c3fb0df admin admin] PATH_INFO: `/v3/users/d30a8ef215384e1f8a58505f4ad785ff` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:48.364933 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36b9b8-54c5-4b94-aaa4-f02a5c3fb0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=d30a8ef215384e1f8a58505f4ad785ff)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:48.366833 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36b9b8-54c5-4b94-aaa4-f02a5c3fb0df admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:48.412419 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9d36b9b8-54c5-4b94-aaa4-f02a5c3fb0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd30a8ef215384e1f8a58505f4ad785ff'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:48.425360 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9d36b9b8-54c5-4b94-aaa4-f02a5c3fb0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd30a8ef215384e1f8a58505f4ad785ff'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:48.426143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9d36b9b8-54c5-4b94-aaa4-f02a5c3fb0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd30a8ef215384e1f8a58505f4ad785ff'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:48.433719 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9d36b9b8-54c5-4b94-aaa4-f02a5c3fb0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd30a8ef215384e1f8a58505f4ad785ff'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:48.441313 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-9d36b9b8-54c5-4b94-aaa4-f02a5c3fb0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd30a8ef215384e1f8a58505f4ad785ff'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:48.447283 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1449/2843] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:45:48 2022] DELETE /identity/v3/users/d30a8ef215384e1f8a58505f4ad785ff => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:45:48.451820 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c20825-b4f6-4d40-a1c5-a7aed9397a1f None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:48.452309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c20825-b4f6-4d40-a1c5-a7aed9397a1f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:48.452423 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c20825-b4f6-4d40-a1c5-a7aed9397a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:48.468805 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-46c20825-b4f6-4d40-a1c5-a7aed9397a1f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:45:48.469995 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-46c20825-b4f6-4d40-a1c5-a7aed9397a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:48.528655 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1395/2844] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:45:48.538528 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36b9b8-54c5-4b94-aaa4-f02a5c3fb0df admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:48.539950 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-9d36b9b8-54c5-4b94-aaa4-f02a5c3fb0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:48.598515 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36b9b8-54c5-4b94-aaa4-f02a5c3fb0df admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:48.602268 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46f5e1-8205-4d52-9254-05812dfaeb60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:48.602991 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46f5e1-8205-4d52-9254-05812dfaeb60 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:48.603276 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46f5e1-8205-4d52-9254-05812dfaeb60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:48.603577 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46f5e1-8205-4d52-9254-05812dfaeb60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:48.615783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46f5e1-8205-4d52-9254-05812dfaeb60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:48.617214 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46f5e1-8205-4d52-9254-05812dfaeb60 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:48.627615 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1450/2845] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:45:48.899727 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c20825-b4f6-4d40-a1c5-a7aed9397a1f None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:48.901244 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-46c20825-b4f6-4d40-a1c5-a7aed9397a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:48.914220 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c20825-b4f6-4d40-a1c5-a7aed9397a1f None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:48.920327 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:48.921358 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:48.921650 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:48.921931 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] PATH_INFO: `/v3/projects/c31d3a0c59d34b5087b70749b6a45101` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:48.923156 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31d3a0c59d34b5087b70749b6a45101)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:48.925153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:48.972527 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31d3a0c59d34b5087b70749b6a45101', 'request_id': 'req-12faa9e4-55ae-4e84-82ad-972f007dd6a4'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:48.978656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31d3a0c59d34b5087b70749b6a45101', 'request_id': 'req-12faa9e4-55ae-4e84-82ad-972f007dd6a4'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:48.985060 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31d3a0c59d34b5087b70749b6a45101', 'request_id': 'req-12faa9e4-55ae-4e84-82ad-972f007dd6a4'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:48.997893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] The token cache is being invalidate because project c31d3a0c59d34b5087b70749b6a45101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:45:48.998183 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:48.998802 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:49.000416 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1396/2846] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:45:48 2022] DELETE /identity/v3/projects/c31d3a0c59d34b5087b70749b6a45101 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:45:49.004399 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46f5e1-8205-4d52-9254-05812dfaeb60 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:49.014347 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46f5e1-8205-4d52-9254-05812dfaeb60 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:49.033715 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:49.074658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f601d5e-a913-40a0-bf1b-5b5da72d9af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:49.075635 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f601d5e-a913-40a0-bf1b-5b5da72d9af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:49.075917 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f601d5e-a913-40a0-bf1b-5b5da72d9af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:49.076193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f601d5e-a913-40a0-bf1b-5b5da72d9af1 admin admin] PATH_INFO: `/v3/users/c7215813c6354e52bea5ee1e801a5de3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:49.077543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f601d5e-a913-40a0-bf1b-5b5da72d9af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7215813c6354e52bea5ee1e801a5de3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:49.079560 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f601d5e-a913-40a0-bf1b-5b5da72d9af1 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:49.127449 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2f601d5e-a913-40a0-bf1b-5b5da72d9af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7215813c6354e52bea5ee1e801a5de3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:49.140317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2f601d5e-a913-40a0-bf1b-5b5da72d9af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7215813c6354e52bea5ee1e801a5de3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:49.141000 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2f601d5e-a913-40a0-bf1b-5b5da72d9af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7215813c6354e52bea5ee1e801a5de3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:49.147891 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2f601d5e-a913-40a0-bf1b-5b5da72d9af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7215813c6354e52bea5ee1e801a5de3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:49.156125 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-2f601d5e-a913-40a0-bf1b-5b5da72d9af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7215813c6354e52bea5ee1e801a5de3'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:49.162138 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1451/2847] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:45:49 2022] DELETE /identity/v3/users/c7215813c6354e52bea5ee1e801a5de3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:45:49.431102 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:49.432722 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:49.446894 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12faa9e4-55ae-4e84-82ad-972f007dd6a4 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:49.457030 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:49.511398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4490c-8183-4ecd-8ea4-6d7004c2104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:49.512284 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4490c-8183-4ecd-8ea4-6d7004c2104b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:49.512560 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4490c-8183-4ecd-8ea4-6d7004c2104b admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:49.512830 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4490c-8183-4ecd-8ea4-6d7004c2104b admin admin] PATH_INFO: `/v3/projects/f2621adc27e144119207ddd5981932fb` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:49.514041 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4490c-8183-4ecd-8ea4-6d7004c2104b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2621adc27e144119207ddd5981932fb)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:49.515975 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4490c-8183-4ecd-8ea4-6d7004c2104b admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:49.564494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-93a4490c-8183-4ecd-8ea4-6d7004c2104b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2621adc27e144119207ddd5981932fb', 'request_id': 'req-93a4490c-8183-4ecd-8ea4-6d7004c2104b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:49.570635 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-93a4490c-8183-4ecd-8ea4-6d7004c2104b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2621adc27e144119207ddd5981932fb', 'request_id': 'req-93a4490c-8183-4ecd-8ea4-6d7004c2104b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:49.577213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-93a4490c-8183-4ecd-8ea4-6d7004c2104b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2621adc27e144119207ddd5981932fb', 'request_id': 'req-93a4490c-8183-4ecd-8ea4-6d7004c2104b'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:49.591660 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-93a4490c-8183-4ecd-8ea4-6d7004c2104b admin admin] The token cache is being invalidate because project f2621adc27e144119207ddd5981932fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:45:49.591930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-93a4490c-8183-4ecd-8ea4-6d7004c2104b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:49.592816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-93a4490c-8183-4ecd-8ea4-6d7004c2104b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:45:49.594582 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1397/2848] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:45:49 2022] DELETE /identity/v3/projects/f2621adc27e144119207ddd5981932fb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:45:49.600431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403185c-715a-4b66-952d-a681251fbfb0 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:49.600931 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403185c-715a-4b66-952d-a681251fbfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:49.601098 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403185c-715a-4b66-952d-a681251fbfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:49.621882 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-7403185c-715a-4b66-952d-a681251fbfb0 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:45:49.623144 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-7403185c-715a-4b66-952d-a681251fbfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:49.686525 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1452/2849] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:45:49.694333 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe0c21-aec8-4728-8476-15532d27d60f None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:49.694623 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe0c21-aec8-4728-8476-15532d27d60f None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:49.694905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe0c21-aec8-4728-8476-15532d27d60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:49.713905 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-0bfe0c21-aec8-4728-8476-15532d27d60f None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:45:49.715119 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-0bfe0c21-aec8-4728-8476-15532d27d60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:49.723101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1398/2850] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:45:49.727486 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403185c-715a-4b66-952d-a681251fbfb0 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:49.737258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403185c-715a-4b66-952d-a681251fbfb0 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:49.741899 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d408b8-986f-470c-9e14-aa5ca66f2c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:49.742559 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d408b8-986f-470c-9e14-aa5ca66f2c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:49.742844 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d408b8-986f-470c-9e14-aa5ca66f2c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:49.743123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d408b8-986f-470c-9e14-aa5ca66f2c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:49.743897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d408b8-986f-470c-9e14-aa5ca66f2c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:45:49.744205 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d408b8-986f-470c-9e14-aa5ca66f2c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:49.746297 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d408b8-986f-470c-9e14-aa5ca66f2c56 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:49.758697 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1453/2851] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:45:49.763763 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe0c21-aec8-4728-8476-15532d27d60f None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:49.773346 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe0c21-aec8-4728-8476-15532d27d60f None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:49.777986 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d12375-5eea-44f7-a86d-366109d095fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:49.778642 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d12375-5eea-44f7-a86d-366109d095fc admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:49.778922 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d12375-5eea-44f7-a86d-366109d095fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:49.779198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d12375-5eea-44f7-a86d-366109d095fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:49.779930 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d12375-5eea-44f7-a86d-366109d095fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:49.781816 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d12375-5eea-44f7-a86d-366109d095fc admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:49.807447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1399/2852] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:45:49 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:45:49.812145 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d408b8-986f-470c-9e14-aa5ca66f2c56 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:49.822630 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d408b8-986f-470c-9e14-aa5ca66f2c56 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:49.849471 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:49.883379 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bdd60-9335-47db-90c4-4f3f6e3f2ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:49.884082 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bdd60-9335-47db-90c4-4f3f6e3f2ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:49.884367 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bdd60-9335-47db-90c4-4f3f6e3f2ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:49.884675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bdd60-9335-47db-90c4-4f3f6e3f2ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:49.885380 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0bdd60-9335-47db-90c4-4f3f6e3f2ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:49.887901 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0bdd60-9335-47db-90c4-4f3f6e3f2ee2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:49.906689 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1454/2853] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:45:49 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:45:49.910868 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d12375-5eea-44f7-a86d-366109d095fc admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:49.921786 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d12375-5eea-44f7-a86d-366109d095fc admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:49.927221 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cf868-481a-4a0c-b234-0faaf420cd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:49.928056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cf868-481a-4a0c-b234-0faaf420cd49 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:49.928369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cf868-481a-4a0c-b234-0faaf420cd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:49.928641 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cf868-481a-4a0c-b234-0faaf420cd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:49.929374 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cf868-481a-4a0c-b234-0faaf420cd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:49.930968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cf868-481a-4a0c-b234-0faaf420cd49 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:49.942467 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1400/2854] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:45:49.946518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bdd60-9335-47db-90c4-4f3f6e3f2ee2 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:49.956541 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bdd60-9335-47db-90c4-4f3f6e3f2ee2 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:49.961136 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e3dfc-9eba-4c23-8d1e-50b8d19b28d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:49.961791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e3dfc-9eba-4c23-8d1e-50b8d19b28d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:49.962072 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e3dfc-9eba-4c23-8d1e-50b8d19b28d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:49.962342 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e3dfc-9eba-4c23-8d1e-50b8d19b28d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:49.963096 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e3dfc-9eba-4c23-8d1e-50b8d19b28d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:49.964777 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e3dfc-9eba-4c23-8d1e-50b8d19b28d2 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:49.975543 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1455/2855] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:45:49.980316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cf868-481a-4a0c-b234-0faaf420cd49 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:49.990912 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cf868-481a-4a0c-b234-0faaf420cd49 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:49.996494 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e21d6-7258-4d33-9ecc-8ac8443fc81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:49.997429 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e21d6-7258-4d33-9ecc-8ac8443fc81f admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:49.997714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e21d6-7258-4d33-9ecc-8ac8443fc81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:49.997991 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e21d6-7258-4d33-9ecc-8ac8443fc81f admin admin] PATH_INFO: `/v3/projects/de8009ef495f448eaf55664dfe10b0ad/users/1ebf9ba85a3e46e88add29347ec99748/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:50.015034 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e21d6-7258-4d33-9ecc-8ac8443fc81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8009ef495f448eaf55664dfe10b0ad, user_id=1ebf9ba85a3e46e88add29347ec99748, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:50.017801 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e21d6-7258-4d33-9ecc-8ac8443fc81f admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:50.032516 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1401/2856] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:45:49 2022] PUT /identity/v3/projects/de8009ef495f448eaf55664dfe10b0ad/users/1ebf9ba85a3e46e88add29347ec99748/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:45:50.044975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774312-7433-4342-a4db-510310120565 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:50.045250 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774312-7433-4342-a4db-510310120565 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:50.045526 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774312-7433-4342-a4db-510310120565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:50.075983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-a9774312-7433-4342-a4db-510310120565 None None] MFA Rules not processed for user `1ebf9ba85a3e46e88add29347ec99748`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:45:50.077154 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a9774312-7433-4342-a4db-510310120565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:50.146075 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1456/2857] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:45:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:45:50.150639 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e21d6-7258-4d33-9ecc-8ac8443fc81f admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:50.193770 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:50.217344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e21d6-7258-4d33-9ecc-8ac8443fc81f admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:50.221998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f93e42-0f15-45b3-b13a-3692da177f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:50.222656 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93e42-0f15-45b3-b13a-3692da177f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:50.222937 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93e42-0f15-45b3-b13a-3692da177f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:50.223212 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93e42-0f15-45b3-b13a-3692da177f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:50.223943 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f93e42-0f15-45b3-b13a-3692da177f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:50.225825 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f93e42-0f15-45b3-b13a-3692da177f73 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:50.252417 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1402/2858] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:45:50 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:45:50.256667 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9774312-7433-4342-a4db-510310120565 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:50.267483 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9774312-7433-4342-a4db-510310120565 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:50.330040 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6db9d-e668-43af-b115-3e0cdda65c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:50.330611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6db9d-e668-43af-b115-3e0cdda65c86 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:50.330896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6db9d-e668-43af-b115-3e0cdda65c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:50.331172 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6db9d-e668-43af-b115-3e0cdda65c86 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:50.331914 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6db9d-e668-43af-b115-3e0cdda65c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:50.333824 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab6db9d-e668-43af-b115-3e0cdda65c86 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:50.354386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1457/2859] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:45:50 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:45:50.358999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f93e42-0f15-45b3-b13a-3692da177f73 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:50.369261 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f93e42-0f15-45b3-b13a-3692da177f73 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:50.373890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e898bc0-9419-4d9d-986a-66e8e40d9fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:50.374547 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e898bc0-9419-4d9d-986a-66e8e40d9fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:50.374829 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e898bc0-9419-4d9d-986a-66e8e40d9fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:50.375103 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e898bc0-9419-4d9d-986a-66e8e40d9fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:50.375863 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e898bc0-9419-4d9d-986a-66e8e40d9fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:50.377461 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e898bc0-9419-4d9d-986a-66e8e40d9fc1 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:50.389354 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1403/2860] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:45:50.393821 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6db9d-e668-43af-b115-3e0cdda65c86 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:50.404450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6db9d-e668-43af-b115-3e0cdda65c86 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:50.409794 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a8209-1042-4891-8564-ae7e459de1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:50.410675 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a8209-1042-4891-8564-ae7e459de1c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:50.410957 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a8209-1042-4891-8564-ae7e459de1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:50.411234 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a8209-1042-4891-8564-ae7e459de1c3 admin admin] PATH_INFO: `/v3/projects/6b032fd70d2648f8b451ea010964bb02/users/63426871ae724b99ba63176b8ca9020a/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:50.427732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a8209-1042-4891-8564-ae7e459de1c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b032fd70d2648f8b451ea010964bb02, user_id=63426871ae724b99ba63176b8ca9020a, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:50.430386 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a8209-1042-4891-8564-ae7e459de1c3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:50.444133 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1458/2861] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:45:50 2022] PUT /identity/v3/projects/6b032fd70d2648f8b451ea010964bb02/users/63426871ae724b99ba63176b8ca9020a/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:45:50.448282 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e898bc0-9419-4d9d-986a-66e8e40d9fc1 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:50.458154 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e898bc0-9419-4d9d-986a-66e8e40d9fc1 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:50.514091 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45513bc0-cbb8-46a5-9273-57b1d728bae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:50.514791 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45513bc0-cbb8-46a5-9273-57b1d728bae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:50.515079 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45513bc0-cbb8-46a5-9273-57b1d728bae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:50.515354 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45513bc0-cbb8-46a5-9273-57b1d728bae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:50.516120 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45513bc0-cbb8-46a5-9273-57b1d728bae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:50.517740 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45513bc0-cbb8-46a5-9273-57b1d728bae8 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:50.527903 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1404/2862] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:45:50.532333 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a8209-1042-4891-8564-ae7e459de1c3 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:50.538265 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:45:50.544926 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a8209-1042-4891-8564-ae7e459de1c3 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:50.549921 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fba6e-5172-4439-bdf0-ea866c3597bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:50.550810 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fba6e-5172-4439-bdf0-ea866c3597bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:50.551093 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fba6e-5172-4439-bdf0-ea866c3597bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:50.551372 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fba6e-5172-4439-bdf0-ea866c3597bc admin admin] PATH_INFO: `/v3/projects/6b032fd70d2648f8b451ea010964bb02/users/63426871ae724b99ba63176b8ca9020a/roles/e1a2021d08e14daa969362b3d23face3` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:50.553432 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fba6e-5172-4439-bdf0-ea866c3597bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b032fd70d2648f8b451ea010964bb02, user_id=63426871ae724b99ba63176b8ca9020a, role_id=e1a2021d08e14daa969362b3d23face3)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:50.556140 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fba6e-5172-4439-bdf0-ea866c3597bc admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:50.566954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1459/2863] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:45:50 2022] PUT /identity/v3/projects/6b032fd70d2648f8b451ea010964bb02/users/63426871ae724b99ba63176b8ca9020a/roles/e1a2021d08e14daa969362b3d23face3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:45:50.577035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d574157-5ef0-4fe3-af7b-31d96ad13972 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:50.577434 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d574157-5ef0-4fe3-af7b-31d96ad13972 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:50.577605 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d574157-5ef0-4fe3-af7b-31d96ad13972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:50.606918 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-4d574157-5ef0-4fe3-af7b-31d96ad13972 None None] MFA Rules not processed for user `63426871ae724b99ba63176b8ca9020a`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:45:50.608188 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4d574157-5ef0-4fe3-af7b-31d96ad13972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:50.677956 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1405/2864] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:45:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:45:50.689071 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fba6e-5172-4439-bdf0-ea866c3597bc admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:50.690817 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1c0fba6e-5172-4439-bdf0-ea866c3597bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:50.748402 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fba6e-5172-4439-bdf0-ea866c3597bc admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:50.752033 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac37c5f-3815-4b8a-8fa0-62edd8882d29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:50.752670 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac37c5f-3815-4b8a-8fa0-62edd8882d29 service cinder] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:50.752953 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac37c5f-3815-4b8a-8fa0-62edd8882d29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:50.753229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac37c5f-3815-4b8a-8fa0-62edd8882d29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:50.809123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac37c5f-3815-4b8a-8fa0-62edd8882d29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:50.810551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac37c5f-3815-4b8a-8fa0-62edd8882d29 service cinder] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:50.819383 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1460/2865] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:45:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:45:55.021376 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d574157-5ef0-4fe3-af7b-31d96ad13972 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:45:55.023421 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-4d574157-5ef0-4fe3-af7b-31d96ad13972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:45:55.034896 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d574157-5ef0-4fe3-af7b-31d96ad13972 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:45:55.038444 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11a7bc-0167-4542-b2a2-be6986649bda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:45:55.039086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11a7bc-0167-4542-b2a2-be6986649bda service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:45:55.039369 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11a7bc-0167-4542-b2a2-be6986649bda service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:45:55.039679 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11a7bc-0167-4542-b2a2-be6986649bda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:45:55.048568 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11a7bc-0167-4542-b2a2-be6986649bda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:45:55.049993 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11a7bc-0167-4542-b2a2-be6986649bda service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:45:55.059786 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1406/2866] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:45:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:45:59.951161 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac37c5f-3815-4b8a-8fa0-62edd8882d29 service cinder] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:00.012610 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac37c5f-3815-4b8a-8fa0-62edd8882d29 service cinder] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:00.017207 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a658e-378f-4322-a126-e94614577e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:00.018079 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a658e-378f-4322-a126-e94614577e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:00.018361 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a658e-378f-4322-a126-e94614577e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:00.018638 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a658e-378f-4322-a126-e94614577e89 admin admin] PATH_INFO: `/v3/users/1ebf9ba85a3e46e88add29347ec99748` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:00.019867 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a658e-378f-4322-a126-e94614577e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ebf9ba85a3e46e88add29347ec99748)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:00.021802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a658e-378f-4322-a126-e94614577e89 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:00.067206 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:00.068969 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-675a658e-378f-4322-a126-e94614577e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ebf9ba85a3e46e88add29347ec99748'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.083193 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-675a658e-378f-4322-a126-e94614577e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ebf9ba85a3e46e88add29347ec99748'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.083888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-675a658e-378f-4322-a126-e94614577e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ebf9ba85a3e46e88add29347ec99748'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.091372 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-675a658e-378f-4322-a126-e94614577e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ebf9ba85a3e46e88add29347ec99748'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.099492 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-675a658e-378f-4322-a126-e94614577e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ebf9ba85a3e46e88add29347ec99748'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.105983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1461/2867] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:45:59 2022] DELETE /identity/v3/users/1ebf9ba85a3e46e88add29347ec99748 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:46:00.110561 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb01685-2e7a-498c-8d8f-c705c2149797 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:00.111035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb01685-2e7a-498c-8d8f-c705c2149797 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:00.111153 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb01685-2e7a-498c-8d8f-c705c2149797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:00.128330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-8fb01685-2e7a-498c-8d8f-c705c2149797 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:46:00.129538 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8fb01685-2e7a-498c-8d8f-c705c2149797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:00.142704 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:00.190180 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1407/2868] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:46:00.199825 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a658e-378f-4322-a126-e94614577e89 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:00.201317 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-675a658e-378f-4322-a126-e94614577e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:00.259992 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a658e-378f-4322-a126-e94614577e89 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:00.263718 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafce94-0dd6-4097-8bc3-380cbff77173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:00.264490 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafce94-0dd6-4097-8bc3-380cbff77173 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:00.264770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafce94-0dd6-4097-8bc3-380cbff77173 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:00.265046 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafce94-0dd6-4097-8bc3-380cbff77173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:00.274251 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafce94-0dd6-4097-8bc3-380cbff77173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:00.275710 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafce94-0dd6-4097-8bc3-380cbff77173 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:00.285685 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1462/2869] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:46:00.556612 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb01685-2e7a-498c-8d8f-c705c2149797 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:00.558193 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-8fb01685-2e7a-498c-8d8f-c705c2149797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:00.570138 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb01685-2e7a-498c-8d8f-c705c2149797 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:00.575386 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:00.576288 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:00.576572 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:00.576901 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] PATH_INFO: `/v3/projects/de8009ef495f448eaf55664dfe10b0ad` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:00.578043 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8009ef495f448eaf55664dfe10b0ad)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:00.579981 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:00.628979 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8009ef495f448eaf55664dfe10b0ad', 'request_id': 'req-0931b3e0-a56d-4409-b003-d4319b735db1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.635297 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8009ef495f448eaf55664dfe10b0ad', 'request_id': 'req-0931b3e0-a56d-4409-b003-d4319b735db1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.641390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8009ef495f448eaf55664dfe10b0ad', 'request_id': 'req-0931b3e0-a56d-4409-b003-d4319b735db1'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.654929 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] The token cache is being invalidate because project de8009ef495f448eaf55664dfe10b0ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:46:00.655216 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.655906 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.657464 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1408/2870] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:46:00 2022] DELETE /identity/v3/projects/de8009ef495f448eaf55664dfe10b0ad => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:46:00.661450 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafce94-0dd6-4097-8bc3-380cbff77173 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:00.671869 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafce94-0dd6-4097-8bc3-380cbff77173 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:00.730666 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d1f36-62b5-46bf-8020-0e8e5d974e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:00.731444 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d1f36-62b5-46bf-8020-0e8e5d974e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:00.731771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d1f36-62b5-46bf-8020-0e8e5d974e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:00.732052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d1f36-62b5-46bf-8020-0e8e5d974e2d admin admin] PATH_INFO: `/v3/users/63426871ae724b99ba63176b8ca9020a` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:00.733297 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d1f36-62b5-46bf-8020-0e8e5d974e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=63426871ae724b99ba63176b8ca9020a)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:00.735229 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d1f36-62b5-46bf-8020-0e8e5d974e2d admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:00.781774 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fc4d1f36-62b5-46bf-8020-0e8e5d974e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63426871ae724b99ba63176b8ca9020a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.794551 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fc4d1f36-62b5-46bf-8020-0e8e5d974e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63426871ae724b99ba63176b8ca9020a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.795249 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fc4d1f36-62b5-46bf-8020-0e8e5d974e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63426871ae724b99ba63176b8ca9020a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.797258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:00.803227 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fc4d1f36-62b5-46bf-8020-0e8e5d974e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63426871ae724b99ba63176b8ca9020a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.811163 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-fc4d1f36-62b5-46bf-8020-0e8e5d974e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63426871ae724b99ba63176b8ca9020a'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:00.817032 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1463/2871] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:46:00 2022] DELETE /identity/v3/users/63426871ae724b99ba63176b8ca9020a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:46:01.093765 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:01.095236 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:01.108908 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931b3e0-a56d-4409-b003-d4319b735db1 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:01.165476 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aaa53e-3dae-422c-a991-2d742d8e8493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:01.166336 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaa53e-3dae-422c-a991-2d742d8e8493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:01.166620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaa53e-3dae-422c-a991-2d742d8e8493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:01.167455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaa53e-3dae-422c-a991-2d742d8e8493 admin admin] PATH_INFO: `/v3/projects/6b032fd70d2648f8b451ea010964bb02` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:01.168662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aaa53e-3dae-422c-a991-2d742d8e8493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b032fd70d2648f8b451ea010964bb02)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:01.170581 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aaa53e-3dae-422c-a991-2d742d8e8493 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:01.212523 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:01.215526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-50aaa53e-3dae-422c-a991-2d742d8e8493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b032fd70d2648f8b451ea010964bb02', 'request_id': 'req-50aaa53e-3dae-422c-a991-2d742d8e8493'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:01.223714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-50aaa53e-3dae-422c-a991-2d742d8e8493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b032fd70d2648f8b451ea010964bb02', 'request_id': 'req-50aaa53e-3dae-422c-a991-2d742d8e8493'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:01.229265 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-50aaa53e-3dae-422c-a991-2d742d8e8493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b032fd70d2648f8b451ea010964bb02', 'request_id': 'req-50aaa53e-3dae-422c-a991-2d742d8e8493'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:01.241556 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-50aaa53e-3dae-422c-a991-2d742d8e8493 admin admin] The token cache is being invalidate because project 6b032fd70d2648f8b451ea010964bb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:46:01.241842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-50aaa53e-3dae-422c-a991-2d742d8e8493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:01.242480 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-50aaa53e-3dae-422c-a991-2d742d8e8493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:01.244086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1409/2872] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:46:01 2022] DELETE /identity/v3/projects/6b032fd70d2648f8b451ea010964bb02 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:46:01.252148 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27405f-a7d3-41fa-9280-daec35167c41 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:01.252661 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27405f-a7d3-41fa-9280-daec35167c41 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:01.252776 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27405f-a7d3-41fa-9280-daec35167c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:01.270698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-1b27405f-a7d3-41fa-9280-daec35167c41 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:46:01.271874 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-1b27405f-a7d3-41fa-9280-daec35167c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:01.330204 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1464/2873] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:46:01.338634 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76572057-9762-4b01-8a25-684e017681fa None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:01.338927 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76572057-9762-4b01-8a25-684e017681fa None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:01.339210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76572057-9762-4b01-8a25-684e017681fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:01.357787 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-76572057-9762-4b01-8a25-684e017681fa None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:46:01.358976 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-76572057-9762-4b01-8a25-684e017681fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:01.366734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1410/2874] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:46:01.371518 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27405f-a7d3-41fa-9280-daec35167c41 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:01.381292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27405f-a7d3-41fa-9280-daec35167c41 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:01.385787 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a711db-c00b-46a9-84c2-d75bec9d607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:01.386431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a711db-c00b-46a9-84c2-d75bec9d607f admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:01.386711 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a711db-c00b-46a9-84c2-d75bec9d607f admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:01.386986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a711db-c00b-46a9-84c2-d75bec9d607f admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:01.387736 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a711db-c00b-46a9-84c2-d75bec9d607f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:46:01.388043 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a711db-c00b-46a9-84c2-d75bec9d607f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:01.389613 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a711db-c00b-46a9-84c2-d75bec9d607f admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:01.400989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1465/2875] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:46:01.405238 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76572057-9762-4b01-8a25-684e017681fa None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:01.414536 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76572057-9762-4b01-8a25-684e017681fa None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:01.419721 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a8bcb-c20b-4fe5-8cc6-472a49b46329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:01.420375 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a8bcb-c20b-4fe5-8cc6-472a49b46329 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:01.420657 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a8bcb-c20b-4fe5-8cc6-472a49b46329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:01.420935 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a8bcb-c20b-4fe5-8cc6-472a49b46329 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:01.421620 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a8bcb-c20b-4fe5-8cc6-472a49b46329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:01.423530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a8bcb-c20b-4fe5-8cc6-472a49b46329 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:01.448707 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1411/2876] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:46:01 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:46:01.452876 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a711db-c00b-46a9-84c2-d75bec9d607f admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:01.463507 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a711db-c00b-46a9-84c2-d75bec9d607f admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:01.519679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b5fad-af0b-4496-aa8e-63de61db02a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:01.520344 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b5fad-af0b-4496-aa8e-63de61db02a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:01.520617 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b5fad-af0b-4496-aa8e-63de61db02a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:01.520942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b5fad-af0b-4496-aa8e-63de61db02a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:01.521581 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b5fad-af0b-4496-aa8e-63de61db02a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:01.523502 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b5fad-af0b-4496-aa8e-63de61db02a6 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:01.545751 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1466/2877] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:46:01 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:46:01.549858 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a8bcb-c20b-4fe5-8cc6-472a49b46329 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:01.560209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a8bcb-c20b-4fe5-8cc6-472a49b46329 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:01.565107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71085c1-63f5-44c5-b593-4ac70d004c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:01.565894 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71085c1-63f5-44c5-b593-4ac70d004c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:01.566182 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71085c1-63f5-44c5-b593-4ac70d004c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:01.566485 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71085c1-63f5-44c5-b593-4ac70d004c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:01.567210 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71085c1-63f5-44c5-b593-4ac70d004c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:01.568849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71085c1-63f5-44c5-b593-4ac70d004c64 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:01.579431 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1412/2878] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:46:01.583100 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b5fad-af0b-4496-aa8e-63de61db02a6 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:01.593460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b5fad-af0b-4496-aa8e-63de61db02a6 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:01.598117 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392efc0-5e41-4cf7-b767-c798cfaf039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:01.598763 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392efc0-5e41-4cf7-b767-c798cfaf039c admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:01.599047 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392efc0-5e41-4cf7-b767-c798cfaf039c admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:01.599325 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392efc0-5e41-4cf7-b767-c798cfaf039c admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:01.600077 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392efc0-5e41-4cf7-b767-c798cfaf039c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:01.601658 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392efc0-5e41-4cf7-b767-c798cfaf039c admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:01.612171 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1467/2879] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:46:01.615997 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71085c1-63f5-44c5-b593-4ac70d004c64 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:01.625838 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71085c1-63f5-44c5-b593-4ac70d004c64 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:01.630343 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9fbe3-a88c-4ada-a653-66978fbb7f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:01.631492 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9fbe3-a88c-4ada-a653-66978fbb7f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:01.631780 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9fbe3-a88c-4ada-a653-66978fbb7f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:01.632051 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9fbe3-a88c-4ada-a653-66978fbb7f62 admin admin] PATH_INFO: `/v3/projects/726383e81671470fa4b810bd6c6e1e59/users/3d5972daf56e4be2902cde9ad6f586a2/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:01.646711 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9fbe3-a88c-4ada-a653-66978fbb7f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726383e81671470fa4b810bd6c6e1e59, user_id=3d5972daf56e4be2902cde9ad6f586a2, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:01.649359 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9fbe3-a88c-4ada-a653-66978fbb7f62 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:01.663122 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1413/2880] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:46:01 2022] PUT /identity/v3/projects/726383e81671470fa4b810bd6c6e1e59/users/3d5972daf56e4be2902cde9ad6f586a2/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:46:01.675897 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e10b3-c8d2-49df-af7e-7d62fd4c9fb2 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:01.676188 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e10b3-c8d2-49df-af7e-7d62fd4c9fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:01.676463 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e10b3-c8d2-49df-af7e-7d62fd4c9fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:01.702783 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6c6e10b3-c8d2-49df-af7e-7d62fd4c9fb2 None None] MFA Rules not processed for user `3d5972daf56e4be2902cde9ad6f586a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:46:01.704065 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6c6e10b3-c8d2-49df-af7e-7d62fd4c9fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:01.744816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:01.771197 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1468/2881] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:46:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:46:01.782759 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9fbe3-a88c-4ada-a653-66978fbb7f62 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:01.784550 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-7cb9fbe3-a88c-4ada-a653-66978fbb7f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:01.841691 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9fbe3-a88c-4ada-a653-66978fbb7f62 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:01.845644 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b5c52-aad0-4ae4-96a1-454f2a268b4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68f1b06364a24554bba9936621127752', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:01.846287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b5c52-aad0-4ae4-96a1-454f2a268b4c service glance] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:01.846571 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b5c52-aad0-4ae4-96a1-454f2a268b4c service glance] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:01.846849 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b5c52-aad0-4ae4-96a1-454f2a268b4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:01.855300 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b5c52-aad0-4ae4-96a1-454f2a268b4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:01.856760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b5c52-aad0-4ae4-96a1-454f2a268b4c service glance] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:01.865648 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1414/2882] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:46:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:46:11.768293 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=9 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:11.861642 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:28.524985 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e10b3-c8d2-49df-af7e-7d62fd4c9fb2 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:28.593118 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e10b3-c8d2-49df-af7e-7d62fd4c9fb2 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:28.597753 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3ed9-267d-4a56-982c-b0f18ee6ef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:28.598770 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3ed9-267d-4a56-982c-b0f18ee6ef53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:28.598914 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3ed9-267d-4a56-982c-b0f18ee6ef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:28.599181 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3ed9-267d-4a56-982c-b0f18ee6ef53 admin admin] PATH_INFO: `/v3/users/3d5972daf56e4be2902cde9ad6f586a2` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:28.600463 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3ed9-267d-4a56-982c-b0f18ee6ef53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d5972daf56e4be2902cde9ad6f586a2)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:28.602375 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3ed9-267d-4a56-982c-b0f18ee6ef53 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:28.652181 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d71f3ed9-267d-4a56-982c-b0f18ee6ef53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d5972daf56e4be2902cde9ad6f586a2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:28.666123 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d71f3ed9-267d-4a56-982c-b0f18ee6ef53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d5972daf56e4be2902cde9ad6f586a2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:28.666827 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d71f3ed9-267d-4a56-982c-b0f18ee6ef53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d5972daf56e4be2902cde9ad6f586a2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:28.674593 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d71f3ed9-267d-4a56-982c-b0f18ee6ef53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d5972daf56e4be2902cde9ad6f586a2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:28.682426 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-d71f3ed9-267d-4a56-982c-b0f18ee6ef53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d5972daf56e4be2902cde9ad6f586a2'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:28.688623 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1469/2883] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:46:28 2022] DELETE /identity/v3/users/3d5972daf56e4be2902cde9ad6f586a2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:46:28.693508 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdbdcd-8ee8-4c60-bd39-1add3c4fb88c None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:28.694000 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdbdcd-8ee8-4c60-bd39-1add3c4fb88c None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:28.694108 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdbdcd-8ee8-4c60-bd39-1add3c4fb88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:28.710684 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-a9cdbdcd-8ee8-4c60-bd39-1add3c4fb88c None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:46:28.711913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a9cdbdcd-8ee8-4c60-bd39-1add3c4fb88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:28.770630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1415/2884] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:46:28.781589 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3ed9-267d-4a56-982c-b0f18ee6ef53 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:28.783028 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d71f3ed9-267d-4a56-982c-b0f18ee6ef53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:28.839676 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3ed9-267d-4a56-982c-b0f18ee6ef53 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:28.843881 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e3175-73fb-49a3-8340-da44fa96ccc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:28.844522 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e3175-73fb-49a3-8340-da44fa96ccc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:28.844802 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e3175-73fb-49a3-8340-da44fa96ccc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:28.845080 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e3175-73fb-49a3-8340-da44fa96ccc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:28.854592 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e3175-73fb-49a3-8340-da44fa96ccc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:28.856669 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e3175-73fb-49a3-8340-da44fa96ccc2 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:28.866875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1470/2885] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:46:29.156455 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdbdcd-8ee8-4c60-bd39-1add3c4fb88c None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:29.158724 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-a9cdbdcd-8ee8-4c60-bd39-1add3c4fb88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:29.176530 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdbdcd-8ee8-4c60-bd39-1add3c4fb88c None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:29.181330 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae4856-f3dd-42b8-9213-a44c7444dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:29.182213 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4856-f3dd-42b8-9213-a44c7444dbab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:29.182491 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4856-f3dd-42b8-9213-a44c7444dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:29.182767 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4856-f3dd-42b8-9213-a44c7444dbab admin admin] PATH_INFO: `/v3/projects/726383e81671470fa4b810bd6c6e1e59` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:29.184589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae4856-f3dd-42b8-9213-a44c7444dbab admin admin] RBAC: Authorizing `identity:delete_project(project_id=726383e81671470fa4b810bd6c6e1e59)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:29.186512 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae4856-f3dd-42b8-9213-a44c7444dbab admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:29.239389 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a2ae4856-f3dd-42b8-9213-a44c7444dbab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726383e81671470fa4b810bd6c6e1e59', 'request_id': 'req-a2ae4856-f3dd-42b8-9213-a44c7444dbab'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:29.246019 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a2ae4856-f3dd-42b8-9213-a44c7444dbab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726383e81671470fa4b810bd6c6e1e59', 'request_id': 'req-a2ae4856-f3dd-42b8-9213-a44c7444dbab'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:29.253108 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a2ae4856-f3dd-42b8-9213-a44c7444dbab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726383e81671470fa4b810bd6c6e1e59', 'request_id': 'req-a2ae4856-f3dd-42b8-9213-a44c7444dbab'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:29.266459 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a2ae4856-f3dd-42b8-9213-a44c7444dbab admin admin] The token cache is being invalidate because project 726383e81671470fa4b810bd6c6e1e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:46:29.266746 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a2ae4856-f3dd-42b8-9213-a44c7444dbab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:29.267378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a2ae4856-f3dd-42b8-9213-a44c7444dbab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:29.268958 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1416/2886] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:46:29 2022] DELETE /identity/v3/projects/726383e81671470fa4b810bd6c6e1e59 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:46:29.274104 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50884ebd-63f8-4921-8859-161a59cfe1e1 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:29.274309 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50884ebd-63f8-4921-8859-161a59cfe1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:29.274539 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50884ebd-63f8-4921-8859-161a59cfe1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:29.295414 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-50884ebd-63f8-4921-8859-161a59cfe1e1 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:46:29.296662 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-50884ebd-63f8-4921-8859-161a59cfe1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:29.315570 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:29.360986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1471/2887] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:46:29.368966 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56ed61-16a2-4881-8592-7fb33e626419 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:29.369255 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56ed61-16a2-4881-8592-7fb33e626419 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:29.369533 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56ed61-16a2-4881-8592-7fb33e626419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:29.388575 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-0d56ed61-16a2-4881-8592-7fb33e626419 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:46:29.389813 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-0d56ed61-16a2-4881-8592-7fb33e626419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:29.398603 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1417/2888] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:46:29.403380 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50884ebd-63f8-4921-8859-161a59cfe1e1 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:29.413934 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50884ebd-63f8-4921-8859-161a59cfe1e1 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:29.419237 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fc97f-4ef6-4392-94ba-b1d801b4b2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:29.420500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc97f-4ef6-4392-94ba-b1d801b4b2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:29.420500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc97f-4ef6-4392-94ba-b1d801b4b2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:29.420500 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc97f-4ef6-4392-94ba-b1d801b4b2b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:29.421226 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fc97f-4ef6-4392-94ba-b1d801b4b2b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80117) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 10:46:29.421530 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fc97f-4ef6-4392-94ba-b1d801b4b2b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:29.423132 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fc97f-4ef6-4392-94ba-b1d801b4b2b3 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:29.435459 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1472/2889] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Jun 15 10:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 10:46:29.439968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56ed61-16a2-4881-8592-7fb33e626419 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:29.449405 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56ed61-16a2-4881-8592-7fb33e626419 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:29.454178 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9282b95-535c-4a2f-9ec5-960399a86b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:29.455015 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9282b95-535c-4a2f-9ec5-960399a86b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:29.455301 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9282b95-535c-4a2f-9ec5-960399a86b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:29.455619 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9282b95-535c-4a2f-9ec5-960399a86b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:29.456307 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9282b95-535c-4a2f-9ec5-960399a86b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:29.458209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9282b95-535c-4a2f-9ec5-960399a86b71 admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:29.484249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1418/2890] 10.222.0.50 () {60 vars in 1152 bytes} [Wed Jun 15 10:46:29 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 10:46:29.488439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fc97f-4ef6-4392-94ba-b1d801b4b2b3 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:29.499007 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fc97f-4ef6-4392-94ba-b1d801b4b2b3 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:29.562122 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeab730-9175-4d78-ad06-3036be92b220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:29.562797 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeab730-9175-4d78-ad06-3036be92b220 admin admin] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:29.562983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeab730-9175-4d78-ad06-3036be92b220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:29.563258 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeab730-9175-4d78-ad06-3036be92b220 admin admin] PATH_INFO: `/v3/users` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:29.563998 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeab730-9175-4d78-ad06-3036be92b220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:29.565918 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeab730-9175-4d78-ad06-3036be92b220 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:29.585388 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1473/2891] 10.222.0.50 () {60 vars in 1143 bytes} [Wed Jun 15 10:46:29 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 10:46:29.592099 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9282b95-535c-4a2f-9ec5-960399a86b71 admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:29.602785 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9282b95-535c-4a2f-9ec5-960399a86b71 admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:29.608204 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ca26e-c9b8-4b9b-acdc-996b515e376a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:29.608881 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca26e-c9b8-4b9b-acdc-996b515e376a admin admin] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:29.609164 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca26e-c9b8-4b9b-acdc-996b515e376a admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:29.609442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca26e-c9b8-4b9b-acdc-996b515e376a admin admin] PATH_INFO: `/v3/roles` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:29.610194 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ca26e-c9b8-4b9b-acdc-996b515e376a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:29.611842 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ca26e-c9b8-4b9b-acdc-996b515e376a admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:29.622720 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1419/2892] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:46:29.626888 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeab730-9175-4d78-ad06-3036be92b220 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:29.637875 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeab730-9175-4d78-ad06-3036be92b220 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:29.642714 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc146e-3ffe-4070-9c41-b8aa2d3fe6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:29.643446 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc146e-3ffe-4070-9c41-b8aa2d3fe6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:29.643709 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc146e-3ffe-4070-9c41-b8aa2d3fe6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:29.643983 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc146e-3ffe-4070-9c41-b8aa2d3fe6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:29.644762 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc146e-3ffe-4070-9c41-b8aa2d3fe6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:29.646370 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc146e-3ffe-4070-9c41-b8aa2d3fe6a4 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:29.657883 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1474/2893] 10.222.0.50 () {58 vars in 1121 bytes} [Wed Jun 15 10:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 10:46:29.663162 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ca26e-c9b8-4b9b-acdc-996b515e376a admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:29.674223 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ca26e-c9b8-4b9b-acdc-996b515e376a admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:29.679049 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c2fc5-ea11-4944-a9d5-ec8d72d3aecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:29.679990 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c2fc5-ea11-4944-a9d5-ec8d72d3aecb admin admin] REQUEST_METHOD: `PUT` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:29.680279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c2fc5-ea11-4944-a9d5-ec8d72d3aecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:29.680557 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c2fc5-ea11-4944-a9d5-ec8d72d3aecb admin admin] PATH_INFO: `/v3/projects/09e739bc22954b8e994611d69ed7e828/users/36473998232c4a89a5acb7ac0f2bb72d/roles/484f610225884740911a5c3333f22221` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:29.696083 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c2fc5-ea11-4944-a9d5-ec8d72d3aecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e739bc22954b8e994611d69ed7e828, user_id=36473998232c4a89a5acb7ac0f2bb72d, role_id=484f610225884740911a5c3333f22221)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:29.698760 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c2fc5-ea11-4944-a9d5-ec8d72d3aecb admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:29.716665 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1420/2894] 10.222.0.50 () {60 vars in 1482 bytes} [Wed Jun 15 10:46:29 2022] PUT /identity/v3/projects/09e739bc22954b8e994611d69ed7e828/users/36473998232c4a89a5acb7ac0f2bb72d/roles/484f610225884740911a5c3333f22221 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:46:29.728403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c727c-bb15-46d9-925e-7fb9f1ce0c14 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:29.728403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c727c-bb15-46d9-925e-7fb9f1ce0c14 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:29.729141 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c727c-bb15-46d9-925e-7fb9f1ce0c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:29.757030 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-6c0c727c-bb15-46d9-925e-7fb9f1ce0c14 None None] MFA Rules not processed for user `36473998232c4a89a5acb7ac0f2bb72d`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:46:29.757694 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-6c0c727c-bb15-46d9-925e-7fb9f1ce0c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:29.829439 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1475/2895] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:46:29.839872 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c2fc5-ea11-4944-a9d5-ec8d72d3aecb admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:29.842147 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-360c2fc5-ea11-4944-a9d5-ec8d72d3aecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:29.867398 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:29.904973 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c2fc5-ea11-4944-a9d5-ec8d72d3aecb admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:29.908844 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857e4e7-b886-480a-bbc3-9b626ca10fed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '383ef65dd6b14810a7a2a8e06143eca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:29.909521 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857e4e7-b886-480a-bbc3-9b626ca10fed service cinder] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:29.909812 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857e4e7-b886-480a-bbc3-9b626ca10fed service cinder] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:29.910117 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857e4e7-b886-480a-bbc3-9b626ca10fed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:29.920897 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857e4e7-b886-480a-bbc3-9b626ca10fed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:29.923107 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857e4e7-b886-480a-bbc3-9b626ca10fed service cinder] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:29.935756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1421/2896] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:46:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:46:39.826425 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:39.907088 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c727c-bb15-46d9-925e-7fb9f1ce0c14 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:39.928756 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=17 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:39.975784 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c727c-bb15-46d9-925e-7fb9f1ce0c14 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:39.982880 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018e04c-354a-48ec-b2ab-0832ef867857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:39.983771 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018e04c-354a-48ec-b2ab-0832ef867857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:39.984052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018e04c-354a-48ec-b2ab-0832ef867857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:39.984322 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018e04c-354a-48ec-b2ab-0832ef867857 admin admin] PATH_INFO: `/v3/users/36473998232c4a89a5acb7ac0f2bb72d` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:39.985503 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018e04c-354a-48ec-b2ab-0832ef867857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36473998232c4a89a5acb7ac0f2bb72d)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:39.987406 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018e04c-354a-48ec-b2ab-0832ef867857 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:40.035757 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5018e04c-354a-48ec-b2ab-0832ef867857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36473998232c4a89a5acb7ac0f2bb72d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:40.052260 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5018e04c-354a-48ec-b2ab-0832ef867857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36473998232c4a89a5acb7ac0f2bb72d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:40.053020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5018e04c-354a-48ec-b2ab-0832ef867857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36473998232c4a89a5acb7ac0f2bb72d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:40.060143 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5018e04c-354a-48ec-b2ab-0832ef867857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36473998232c4a89a5acb7ac0f2bb72d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:40.067954 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-5018e04c-354a-48ec-b2ab-0832ef867857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36473998232c4a89a5acb7ac0f2bb72d'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:40.074051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1476/2897] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:46:39 2022] DELETE /identity/v3/users/36473998232c4a89a5acb7ac0f2bb72d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:46:40.079442 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198c56-364b-4158-b3f4-1b6aa56bee31 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:40.079750 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198c56-364b-4158-b3f4-1b6aa56bee31 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:40.080026 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198c56-364b-4158-b3f4-1b6aa56bee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:40.099173 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-b1198c56-364b-4158-b3f4-1b6aa56bee31 None None] MFA Rules not processed for user `283045f7f6ca4861bfbecc3aa402c697`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:46:40.100409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b1198c56-364b-4158-b3f4-1b6aa56bee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:40.162431 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1422/2898] 10.222.0.50 () {58 vars in 957 bytes} [Wed Jun 15 10:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:46:40.172260 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018e04c-354a-48ec-b2ab-0832ef867857 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:40.173721 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-5018e04c-354a-48ec-b2ab-0832ef867857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:40.232620 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018e04c-354a-48ec-b2ab-0832ef867857 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:40.236400 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b67843-eb78-4941-9f02-2e8c06c3374c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:40.237115 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b67843-eb78-4941-9f02-2e8c06c3374c service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:40.237431 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b67843-eb78-4941-9f02-2e8c06c3374c service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:40.237741 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b67843-eb78-4941-9f02-2e8c06c3374c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:40.247231 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b67843-eb78-4941-9f02-2e8c06c3374c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:40.248696 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b67843-eb78-4941-9f02-2e8c06c3374c service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:40.258494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1477/2899] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:46:40.561318 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1198c56-364b-4158-b3f4-1b6aa56bee31 None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:40.562913 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b1198c56-364b-4158-b3f4-1b6aa56bee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:40.583184 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1198c56-364b-4158-b3f4-1b6aa56bee31 None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:40.589949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6875a0d-0c42-419a-a01d-b66a4698685c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:40.590796 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6875a0d-0c42-419a-a01d-b66a4698685c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:40.591075 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6875a0d-0c42-419a-a01d-b66a4698685c admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:40.591349 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6875a0d-0c42-419a-a01d-b66a4698685c admin admin] PATH_INFO: `/v3/projects/09e739bc22954b8e994611d69ed7e828` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:40.592587 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6875a0d-0c42-419a-a01d-b66a4698685c admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e739bc22954b8e994611d69ed7e828)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:40.594505 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6875a0d-0c42-419a-a01d-b66a4698685c admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:40.652044 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a6875a0d-0c42-419a-a01d-b66a4698685c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e739bc22954b8e994611d69ed7e828', 'request_id': 'req-a6875a0d-0c42-419a-a01d-b66a4698685c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:40.659734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a6875a0d-0c42-419a-a01d-b66a4698685c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e739bc22954b8e994611d69ed7e828', 'request_id': 'req-a6875a0d-0c42-419a-a01d-b66a4698685c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:40.665503 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a6875a0d-0c42-419a-a01d-b66a4698685c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e739bc22954b8e994611d69ed7e828', 'request_id': 'req-a6875a0d-0c42-419a-a01d-b66a4698685c'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:40.679390 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a6875a0d-0c42-419a-a01d-b66a4698685c admin admin] The token cache is being invalidate because project 09e739bc22954b8e994611d69ed7e828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80118) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:46:40.679717 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a6875a0d-0c42-419a-a01d-b66a4698685c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:40.680339 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-a6875a0d-0c42-419a-a01d-b66a4698685c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:46:40.681892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1423/2900] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:46:40 2022] DELETE /identity/v3/projects/09e739bc22954b8e994611d69ed7e828 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:46:46.704986 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a87b31-74c9-49ea-8a88-116c1f755746 None None] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:46.705616 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a87b31-74c9-49ea-8a88-116c1f755746 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:46.705732 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a87b31-74c9-49ea-8a88-116c1f755746 None None] PATH_INFO: `/` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:46.707185 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1478/2901] 10.222.0.50 () {54 vars in 921 bytes} [Wed Jun 15 10:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:46:46.713514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b84881-399d-42bd-a260-1cdc8ff18e52 None None] REQUEST_METHOD: `POST` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:46.714112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b84881-399d-42bd-a260-1cdc8ff18e52 None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:46.714112 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b84881-399d-42bd-a260-1cdc8ff18e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:46.761676 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.auth.core [None req-35b84881-399d-42bd-a260-1cdc8ff18e52 None None] MFA Rules not processed for user `5f2e2038f69f49019a1e528107296223`. Rule list: `[]` (Enabled: `True`). {{(pid=80118) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:46:46.763989 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-35b84881-399d-42bd-a260-1cdc8ff18e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:46.819526 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1424/2902] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Jun 15 10:46:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 10:46:46.839391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a87b31-74c9-49ea-8a88-116c1f755746 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:46.841165 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-59a87b31-74c9-49ea-8a88-116c1f755746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:46.855345 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a87b31-74c9-49ea-8a88-116c1f755746 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:46.859599 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f26c7-fb8c-4f65-a734-c88779ba54c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:46.860248 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f26c7-fb8c-4f65-a734-c88779ba54c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:46.860600 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f26c7-fb8c-4f65-a734-c88779ba54c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:46.860885 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f26c7-fb8c-4f65-a734-c88779ba54c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:46.868442 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f26c7-fb8c-4f65-a734-c88779ba54c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:46.869862 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f26c7-fb8c-4f65-a734-c88779ba54c5 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:46.878579 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1479/2903] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:46:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:46:46.962675 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dacae-7ffb-424f-89ae-458098e322cf None None] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:46.962994 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dacae-7ffb-424f-89ae-458098e322cf None None] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:46.963316 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dacae-7ffb-424f-89ae-458098e322cf None None] PATH_INFO: `/` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:46.964779 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1425/2904] 10.222.0.50 () {54 vars in 921 bytes} [Wed Jun 15 10:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 10:46:46.970104 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d77e9-8dd3-40c7-946c-1ede20c6b298 None None] REQUEST_METHOD: `POST` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:46.970397 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d77e9-8dd3-40c7-946c-1ede20c6b298 None None] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:46.970682 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d77e9-8dd3-40c7-946c-1ede20c6b298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:46.989672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.auth.core [None req-761d77e9-8dd3-40c7-946c-1ede20c6b298 None None] MFA Rules not processed for user `81e9805ec4c44cedb658b7becf768369`. Rule list: `[]` (Enabled: `True`). {{(pid=80117) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 10:46:46.990902 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-761d77e9-8dd3-40c7-946c-1ede20c6b298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:46.995932 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:47.063990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1480/2905] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Jun 15 10:46:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 10:46:47.075940 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dacae-7ffb-424f-89ae-458098e322cf None None] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:47.077701 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-716dacae-7ffb-424f-89ae-458098e322cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:47.093168 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dacae-7ffb-424f-89ae-458098e322cf None None] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:47.096862 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446804bb-fb98-44fd-ab74-aa329a540c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:47.097504 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446804bb-fb98-44fd-ab74-aa329a540c36 service neutron] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:47.097792 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446804bb-fb98-44fd-ab74-aa329a540c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:47.098074 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446804bb-fb98-44fd-ab74-aa329a540c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:47.108643 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446804bb-fb98-44fd-ab74-aa329a540c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:47.110087 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446804bb-fb98-44fd-ab74-aa329a540c36 service neutron] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:47.121249 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1426/2906] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:46:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:46:47.185698 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d77e9-8dd3-40c7-946c-1ede20c6b298 None None] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:47.187130 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-761d77e9-8dd3-40c7-946c-1ede20c6b298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:47.256059 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d77e9-8dd3-40c7-946c-1ede20c6b298 None None] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:47.261403 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adeea6-0ce6-438f-8729-af9fe775e63c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2729cb0b9adb44f7ba5c968b6158a93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:47.262052 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adeea6-0ce6-438f-8729-af9fe775e63c service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:47.262337 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adeea6-0ce6-438f-8729-af9fe775e63c service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:47.262618 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adeea6-0ce6-438f-8729-af9fe775e63c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:47.264760 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-85adeea6-0ce6-438f-8729-af9fe775e63c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:47.276396 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adeea6-0ce6-438f-8729-af9fe775e63c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:47.277989 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85adeea6-0ce6-438f-8729-af9fe775e63c service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:47.289127 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1481/2907] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:46:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:46:49.619783 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446804bb-fb98-44fd-ab74-aa329a540c36 service neutron] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:46:49.621324 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-446804bb-fb98-44fd-ab74-aa329a540c36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:49.637591 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446804bb-fb98-44fd-ab74-aa329a540c36 service neutron] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:46:49.643938 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650484c4-be3a-429e-9b8c-f4c72b03f8e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:46:49.644710 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650484c4-be3a-429e-9b8c-f4c72b03f8e3 service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:46:49.644996 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650484c4-be3a-429e-9b8c-f4c72b03f8e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:46:49.645273 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650484c4-be3a-429e-9b8c-f4c72b03f8e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:46:49.647365 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-650484c4-be3a-429e-9b8c-f4c72b03f8e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:46:49.657209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:49.662998 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650484c4-be3a-429e-9b8c-f4c72b03f8e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:46:49.664824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650484c4-be3a-429e-9b8c-f4c72b03f8e3 service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:46:49.695589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1427/2908] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:46:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 10:46:57.284791 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=59 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:46:59.676880 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=3 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:37.856546 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adeea6-0ce6-438f-8729-af9fe775e63c service placement] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:48:37.895001 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adeea6-0ce6-438f-8729-af9fe775e63c service placement] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:48:37.898650 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e5080-9266-4d0a-808c-47803f72a2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:48:37.899292 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e5080-9266-4d0a-808c-47803f72a2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:48:37.899611 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e5080-9266-4d0a-808c-47803f72a2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:48:37.899892 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e5080-9266-4d0a-808c-47803f72a2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:48:37.901654 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-3a3e5080-9266-4d0a-808c-47803f72a2b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:48:37.984020 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e5080-9266-4d0a-808c-47803f72a2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:48:37.985364 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e5080-9266-4d0a-808c-47803f72a2b1 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:48:37.994478 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1482/2909] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:48:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:48:38.850796 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650484c4-be3a-429e-9b8c-f4c72b03f8e3 service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:48:38.853757 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-650484c4-be3a-429e-9b8c-f4c72b03f8e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:48:38.965999 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650484c4-be3a-429e-9b8c-f4c72b03f8e3 service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:48:38.974470 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a034d-8b35-4714-9f40-d5154be18dbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:48:38.975198 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a034d-8b35-4714-9f40-d5154be18dbc service nova] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:48:38.975517 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a034d-8b35-4714-9f40-d5154be18dbc service nova] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:48:38.975892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a034d-8b35-4714-9f40-d5154be18dbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:48:38.978393 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-e90a034d-8b35-4714-9f40-d5154be18dbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:48:38.997378 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a034d-8b35-4714-9f40-d5154be18dbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:48:38.999457 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a034d-8b35-4714-9f40-d5154be18dbc service nova] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:48:39.015035 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1428/2910] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:48:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:48:41.401455 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e5080-9266-4d0a-808c-47803f72a2b1 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:48:41.416936 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e5080-9266-4d0a-808c-47803f72a2b1 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:48:41.423584 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f403a9-47a4-4954-9c39-520640c02722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81e9805ec4c44cedb658b7becf768369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:48:41.424263 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f403a9-47a4-4954-9c39-520640c02722 service nova] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:48:41.424584 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f403a9-47a4-4954-9c39-520640c02722 service nova] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:48:41.424990 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f403a9-47a4-4954-9c39-520640c02722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:48:41.426922 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-37f403a9-47a4-4954-9c39-520640c02722 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:48:41.446678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f403a9-47a4-4954-9c39-520640c02722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:48:41.448310 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f403a9-47a4-4954-9c39-520640c02722 service nova] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:48:41.460877 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1483/2911] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:48:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:48:41.758447 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a034d-8b35-4714-9f40-d5154be18dbc service nova] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:48:41.759924 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-e90a034d-8b35-4714-9f40-d5154be18dbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:48:41.800752 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a034d-8b35-4714-9f40-d5154be18dbc service nova] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:48:41.807968 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f9b17-852c-4fa0-977b-7b0421c61de4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2729cb0b9adb44f7ba5c968b6158a93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:48:41.808719 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f9b17-852c-4fa0-977b-7b0421c61de4 service placement] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:48:41.809010 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f9b17-852c-4fa0-977b-7b0421c61de4 service placement] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:48:41.809331 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f9b17-852c-4fa0-977b-7b0421c61de4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:48:41.811285 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-b47f9b17-852c-4fa0-977b-7b0421c61de4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:48:41.824279 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f9b17-852c-4fa0-977b-7b0421c61de4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:48:41.825936 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f9b17-852c-4fa0-977b-7b0421c61de4 service placement] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:48:41.837368 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1429/2912] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:48:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:48:42.734548 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f403a9-47a4-4954-9c39-520640c02722 service nova] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:48:42.744222 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f403a9-47a4-4954-9c39-520640c02722 service nova] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:48:42.747769 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f52f14-4740-4bba-8d90-84416997bdc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f2e2038f69f49019a1e528107296223', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:48:42.748404 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f52f14-4740-4bba-8d90-84416997bdc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:48:42.748707 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f52f14-4740-4bba-8d90-84416997bdc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:48:42.748964 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f52f14-4740-4bba-8d90-84416997bdc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:48:42.750816 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-a9f52f14-4740-4bba-8d90-84416997bdc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:48:42.835706 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f52f14-4740-4bba-8d90-84416997bdc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:48:42.837136 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f52f14-4740-4bba-8d90-84416997bdc0 service neutron] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:48:42.857340 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1484/2913] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:48:45.801963 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f9b17-852c-4fa0-977b-7b0421c61de4 service placement] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:48:45.813714 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f9b17-852c-4fa0-977b-7b0421c61de4 service placement] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:48:45.820514 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff0718-3d3d-4f82-bf31-cc26e4ade9ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2729cb0b9adb44f7ba5c968b6158a93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:48:45.821248 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff0718-3d3d-4f82-bf31-cc26e4ade9ad service placement] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:48:45.821528 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff0718-3d3d-4f82-bf31-cc26e4ade9ad service placement] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:48:45.821806 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff0718-3d3d-4f82-bf31-cc26e4ade9ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:48:45.823824 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c7ff0718-3d3d-4f82-bf31-cc26e4ade9ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:48:45.843388 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff0718-3d3d-4f82-bf31-cc26e4ade9ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:48:45.846029 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff0718-3d3d-4f82-bf31-cc26e4ade9ad service placement] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:48:45.860264 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1430/2914] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:48:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:48:49.005974 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f52f14-4740-4bba-8d90-84416997bdc0 service neutron] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:48:49.013391 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=100 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:49.018789 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f52f14-4740-4bba-8d90-84416997bdc0 service neutron] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:48:49.025028 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622be3b-b647-4774-b5af-ba1e0b7e4a25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2729cb0b9adb44f7ba5c968b6158a93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:48:49.025765 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622be3b-b647-4774-b5af-ba1e0b7e4a25 service placement] REQUEST_METHOD: `GET` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:48:49.026051 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622be3b-b647-4774-b5af-ba1e0b7e4a25 service placement] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:48:49.026323 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622be3b-b647-4774-b5af-ba1e0b7e4a25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:48:49.028183 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-d622be3b-b647-4774-b5af-ba1e0b7e4a25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:48:49.041180 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622be3b-b647-4774-b5af-ba1e0b7e4a25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:48:49.043167 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622be3b-b647-4774-b5af-ba1e0b7e4a25 service placement] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:48:49.056794 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1485/2915] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:48:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:48:49.072681 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff0718-3d3d-4f82-bf31-cc26e4ade9ad service placement] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:48:49.074209 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-c7ff0718-3d3d-4f82-bf31-cc26e4ade9ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:48:49.088299 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff0718-3d3d-4f82-bf31-cc26e4ade9ad service placement] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:48:49.094229 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d94fff-2941-493b-86d2-becef1a196fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:48:49.095372 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d94fff-2941-493b-86d2-becef1a196fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:48:49.100920 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d94fff-2941-493b-86d2-becef1a196fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:48:49.101214 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d94fff-2941-493b-86d2-becef1a196fc admin admin] PATH_INFO: `/v3/users/9ec84740135e4bd8989378635cdd9133` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:48:49.103287 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d94fff-2941-493b-86d2-becef1a196fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec84740135e4bd8989378635cdd9133)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:48:49.105309 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d94fff-2941-493b-86d2-becef1a196fc admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:48:49.155525 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-38d94fff-2941-493b-86d2-becef1a196fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec84740135e4bd8989378635cdd9133'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.167554 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-38d94fff-2941-493b-86d2-becef1a196fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec84740135e4bd8989378635cdd9133'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.168344 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-38d94fff-2941-493b-86d2-becef1a196fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec84740135e4bd8989378635cdd9133'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.175439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-38d94fff-2941-493b-86d2-becef1a196fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec84740135e4bd8989378635cdd9133'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.176152 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-38d94fff-2941-493b-86d2-becef1a196fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec84740135e4bd8989378635cdd9133'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.184305 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:49.189949 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1431/2916] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:48:49 2022] DELETE /identity/v3/users/9ec84740135e4bd8989378635cdd9133 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:48:49.366328 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622be3b-b647-4774-b5af-ba1e0b7e4a25 service placement] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:48:49.378749 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622be3b-b647-4774-b5af-ba1e0b7e4a25 service placement] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:48:49.453815 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:48:49.454695 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:48:49.454975 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:48:49.455254 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] PATH_INFO: `/v3/projects/88745bc830b44d409544a8d167954f89` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:48:49.456494 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88745bc830b44d409544a8d167954f89)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:48:49.458427 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:48:49.505538 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88745bc830b44d409544a8d167954f89', 'request_id': 'req-445d6292-b225-403b-996a-c95b1f9c4c03'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.511320 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88745bc830b44d409544a8d167954f89', 'request_id': 'req-445d6292-b225-403b-996a-c95b1f9c4c03'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.518358 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88745bc830b44d409544a8d167954f89', 'request_id': 'req-445d6292-b225-403b-996a-c95b1f9c4c03'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.532046 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] The token cache is being invalidate because project 88745bc830b44d409544a8d167954f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:48:49.532415 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.533194 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.534896 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1486/2917] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:48:49 2022] DELETE /identity/v3/projects/88745bc830b44d409544a8d167954f89 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:48:49.539056 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d94fff-2941-493b-86d2-becef1a196fc admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:48:49.540501 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-38d94fff-2941-493b-86d2-becef1a196fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:48:49.555101 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d94fff-2941-493b-86d2-becef1a196fc admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:48:49.609734 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e93fe3-4688-46cc-875c-c3d598cf93ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:48:49.610662 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e93fe3-4688-46cc-875c-c3d598cf93ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:48:49.610944 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e93fe3-4688-46cc-875c-c3d598cf93ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:48:49.611218 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e93fe3-4688-46cc-875c-c3d598cf93ed admin admin] PATH_INFO: `/v3/users/18fa316e7e784ccb860f5006ae3960e7` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:48:49.612458 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e93fe3-4688-46cc-875c-c3d598cf93ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=18fa316e7e784ccb860f5006ae3960e7)` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:48:49.614890 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e93fe3-4688-46cc-875c-c3d598cf93ed admin admin] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:48:49.661742 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-90e93fe3-4688-46cc-875c-c3d598cf93ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18fa316e7e784ccb860f5006ae3960e7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.673589 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-90e93fe3-4688-46cc-875c-c3d598cf93ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18fa316e7e784ccb860f5006ae3960e7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.674409 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-90e93fe3-4688-46cc-875c-c3d598cf93ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18fa316e7e784ccb860f5006ae3960e7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.682155 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-90e93fe3-4688-46cc-875c-c3d598cf93ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18fa316e7e784ccb860f5006ae3960e7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.683086 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.notifications [None req-90e93fe3-4688-46cc-875c-c3d598cf93ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18fa316e7e784ccb860f5006ae3960e7'} {{(pid=80118) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:49.695439 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1432/2918] 10.222.0.50 () {58 vars in 1223 bytes} [Wed Jun 15 10:48:49 2022] DELETE /identity/v3/users/18fa316e7e784ccb860f5006ae3960e7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:48:49.866199 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] Authenticating user token {{(pid=80117) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:48:49.867679 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.fernet_utils [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80117) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:48:49.886727 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d6292-b225-403b-996a-c95b1f9c4c03 admin admin] Validating token access rules against request {{(pid=80117) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:48:49.944553 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeefe4-d146-4020-9593-aabe5c47bf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283045f7f6ca4861bfbecc3aa402c697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e426bab74fde45f595bae4efed952751', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80117) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:48:49.945394 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeefe4-d146-4020-9593-aabe5c47bf6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:48:49.945672 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeefe4-d146-4020-9593-aabe5c47bf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:48:49.945942 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeefe4-d146-4020-9593-aabe5c47bf6b admin admin] PATH_INFO: `/v3/projects/829a06c114c64c1bbfece8a0d7718159` {{(pid=80117) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:48:49.947097 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbeefe4-d146-4020-9593-aabe5c47bf6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=829a06c114c64c1bbfece8a0d7718159)` {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:48:49.949396 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbeefe4-d146-4020-9593-aabe5c47bf6b admin admin] RBAC: Authorization granted {{(pid=80117) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:48:49.971223 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:48:49.995678 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7cbeefe4-d146-4020-9593-aabe5c47bf6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829a06c114c64c1bbfece8a0d7718159', 'request_id': 'req-7cbeefe4-d146-4020-9593-aabe5c47bf6b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:50.000965 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7cbeefe4-d146-4020-9593-aabe5c47bf6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829a06c114c64c1bbfece8a0d7718159', 'request_id': 'req-7cbeefe4-d146-4020-9593-aabe5c47bf6b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:50.008428 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7cbeefe4-d146-4020-9593-aabe5c47bf6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829a06c114c64c1bbfece8a0d7718159', 'request_id': 'req-7cbeefe4-d146-4020-9593-aabe5c47bf6b'} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:50.019460 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7cbeefe4-d146-4020-9593-aabe5c47bf6b admin admin] The token cache is being invalidate because project 829a06c114c64c1bbfece8a0d7718159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80117) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 10:48:50.020282 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7cbeefe4-d146-4020-9593-aabe5c47bf6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:50.020922 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG keystone.notifications [None req-7cbeefe4-d146-4020-9593-aabe5c47bf6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80117) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 10:48:50.022487 dv-cinder-843493-2-smb devstack@keystone.service[80117]: [pid: 80117|app: 0|req: 1487/2919] 10.222.0.50 () {58 vars in 1232 bytes} [Wed Jun 15 10:48:49 2022] DELETE /identity/v3/projects/829a06c114c64c1bbfece8a0d7718159 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 10:48:59.691893 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:49:00.016622 dv-cinder-843493-2-smb devstack@keystone.service[80117]: DEBUG dbcounter [-] [80117] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=80117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 10:53:53.080465 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e93fe3-4688-46cc-875c-c3d598cf93ed admin admin] Authenticating user token {{(pid=80118) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 10:53:53.081892 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-90e93fe3-4688-46cc-875c-c3d598cf93ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:53:53.151984 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e93fe3-4688-46cc-875c-c3d598cf93ed admin admin] Validating token access rules against request {{(pid=80118) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 10:53:53.209630 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc456c14-de85-4d2a-bbd4-1a3b3cf8fdf5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2729cb0b9adb44f7ba5c968b6158a93c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab2eb230241340229293ca1aa5585cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80118) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 10:53:53.210281 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc456c14-de85-4d2a-bbd4-1a3b3cf8fdf5 service placement] REQUEST_METHOD: `GET` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 10:53:53.210564 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc456c14-de85-4d2a-bbd4-1a3b3cf8fdf5 service placement] SCRIPT_NAME: `/identity` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 10:53:53.210839 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc456c14-de85-4d2a-bbd4-1a3b3cf8fdf5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80118) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 10:53:53.212696 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.fernet_utils [None req-bc456c14-de85-4d2a-bbd4-1a3b3cf8fdf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80118) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 10:53:53.223769 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc456c14-de85-4d2a-bbd4-1a3b3cf8fdf5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 10:53:53.225370 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc456c14-de85-4d2a-bbd4-1a3b3cf8fdf5 service placement] RBAC: Authorization granted {{(pid=80118) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 10:53:53.235185 dv-cinder-843493-2-smb devstack@keystone.service[80118]: [pid: 80118|app: 0|req: 1433/2920] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Jun 15 10:53:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 10:54:03.231449 dv-cinder-843493-2-smb devstack@keystone.service[80118]: DEBUG dbcounter [-] [80118] Writing DB stats keystone:SELECT=58 {{(pid=80118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}